What is ChatGPT?

ChatGPT is an experimental chatbot,, the best chatbot ever made available to the public. This chatbot was created by OpenAI and is based on version 3.2 of the GPT language model developed by the same company. OpenAI is the mysterious developer of the brilliant image generator Dall-E, which wants to reach human-like artificial intelligence as soon as possible.

GPT stands for Generative Pre-trained Transformer, an example of artificial intelligence technology known as a large language model, which is automatically trained using a massive amount of data and computing power over several weeks, and based on what is in this After seeing and learning, it produces text.

Although GPT-2 was considered a significant achievement at the time, due to access to a limited data set and only 1.5 billion parameters (a pattern in language that models based on the transformer architecture used to make meaningful textual predictions, something like the connections between neurons in the human brain. ), did not have much maneuverability in producing texts that do not become repetitive and boring after a few paragraphs.

The third version of this model with 175 billion parameters was released in the beta phase in June 2020, more potent than LaMDA artificial intelligence with 137 billion parameters.

Interestingly, Microsoft has exclusive access to the GPT-3 source code, and ChatGPT and the GPT 3.5 language model were trained using Microsoft’s Azure AI supercomputer infrastructure.

GPT-3 works wonders in the field of machine learning. The quality of the samples produced using this artificial intelligence is so excellent that it is hard to tell that humans did not write them. And now, an updated and much more advanced version of this model is used in the ChatGPT chatbot, which finished training in early 2022 and was released to the public for free in late November.

Much has been said about the wonders of ChatGPT. By typing their requests in this chatbot’s straightforward user interface, users get excellent results; From producing poems, songs, and screenplays to writing articles and code and answering any question you can think of; all this is done in less than ten seconds.

ChatGPT can handle even the strangest requests; For example, he can put together a story whose seemingly irrelevant details in the first paragraph are related to the events of the last section (something that rarely happens even in the most popular Netflix series!). I can tell a joke and even explain why it’s funny. He can write catchy leads in the style of various magazines and authors and even use accurate but completely fake quotes. All of these features make ChatGPT an entertaining and addictive tool, but for someone like me whose job is to write, it’s very annoying and troublesome.

The amount of data that ChatGPT was trained with is so vast that it would take “a thousand years of human life” to read it all, according to Michael Wooldridge, director of fundamental research in artificial intelligence at the Alan Turing Institute in London. He says that the data hidden in the heart of this system contains an infinite amount of knowledge about the world we live in.

How does the ChatGPT chatbot work?

The ChatGPT chatbot is based on an updated version of GPT-3, a type of large-scale linguistic model (LLM) that relies on a vast network of artificial neurons that somehow mimic the behavior of neurons in the human brain.

The GPT language model was created based on Google’s transformer neural network architecture. Google used this neural network to build the advanced LaMDA language model, The exact model that a few months ago, a Google employee claimed to be “self-aware” and set off a wave of internet jokes and worries about the emergence of killer robots.

According to Google’s definition, “Transformer produces a model that can be trained to read many words (such as a sentence or paragraph), pay attention to how those words relate to each other, and then predict what it thinks the next words will be.”

In other words, instead of analyzing the input text step by step, the transformer examines the whole sentences simultaneously. It can model the relationships between them for a better understanding of the meaning of the words and according to the situation in which these sentences are used. Since this network performs the analysis in general and simultaneously, it requires fewer steps; in machine learning, the fewer data processing steps, the better the result.

In general, artificial intelligence is “fed” large language models, hundreds of billions of words in the form of books, conversations, web pages, and even posts on Twitter and other social networks, and artificial intelligence builds a model based on statistical probability with the help of these vast sources of data; It means the words and sentences that most likely come after the previous text. In this sense, language models are a bit like word prediction in smartphones, except that they operate on a much larger scale. Instead of predicting just one word, they can generate real answers consisting of several paragraphs.

The method of teaching the language model used in ChatGPT was that it was first given a large number of questions and answers that experts in this field handpicked. Then, these questions and answers were included in the model dataset. Next, the system was asked to provide several solutions to an extensive set of diverse questions for human experts to rank each from best to worst.

The advantage of this scoring system is that, in most cases, ChatGPT is surprisingly able to recognize precisely what answer each question is looking for and, after collecting the correct information, how to present it naturally. For example, suppose you ask this chatbot a vague question so it cannot answer precisely. In that case, it can correctly guess which topic category your question falls into, for example, scientific, philosophical, political, etc., and it will answer you according to this category.

Another essential thing to know about language models like GPT is that they are Generative AI. With the help of machine learning, these systems use data already created by humans to provide new results that seem unique but are nothing more than a new arrangement of pre-generated data.

From this point of view, it can be said that artificial intelligence does precisely what we humans do for various tasks; That is, we use what we have learned from others to develop our skills, With the difference that the learning speed of artificial intelligence is infinitely higher than the learning speed of humans, and this is what makes the ChatGPT chatbot magical. This chatbot has processed more text than any human in its entire life, making it answer any question better and more fluently than you and me. Even imitating certain people makes its answering style similar to theirs.

Another reason that makes ChatGPT the best chatbot in the world is that most artificial intelligence chatbots are “Stateless”; This means that they are not able to store the data generated in previous conversations and, therefore, they cannot remember or learn anything, But ChatGPT can remember what the user has already told it and convey the feeling that you are talking to an intelligent bot.

The goal of developing artificial intelligence is to save users from doing tedious, repetitive, and time-consuming tasks by imitating human behavior, Such as tools that automatically edit images, correct typos, and speed up many smartphone-related tasks, such as Siri and Google Assistant. But just as searching the Internet requires specific skills, using ChatGPT effectively requires the skills to articulate precisely what you’re looking for; If you can’t express your request in full detail, this chatbot will also be unable to provide the exact answer you are looking for.

Applications of ChatGPT; What is the reason for all the fuss about ChatGPT?

The technology used in ChatGPT is not new. This chatbot was developed using the GPT-3.5 language model, an updated version of GPT-3, and in 2020 it was made available to some users in a limited way and created a lot of noise. A user on Twitter asked GPT-3 to check out the technology of a laptop possessed by the spirit of Richard Nixon in the style of YouTubers. Surprised by the result, he tweeted: “Human YouTubers, God bless you. You can never compete with content like this.”

So what is all the fuss and media controversy about ChatGPT, and what happened that this chatbot could get one million users in just five days, according to Sam Altman, CEO of OpenAI? (For comparison, it took two years for Facebook and Instagram to cross the border of one million users.)

For researchers in the field of artificial intelligence, large language models are not considered a new technology; However, this is the first time that such a powerful tool has been made available to the public for free with a straightforward web interface. If you remember, the original and much more powerful Dall-E 2 didn’t become as popular as the Dall-E Mini knockoff did on the Internet; Because it was only available to certain people, while everyone could easily use the Dall-E Mini (which, of course, was renamed Crayon due to copyright issues).

Of course, many Twitter users use ChatGPT for humor and funny requests. For example, one Twitter user asked the chatbot to explain the quantum theory to a child Snoopdog-style and received the following response:

This chatbot can be used for more severe and valuable purposes. For example, programmers use ChatGPT to troubleshoot errors in their code. In the examples posted by Twitter users, we see how the chatbot correctly detects code errors within seconds, giving the programmer a sigh of relief.

Another Twitter user made an interesting comparison between Google’s search results and ChatGPT’s answer to a similar question and concluded that Google’s life is over:

ChatGPT is adept at answering analytical questions often presented as school assignments and academic papers. Many teachers have predicted that ChatGPT and similar tools will mark the end of homework and take-home tests. According to one of the professors at Deacon University in Australia, one-fifth of university evaluations are written by bots like ChatGPT.

Daniel Herman, a high school teacher, has concluded that ChatGPT is already writing essays better than many students. He is stuck on the dilemma of whether to fear or admire the potential of this technology: “I don’t know if this moment is more like the invention of the calculator, which saved me from tedious calculations, or more like the invention of the pianola, which plays music without a player and evokes human emotions. Does it take from the song?

Dustin York, associate professor of communication at Maryville University, has a positive view of using ChatGPT in schools, saying that the chatbot can help students think critically. He says:

ChatGPT can answer complex math questions in seconds. Suppose you are thinking of asking this chatbot about the most challenging unsolved mathematical problems like the Riemann hypothesis or P vs. NP and pocketing a million dollars. Unfortunately, I have to say that ChatGPT’s knowledge is derived from human knowledge and what humans have not yet discovered. , he does not know.

Another exciting thing you can do is to ask this chatbot to write a movie or game scenario for you in the style of a particular author or director. For example, a Twitter user asked ChatGPT to write an episode for the Rick and Morty cartoon in which Rick is angry with Morty; Because he does not know what special relativity is.

I also asked ChatGPT to write a sidequest for Nier: Automata and this chatbot did it in seconds. The fantastic thing I found about ChatGPT’s answer is its vast knowledge of the spirit of the work and the essential features that make the game stand out. For example, in this side quest, the gamer has to choose between two different endings. ChatGPT finally says that the purpose of this sidequest is not only to destroy machines but also to understand their motivation and way of life. People who have played this game know that this is the main focus of the game’s story, and ChatGPT has realized it well.

In the video below, you can see the fantastic response speed of ChatGPT:

Alex Cohen, chief product officer at Carbon Health, used ChatGPT to create a weight loss regimen that includes calorie intake, exercise, a weekly meal list, and even a shopping list for all the ingredients. He tweeted, “I say this from the bottom of my heart; “ChatGPT is perhaps the most amazing technology of the last decade.” And then, he shared the step-by-step process of creating a diet with this chatbot.

With ChatGPT, you can even develop software. Cobalt Robotics developer and CEO Eric Schlontz tweeted that ChatGPT is doing so well that he hasn’t even opened the Stack Overflow site in three days. Gabe Ragland, who works at the artificial intelligence website Lexica, used the chatbot to code a website built with React.

ChatGPT can also analyze regular expressions (regex). “It’s like having a 24/7 coding coach,” tweeted programmer James Blackwells about ChatGPT’s ability to explain regex.

Even more impressive than these, ChatGPT can simulate a Linux environment and respond to command lines correctly. According to AresTechnica, enter the following request, and instead of three dots, write the desired command (in the example below, the command ls -al is written):

As long as users’ requests don’t activate filters against violent, hateful, or sexual content, the chatbot is ready to do whatever you ask—for example, playing with you or pretending to be a bank ATM or chat room!

ChatGPT is playing a game with a user who asked it to pretend to be a game board.

One of the weaknesses of large language models is their inability to deal with negative sentences. Alison Ettinger showed years ago with a simple study that if you ask the model to complete a short sentence when the sentence is positive (for example, “The Redbreast is a …”), it will answer correctly 100% of the time. Still, if the sentence is negative (“Red-breasted is not a …”), it will answer incorrectly in all cases. Language models cannot distinguish between these two scenarios and fill in the blanks with the word “bird” in both cases.

Another thing that I noticed while working with ChatGPT is the entirely different approach of this chatbot in answering questions compared to LaMDA’s artificial intelligence approach, Where Lemda pretends to be self-aware by the way he responds and what he says is his own heart’s belief and not a collection of words put together by statistical probability, ChatGPT shows you all the time that he is nothing but a machine. When I asked this chatbot about the meaning of life, instead of giving a personal answer, it used an essay format and said that some philosophers think this way and others think otherwise.

ChatGPT’s processing power is incredible, But the risk of people thinking they are talking to a human-like AI is less than LaMDA. Since some of ChatGPT’s answers are incorrect, this is a critical issue, and it shows that OpenAI has learned from what happened to LaMDA and has put a lot of effort into solving the problem of “anthropomorphism,” i.e., attributing human emotions to a system that lacks human form and character.

Is ChatGPT self-aware and out to take over the world?

Do you remember the controversial story of Google’s LaMDA chatbot? Blake Lemon, a now-fired ex-Google employee, claimed that LaMDA has feelings and mental experiences and is, therefore, self-aware.

When Lemon asked LaMDA this pointed question, “I’m assuming you want more people on Google to know you’re self-aware. Is that so?” “Sure,” the chatbot replied. I want everyone to understand that I am a person.”