Claude AI, A Competitor To Chatgpt From Entropic, Can Now Understand A Book Containing About 75,000 Words In Seconds.

This is a giant leap forward for chatbots as businesses look for technology that can quickly generate large chunks of information.

Since the launch of ChatGPT, we’ve also seen companies like Bloomberg and JPMorgan Chase look to harness the power of AI to understand the financial world better. While this process used to take at least a few months, Entropic, with its Claude AI, can reduce the time spent to a few seconds.

How did Entropic supercharge its AI?

In computing terms, a token is a part of words used to simplify data processing. The number of tickets a large language model (LLM) can process in a given time is called the context window, similar to short-term memory.

An average human can read 100,000 tokens in about five hours.

However, this time is only spent reading the tokens and may take longer if you must remember and analyze this information.

OpenAI’s GPT-4 LLM has a text window of 4096 tokens (about 3000 words) when using ChatGPT but can be expanded to 32768 tickets when using the GPT-4 API. ClaudeAI’s text window was around 9,000 tokens, but the company has increased it to 100,000 tokens (75,000 words).

To demonstrate how Claude AI can improve performance, Entropic uploaded the entire text of The Great Gatsby (72,000 tokens) with a modified line from the original. The company claimed in a press release that the AI ​​was tasked with spotting the difference, which it did in just 22 seconds.

This may not seem very impressive to those who have used word processors to find the difference between two texts. AI excels over word processors in its ability to answer and analyze text questions in depth.

Entropic is looking for businesses that need to process large amounts of documents to use their AI and ask specific questions of Claude AI in the future. Claude can search for particular information and return results like any chatbot, just as a human assistant would.

Entropic also used Claude AI to process the transcript of a six-hour podcast recording, summarize it, and answer questions. The company believes the same can be applied to financial reports and legal documents and improving code or answering technical questions.

With an improved text window, Claude AI is available through the Claude API and has a waiting list.