ChatGPT rival Pi, from Inflection, now performs “neck and neck with” OpenAI’s GPT-4 thanks to a new model, according to data first shared with Axios.

Why it matters: Inflection faces a crowded field in the market for AI-based assistants, competing against better-heeled rivals including Google, Microsoft and OpenAI, among others.

Driving the news: Inflection is announcing Thursday that Pi has been using a new model, version 2.5, in recent weeks and that the updated engine is now “powering Pi for the majority of users.” — Read More

Today, we’re announcing the Claude 3 model family, which sets new industry benchmarks across a wide range of cognitive tasks. The family includes three state-of-the-art models in ascending order of capability: Claude 3 Haiku, Claude 3 Sonnet, and Claude 3 Opus. Each successive model offers increasingly powerful performance, allowing users to select the optimal balance of intelligence, speed, and cost for their specific application.

Opus and Sonnet are now available to use in claude.ai and the Claude API which is now generally available in 159 countries. Haiku will be available soon. — Read More

Today, OpenAI announced it is adding a major upgrade to its signature web-based chatbot application, ChatGPT: persistent memory.

Rolling out slowly for selected users of ChatGPT’s free tier and paid subscription ChatGPT Plus ($20 per month) to start, the feature will allow users to ask ChatGPT to remember information they give it, which the app can then recall later, even across new, unrelated chat sessions.  – Read More

Artificial intelligence seems more powerful than ever, with chatbots like Bard and ChatGPT capable of producing uncannily humanlike text. But for all their talents, these bots still leave researchers wondering: Do such models actually understand what they are saying? “Clearly, some people believe they do,” said the AI pioneer Geoff Hinton in a recent conversation with Andrew Ng, “and some people believe they are just stochastic parrots.”

This evocative phrase comes from a 2021 paper co-authored by Emily Bender, a computational linguist at the University of Washington. It suggests that large language models (LLMs) — which form the basis of modern chatbots — generate text only by combining information they have already seen “without any reference to meaning,” the authors wrote, which makes an LLM “a stochastic parrot.”

These models power many of today’s biggest and best chatbots, so Hinton argued that it’s time to determine the extent of what they understand. The question, to him, is more than academic. “So long as we have those differences” of opinion, he said to Ng, “we are not going to be able to come to a consensus about dangers.”

New research may have intimations of an answer. A theory developed by Sanjeev Arora of Princeton University and Anirudh Goyal, a research scientist at Google DeepMind, suggests that the largest of today’s LLMs are not stochastic parrots. The authors argue that as these models get bigger and are trained on more data, they improve on individual language-related abilities and also develop new ones by combining skills in a manner that hints at understanding — combinations that were unlikely to exist in the training data. – Read More

A Theory for Emergence of Complex Skills in Language Models

Skill-Mix: a Flexible and Expandable Family of Evaluations for AI models

OpenAI says it is investigating complaints about ChatGPT having become “lazy”.

In recent days, more and more users of the latest version of ChatGPT – built on OpenAI’s GPT-4 model – have complained that the chatbot refuses to do as people ask, or that it does not seem interested in answering their queries.

If the person asks for a piece of code, for instance, it might just give a little information and then instruct users to fill in the rest. Some complained that it did so in a particularly sassy way, telling people that they are perfectly able to do the work themselves, for instance.  – Read More

Inflection AI, the startup behind the conversational chatbot Pi, has unveiled a new AI model that the company claims can outperform two popular alternatives developed by Google and Meta — and is hot on the heels of OpenAI’s larger, flagship model GPT-4.

Called Inflection-2, the model performed better than Google’s PaLM Large 2 model previously announced in May on a number of standard benchmarks, Inflection said, while beating the open-source LLaMA 2 model largely developed by Meta on different measures. Overall, Inflection’s model is the top-performing of its size, the startup said. It only trails GPT-4, the flagship released model from OpenAI, thought to be significantly larger. — Read More

The biggest announcement from last week’s OpenAI DevDay (and there were a LOT of announcements) was GPTs. Users of ChatGPT Plus can now create their own, custom GPT chat bots that other Plus subscribers can then talk to.

My initial impression of GPTs was that they’re not much more than ChatGPT in a trench coat—a fancy wrapper for standard GPT-4 with some pre-baked prompts.

Now that I’ve spent more time with them I’m beginning to see glimpses of something more than that. The combination of features they provide can add up to some very interesting results. — Read More

On a simulated day in July of a 2020 that didn’t happen, 500 chatbots read the news — real news, our news, from the real July 1, 2020. ABC News reported that Alabama students were throwing “COVID parties.” On CNN, President Donald Trump called Black Lives Matter a “symbol of hate.” The New York Times had a story about the baseball season being canceled because of the pandemic.

Then the 500 robots logged into something very much (but not totally) like Twitter, and discussed what they had read. Meanwhile, in our world, the not-simulated world, a bunch of scientists were watching. — Read More

Grok is an AI modeled after the Hitchhiker’s Guide to the Galaxy, so intended to answer almost anything and, far harder, even suggest what questions to ask!

Grok is designed to answer questions with a bit of wit and has a rebellious streak, so please don’t use it if you hate humor!

A unique and fundamental advantage of Grok is that it has real-time knowledge of the world via the 𝕏 platform. It will also answer spicy questions that are rejected by most other AI systems. — Read More