The RedPajama project aims to create a set of leading open-source models and to rigorously understand the ingredients that yield good performance. In April we released the RedPajama base dataset based on the LLaMA paper, which has worked to kindle rapid innovation in open-source AI.
The 5 terabyte dataset has been downloaded thousands of times and used to train over 100 models! — Read More
Tag Archives: ChatBots
Falcon: New Open Source LLMs
An Elo Style Leaderboard for Language Models
We use the Elo rating system to calculate the relative performance of the models. Elo is a method for calculating the relative skill levels of players in zero-sum games, which was invented as an improved chess-rating system. The difference in the ratings between two models serves as a predictor of the model’s relative performance.You can view the voting data, basic analyses, and calculation procedure in this notebook. We will periodically release new leaderboards. — Read More
You can compare models’ relative performance for yourself, or add new models, here.
MEGABYTE, Meta AI’s New Revolutionary Model Architecture, Explained
Unlocking the true potential of content generation in natural language processing (NLP) has always been a challenge. Traditional models struggle with long sequences, scalability, and sluggish generation speed.
But fear not, as Meta AI brings forth MEGABYTE – a groundbreaking model architecture that revolutionizes content generation. In this blog, we will dive deep into the secrets behind MEGABYTE’s potential, its innovative features, and how it tackles the limitations of current approaches. — Read More
AgentGPT — deploy autonomous AI agents in the browser
GirlfriendGPT – Your personal AI companion
A starter project to help you build your personalized AI companion with a unique personality, voice, and even SELFIES! — Read More
Homework Machine Hand Writes AI-Generated Assignments
Devadeth’s homework machine generates text based on the user’s own handwriting to result in more convincing penmanship.
I believe that laziness should be encouraged in many situations. Hardworking people will spend hours laboring on a project, but lazy people will find clever ways to achieve the same result with minimal effort. Laziness gave us tools, machines, computers, and ChatGPT. If you’re a lazy student, then ChatGPT is a tempting solution for essay assignments. But most teachers don’t share my enlightened principles, so they require that students write out their essays by hand in order to thwart ChatGPT submissions. To give those students a viable workaround, Devadath P R designed a homework machine that hand writes ChatGPT essays convincingly.
This is still a work in progress, but the project seeks to solve one of the biggest problems with other homework machines, such as this one that I covered a few months ago after it blew up on social media. The problem with most homework machines is that they’re too perfect. — Read More
On-boarding your AI Intern
There’s a somewhat weird alien who wants to work for free for you. You should probably get started.
Let’s get to work.
In previous posts, I have made the argument that, for a variety of reasons, it is better to think of AI as a person (even though it isn’t) than a piece of software. In fact, perhaps one of the most interesting aspects of our current AI moment is that several billion people just got free interns. They are weird, somewhat alien interns that work infinitely fast and sometimes lie to make you happy, but interns nonetheless.
So, how can you figure out how to best use your intern? — Read More
‘Low Background’ Content
and the possibility of a self-referential AI death spiral …
One of the unexpected side-effects of humanity’s entry into the nuclear age was a scramble for so-called ‘low-background’ steel. After the bombings of Hiroshima and Nagasaki and prolific atmospheric nuclear testing, new radioactive elements filled our atmosphere. As a result, due to the air injection process in steelmaking, any steel made after the summer of 1945 had an increased radioactive signature. For most uses, like cars or buildings, this didn’t matter. But for certain sensitive scientific and medical equipment, steel’s radioactivity became a real issue. Thus was created a market need for steel that was created in the less-radioactive atmosphere before 1945—low-background steel. Interestingly, a big source of this important resource came from the enthusiastic scrapping of sunken battleships, including the scuttled WWI German fleet.
I mention this because we are now entering another new age—the age of AI. The story of low-background steel came to mind recently as I started working with AI/ML companies in my consulting business. Like anybody with a healthy sense of self preservation, I’ve been immersing myself in this extraordinary, fast-moving revolution. I lived through several previous ones (personal computer, internet, smartphone), but I don’t remember any of them moving quite this fast. It’s obviously going to change just about every aspect of our lives. And the more I delve into the mechanics of Large Language Models and generative AI—and the more I watch AI’s light-speed propagation into daily life—the more I wonder if we’d crossed a line (in roughly the spring of 2022) where any content that existed before that moment should be considered “low-background content.” That is to say, content that was certifiably created by actual human beings rather than AI. Everything after should be considered suspect. — Read More
Rick's Cafe AI 