In this repo, we release a permissively licensed open source reproduction of Meta AI’s LLaMA large language model. In this release, we’re releasing a public preview of the 7B OpenLLaMA model that has been trained with 200 billion tokens. We provide PyTorch and Jax weights of pre-trained OpenLLaMA models, as well as evaluation results and comparison against the original LLaMA models. Stay tuned for our updates. Read More
Daily Archives: May 3, 2023
This Content is for Human Consumption Only
ChatGPT has subverted everyone’s predictions on automation. Just a few years ago, it seemed most likely that the manual, boring, and rote jobs would be automated—but in the presence of GPT and the other newest gargantuan deep learning models like DALL-E, it seems more likely that writers, artists, and programmers are the most vulnerable to displacement. Everyone’s freaking out about it, including me, except mine is more of a cynical freak out: I don’t want to live in a world where AI content is ubiquitous and human content is sparse and poorly incentivized—if only because the professions of a writer, artist, programmer etc. are some of the most fulfilling vocations out there. If the technological trend continues, we’re facing a future world where intellectual work no longer exists. This is the worst imaginable end-stage capitalism dystopia, in which the only ways to make money are the grueling physical jobs like nursing and commercial kitchens (if you work in a field like that, you have my deepest respect). Read More
Geoffrey Hinton tells us why he’s now scared of the tech he helped build
“I have suddenly switched my views on whether these things are going to be more intelligent than us.”
I met Geoffrey Hinton at his house on a pretty street in north London just four days before the bombshell announcement that he is quitting Google. Hinton is a pioneer of deep learning who helped develop some of the most important techniques at the heart of modern artificial intelligence, but after a decade at Google, he is stepping down to focus on new concerns he now has about AI.
Stunned by the capabilities of new large language models like GPT-4, Hinton wants to raise public awareness of the serious risks that he now believes may accompany the technology he ushered in. Read More
Rick's Cafe AI 