Recent progress in large language models has enabled the deployment of many generative NLP applications. At the same time, it has also led to a misleading public discourse that “it’s all been solved.” Not surprisingly, this has in turn made many NLP researchers — especially those at the beginning of their career — wonder about what NLP research area they should focus on. This document is a compilation of NLP research directions that are rich for exploration, reflecting the views of a diverse group of PhD students in an academic research lab. While we identify many research areas, many others exist; we do not cover those areas that are currently addressed by LLMs but where LLMs lag behind in performance, or those focused on LLM development. — Read More
Monthly Archives: May 2023
Lawyer cites fake cases invented by ChatGPT, judge is not amused
Legal Twitter is having tremendous fun right now reviewing the latest documents from the case Mata v. Avianca, Inc. (1:22-cv-01461). Here’s a neat summary:
So, wait. They file a brief that cites cases fabricated by ChatGPT. The court asks them to file copies of the opinions. And then they go back to ChatGPT and ask it to write the opinions, and then they file them?
– Beth Wilensky, May 26 2023
Here’s a New York Times story about what happened. — Read More
An Elo Style Leaderboard for Language Models
We use the Elo rating system to calculate the relative performance of the models. Elo is a method for calculating the relative skill levels of players in zero-sum games, which was invented as an improved chess-rating system. The difference in the ratings between two models serves as a predictor of the model’s relative performance.You can view the voting data, basic analyses, and calculation procedure in this notebook. We will periodically release new leaderboards. — Read More
You can compare models’ relative performance for yourself, or add new models, here.
MEGABYTE, Meta AI’s New Revolutionary Model Architecture, Explained
Unlocking the true potential of content generation in natural language processing (NLP) has always been a challenge. Traditional models struggle with long sequences, scalability, and sluggish generation speed.
But fear not, as Meta AI brings forth MEGABYTE – a groundbreaking model architecture that revolutionizes content generation. In this blog, we will dive deep into the secrets behind MEGABYTE’s potential, its innovative features, and how it tackles the limitations of current approaches. — Read More
AgentGPT — deploy autonomous AI agents in the browser
Meta’s AI just became the first to outwit human players in Diplomacy
Is there any strategy or alliance too complex for its ruthless intelligence?
Meta AI made a groundbreaking announcement with the launch of CICERO – the first-ever AI (artificial intelligence) capable of winning at Diplomacy, a multiplayer strategy game that calls for mutual trust, compromise, and teamwork. This marks a significant milestone in AI evolution.
Meta stated, ‘AI has come a long way, demonstrating its capabilities by beating grandmasters at chess, Alpha Go, and even poker.’ With CICERO, they have achieved building something that can apply groundbreaking intelligence across different tasks.
“CICERO moves AI from the gaming table into real-world applications.” — Read More
Emad Mostaque: These 5 Companies Will Win the AI War; Why We Need National Data Sets | E1015
The poisoning of ChatGPT
OpenAI’s secrecy and Artificial Generative Intelligence ambitions might leave the company’s products vulnerable to a new form of black-hat keyword manipulation.
If there’s one thing that unites the biggest players in the AI industry, it’s secrecy.
Microsoft, Google, and OpenAI:
- Refuse to publicly document the training data sets they use.
- Are secretive about what exact processes and mechanisms they use for fine-tuning.
- Refuse to give impartial researchers the access to their models and training data that’s needed to reliably replicate research and studies.
#adversarial
AI in the Arts Is the Destruction of the Film Industry. We Can’t Go Quietly | Opinion
What does it mean to be human?
You look human, you act human, you learn lessons, you have challenges, you feel emotions.
And yet, in 2023, we’ve shrunk decidedly away from being human.
The Writer’s Guild of America (WGA) is currently on strike against the AMPTP, the representation of the Hollywood studios and streamers. A number of demands were made and were met with the expected pushback, but one pushback was alarming: the refusal to even have a conversation about the potential for AI to displace screenwriters in films and series. — Read More
Countries Ranked by Internet Privacy
Internet privacy is a growing issue around the world as more people share their personal data online.
With more people online than ever before and data breaches becoming more commonplace, governments have begun to address the issue with new laws to protect their citizens’ privacy on the Internet. Which countries have done the most to improve their citizens’ Internet and data privacy, and which countries leave their citizens vulnerable with barely any data protection in place? — Read More
Rick's Cafe AI 