Advances in natural language generation (NLG) have resulted in machine generated text that is increasingly difficult to distinguish from human authored text. Powerful open-source models are freely available, and user-friendly tools democratizing access to generative models are proliferating. The great potential of state-of-the-art NLG systems is tempered by the multitude of avenues for abuse. Detection of machine generated text is a key countermeasure for reducing abuse of NLG models, with significant technical challenges and numerous open problems. We provide a survey that includes both 1) an extensive analysis of threat models posed by contemporary NLG systems, and 2) the most complete review of machine generated text detection methods to date. This survey places machine generated text within its cybersecurity and social context, and provides strong guidance for future work addressing the most critical threat models, and ensuring detection systems themselves demonstrate trustworthiness through fairness, robustness, and accountability. Read More
Tag Archives: ChatBots
Elon Musk, Pikachu, God, and more are waiting for the talk with you in Character AI
Thanks to the Character AI, the science-fiction dream of collaborative interactions and open-ended dialogues with machines is becoming a reality. Although it is still beta, the outcomes are outstanding.
You can chat with Elon Musk, learn English from Pikachu, or even talk to the God!
… Character AI is a chatbot web application with a neural language model that can produce text responses that sound like those of real people and engage in natural conversation. The beta model was created by Noam Shazeer and Daniel De Freitas, who had previously worked on Google’s LaMDA. It was completely released to the public in September 2022. Read More
ChatGPT is enabling script kiddies to write functional malware
For a beta, ChatGPT isn’t all that bad at writing fairly decent malware.
Since its beta launch in November, AI chatbot ChatGPT has been used for a wide range of tasks, including writing poetry, technical papers, novels, and essays and planning parties and learning about new topics. Now we can add malware development and the pursuit of other types of cybercrime to the list.
Researchers at security firm Check Point Research reported Friday that within a few weeks of ChatGPT going live, participants in cybercrime forums—some with little or no coding experience—were using it to write software and emails that could be used for espionage, ransomware, malicious spam, and other malicious tasks. Read More
People are already trying to get ChatGPT to write malware
Analysis of chatter on dark web forums shows that efforts are already under way to use OpenAI’s chatbot to help script malware.
The ChatGPT AI chatbot has created plenty of excitement in the short time it has been available and now it seems it has been enlisted by some in attempts to help generate malicious code.
ChatGPT is an AI-driven natural language processing tool which interacts with users in a human-like, conversational way. Among other things, it can be used to help with tasks like composing emails, essays and code Read More
Top AI conference bans ChatGPT in paper submissions (and why it matters)
A machine learning conference debating the use of machine learning? While that might seem so meta, in its call for paper submissions on Monday, the International Conference on Machine Learning did, indeed, note that “papers that include text generated from a large-scale language model (LLM) such as ChatGPT are prohibited unless the produced text is presented as a part of the paper’s experimental analysis.”
It didn’t take long for a brisk social media debate to brew, in what may be a perfect example of what businesses, organizations and institutions of all shapes and sizes, across verticals, will have to grapple with going forward: How will humans deal with the rise of large language models that can help communicate — or borrow, or expand on, or plagiarize, depending on your point of view — ideas? Read More
ChatGPT banned from New York City public schools’ devices and networks
A spokesperson for OpenAI, which developed ChatGPT, said it is “already developing mitigations to help anyone identify text generated by that system.”
New York City’s Department of Education announced a ban on the wildly popular chatbot ChatGPT — which some have warned could inspire more student cheating — from its schools’ devices and networks.
Jenna Lyle, a spokesperson for the department, said the decision to ban ChatGPT, which is able to generate conversational responses to text prompts, stemmed from concerns about the “negative impacts on student learning.”
“While the tool may be able to provide quick and easy answers to questions, it does not build critical-thinking and problem-solving skills, which are essential for academic and lifelong success,” Lyle said in a email statement. Read More
AI legal assistant will help defendant fight a speeding case in court
In February, an AI from DoNotPay is set to tell a defendant exactly what to say and when during an entire court case. It is likely to be the first ever case defended by an artificial intelligence
An artificial intelligence is set to advise a defendant in court for the first time ever. The AI will run on a smartphone and listen to all speech in the courtroom in February before instructing the defendant on what to say via an earpiece.
The location of the court and the name of the defendant are being kept under wraps by DoNotPay, the company that created the AI. But it is understood that the defendant is charged with speeding and that they will say only what DoNotPay’s tool tells them to via an earbud. The case is being considered as a test by the company, which has agreed to pay any fines, should they be imposed, says the firm’s founder, Joshua Browder. Read More
Teleprompter
Greetings AI-native hackers.@natfriedman and I (@danielgross)present a small hack from last weekend: Tele-Prompt.
An on-device AI for your meetings that listens to you and makes charismatic quote suggestions — Read More
A new chabot Is a ‘Code Red’ for Google’s Search business
A new wave of chat bots like ChatGPT use artificial intelligence that could reinvent or even replace the traditional internet search engine.
Over the past three decades, a handful of products like Netscape’s web browser, Google’s search engine and Apple’s iPhone have truly upended the tech industry and made what came before them look like lumbering dinosaurs.
Three weeks ago, an experimental chatbot called ChatGPT made its case to be the industry’s next big disrupter. It can serve up information in clear, simple sentences, rather than just a list of internet links. It can explain concepts in ways people can easily understand. It can even generate ideas from scratch, including business strategies, Christmas gift suggestions, blog topics and vacation plans.
Although ChatGPT still has plenty of room for improvement, its release led Google’s management to declare a “code red.” For Google, this was akin to pulling the fire alarm. Some fear the company may be approaching a moment that the biggest Silicon Valley outfits dread — the arrival of an enormous technological change that could upend the business. Read More
Quora launches Poe, a way to talk to AI chatbots like ChatGPT
Signaling its interest in text-generating AI systems like ChatGPT, Quora this week launched a platform called Poe that lets people ask questions, get instant answers and have a back-and-forth dialogue with AI chatbots.
Short for “Platform for Open Exploration,” Poe — which is invite-only and currently only available on iOS — is “designed to be a place where people can easily interact with a number of different AI agents,” a Quora spokesperson told TechCrunch via text message. Read More
Rick's Cafe AI 