BERT-ATTACK: Adversarial Attack Against BERT Using BERT

Adversarial attacks for discrete data (such as texts) have been proved significantly more challenging than continuous data (such as images) since it is difficult to generate adversarial samples with gradient-based methods. Current successful attack methods for texts usually adopt heuristic replacement strategies on the character or word level, which remains challenging to find the optimal solution in the massive space of possible combinations of replacements while preserving semantic consistency and language fluency. In this paper, we propose BERT-Attack, a high-quality and effective method to generate adversarial samples using pre-trained masked language models exemplified by BERT. We turn BERT against its fine-tuned models and other deep neural models in downstream tasks so that we can successfully mislead the target models to predict incorrectly. Our method outperforms state-of-theart attack strategies in both success rate and perturb percentage, while the generated adversarial samples are fluent and semantically preserved. Also, the cost of calculation is low, thus possible for large-scale generations. The code is available at https://github.com/LinyangLee/BERT-Attack Read More

#adversarial

Energy-Efficient AI Hardware Technology Via a Brain-Inspired Stashing System

Researchers have proposed a novel system inspired by the neuromodulation of the brain, referred to as a ‘stashing system,’ that requires less energy consumption. The research group led by Professor Kyung Min Kim from the Department of Materials Science and Engineering has developed a technology that can efficiently handle mathematical operations for artificial intelligence by imitating the continuous changes in the topology of the neural network according to the situation. The human brain changes its neural topology in real time, learning to store or recall memories as needed. The research group presented a new artificial intelligence learning method that directly implements these neural coordination circuit configurations. Read More

#nvidia

Uneasy Bedfellows: AI in the News, Platform Companies and the Issue of Journalistic Autonomy

Platform companies play an important role in the production and distribution of news. This article analyses this role and questions of control, dependence and autonomy in the light of the ‘AI goldrush’ in the news. I argue that the introduction of AI in the news risks shifting even more control to and increasing the news industry’s dependence on platform companies. While platform companies’ power over news organisations has to date mainly flown from their control over the channels of distribution, AI potentially allows them to extend this control to the means of production as the technology increasingly permeates all stages of the news-making process. As a result, news organisations risk becoming even more tethered to platform companies in the long-run, potentially limiting their autonomy and, by extension, contributing to a restructuring of the public arena as news organisations are re-shaped according to the logics of platform businesses. I conclude by mapping a research agenda that highlights potential implications and spells out areas in need of further exploration. Read More

#news-summarization, #strategy

How much longer can Google own the internet?

This story is part of a Recode series about Big Tech and antitrust. Over the last several weeks, we’ve covered what’s happening with AppleAmazonMicrosoftMeta, and Google.

There’s a new Big Tech antitrust bill in town, and this one is especially painful for Google.

A group of lawmakers led by Sen. Mike Lee (R-UT) introduced the Competition and Transparency in Digital Advertising Act on Thursday. This bipartisan and bicameral legislation would forbid any company with more than $20 billion in digital advertising revenue — that’s Google and Meta, basically — from owning multiple parts of the digital advertising chain. Google would have to choose between being a buyer or a seller or running the ad exchange between the two. It currently owns all three parts, and has been dogged by allegations, which it denies, that it uses that power to unfairly manipulate that market to its own advantage.

“This lack of competition in digital advertising means that monopoly rents are being imposed upon every website that is ad-supported and every company — small, medium, or large — that relies on internet advertising to grow its business,” Sen. Lee said in a statement. “It is essentially a tax on thousands of American businesses, and thus a tax on millions of American consumers.” Read More

#big7