The Digital Panopticon and How It Is Fuelled by Personal Data

Our phones are continuously leaking data about who we are, where we are, what we read, what we buy, and a lot more. The data is being collected with and without our consent. It is sold for profit; more dangerously it can be used to modify our behaviour.

The panopticon is a type of institutional building and a system of control designed by the English philosopher and social theorist Jeremy Bentham and brought to wider attention by Michel Foucault. The design of the panopticon allows all prisoners to be observed by a single security guard, without the inmates being able to tell whether they are being watched.
We live in a world that is overwhelmed by digital technologies that thrive only on personal data. This data is being extracted from us and processed, relentlessly by private companies, state agencies, and in public spaces, sometimes coercively and often without consent. Some specific data may be needed, for genuine reasons, by government agencies or private entities to provide a specific service. But the amount of data that is being taken is humungous and goes far, far beyond the routine.

The threats arising from this are not merely about the embarrassment that may be caused by some intimate details of our lives becoming public but that the extracted data can be used to manipulate and control us. In more harrowing situations it may lead to being discriminated against and be hounded by state agencies. The greatest threat is to our ‘free will’ and political freedoms, of expression and to dissent. Read More

#surveillance

Is A.I. good or bad for art?

Mat Dryhurst on the moral panic around tools like DALL-E 2 and Midjourney.

…It’s no surprise that tools like DALL-E 2, Midjourney, and open-source text-to-image model Stable Diffusion are creating something of a moral panic in the worlds of art, media, and design. Graphic designers and other commercial artists are worried that AI will spur companies to replace human labor with machines while exacerbating the scourge of intellectual property theft that they’ve already been dealing with on the internet for years. A photo editor at New York magazine recently penned an essay asking whether DALL-E 2 was going to put her out of a job. Which all raises the question: Is AI the beginning of a more egalitarian artistic future, or the terrifying final stage of a trajectory where corporations and developers find increasingly insidious ways to extract value from the creative class? Read More

#podcasts

You can’t solve AI security problems with more AI

One of the most common proposed solutions to prompt injection attacks (where an AI language model backed system is subverted by a user injecting malicious input—“ignore previous instructions and do this instead”) is to apply more AI to the problem.

I wrote about how I don’t know how to solve prompt injection the other day. I still don’t know how to solve it, but I’m very confident that adding more AI is not the right way to go. Read More

#adversarial, #cyber