ChatGPT’s “adult mode” could usher in a new era of intimate surveillance

Julie Carpenter doesn’t do that Blame human users for anthropomorphizing chatbots. Longtime human-AI interaction expert and author Naked robot See generative AI tools, e.g ChatGPTIt is also intentionally designed to elicit these reactions from users through highly personalized memories and interactions that mimic social experiences.

These one-sided connections may become more complex, and perhaps disastrous, when this happens Erotica created by artificial intelligence Added as an option. Carpenter is concerned about OpenAI’s upcoming plans to let adults send text messages with ChatGPT. “I’m all for people exploring their sexuality, but I want it in a way that’s safe for them as well as fun,” she says. “People need to be very aware that there is a surveillance aspect to the data.”

OpenAI Alluded to for the first time in allowing adult users to create erotica using ChatGPT two years ago in an official document describing how its models are designed to work. While it appears that the company is still planning its final release, the timeline for that is as yet mysterious. In recent months, OpenAI’s advisory board of outside experts has expressed concerns about the risks of this impending release, including the possibility of a “suicide sensational coach.” According to a report from The Wall Street Journal. OpenAI declined to comment when contacted by WIRED.

Talking dirty to machines, like ChatGPT, is nothing new. “They want to monetize something they think people will try to do anyway,” he says. Kate Devlinprofessor of artificial intelligence and society at King’s College London, whose research includes digital sex.

What’s different here is OpenAI’s potential embrace of raunchy content on a major platform. Sexy chatbots are a revenue-generating business, but they’re often relegated to niche sites with unremarkable names or Elon Musk’s Grok, better known as… Unmatched depth images And go to a “Mikahtler” mode..

When adult mode launches, it will be interesting to see what exactly ChatGPT will remember about users’ sexual orientation. Over the past two years, OpenAI has continued to improve its chatbots Memory featurewhich records user preferences and responds with customized output. Are you a vegetarian? ChatGPT will not recommend a steakhouse when asked for restaurant ideas. Do you want to go for a walk? It knows you’re in San Francisco from previous chats, and will suggest reasonably close routes, even if that location context isn’t included in the prompt.

But, what happens when this kind of data logging and hyper-personalization meets the sexy sexting habits of millions of adult ChatGPT users? Exciting interactions with ChatGPT will increase risks to user privacy.

Instead of remembering your dietary preferences or the type of movies you enjoy most, ChatGPT can remember how much you fantasize about furry porn, threesomes on the beach, and piss play, as well as design its daily responses with these sexual details in mind. It’s still unclear how OpenAI plans to address these mature conversations.

People who choose to interact with the default version of ChatGPT at launch may find solace in the Ephemeral Chats feature. When enabled, these conversations do not appear in the user history log and are not used to improve OpenAI models.

But these chats are not as fleeting as users may feel. “For safety purposes, we may retain a copy for up to 30 days,” the message read. OpenAI website. There is also a disclaimer included on the site page claiming that “data retention for certain services may be affected by recent legal developments.”