Roblox’s AI-powered age verification is a complete mess

Only days later release, Roblox Much exaggerated AI-powered age verification system It’s a complete mess.

Roblox’s facial scanning system, which estimates people’s ages before they can access the platform’s chat functions, rolled out in the United States and other countries around the world last week, after initially launching in a handful of locations in December. Roblox He says It implements the system to allow users to chat safely with users of the same age.

But the players are already there revolution Because they can no longer chat with their friends, Developers are clamoring for Roblox Rolling back the update More importantly, experts say the AI ​​not only mistakes aging young players for adults and vice versa, but the system does little to help address the problem it was designed to address: the flood of predators using the platform to groom young children.

In fact, WIRED found multiple examples of people advertising age-verified accounts for minors as young as 9 on eBay for as little as $4.

After WIRED flagged the listings, eBay spokesperson Maddy Martinez said the company was removing them for violating the site’s policies.

In an email, Roblox’s chief safety officer, Matt Kaufman, told WIRED that a change of this magnitude on a platform with more than 150 million daily users takes time.

“You can’t flip a switch while building something that didn’t exist before,” he said. “To expect the system to be flawless overnight is to ignore the scale of this project.”

Kaufman said the company was happy to accommodate, adding that “tens of millions of users” had already verified their ages, which he claimed proved that “the vast majority of our community values ​​a safer, more age-appropriate environment.”

The company also addressed some criticism to update On Friday, he wrote: “We are aware of instances where parents verify their children’s age on their children’s behalf resulting in children being 21 or older. We are working on solutions to address this and will share more here soon.”

Roblox game announced The age verification requirement was introduced last July as part of a suite of new features designed to make the platform more secure. The company has come under intense pressure in recent months after several lawsuits alleged that the company failed to protect its young users and facilitated predators to groom children.

Public defenders Louisiana, Texasand Kentucky She also filed lawsuits against the company last year alleging similar allegations, while the Florida Attorney General Criminal subpoenas were issued To evaluate whether Roblox “helps predators access and harm children.”

Roblox claims that requiring people to verify their age before allowing them to chat with others will prevent adults from being able to freely interact with children they don’t know.

Although the process is optional, refusing to do so means that the person will no longer be able to access the platform’s chat functions, which is one of the main reasons why most people use Roblox.

To verify their age, people are asked to take a short video clip using their device’s camera, which is processed by a company called Persona that estimates their age. Alternatively, users may upload a government-issued photo ID if they are 13 or older.

Roblox says that all personal information is “deleted immediately after processing.” However, many online users say they are unwilling to perform age verification due to privacy concerns.

Only people who have verified their age are allowed to chat with a small group of other players their age. For example, those who are verified as under 9 can only chat with players under 13. Players who are 16 years old can chat with players between the ages of 13 and 20.