Artificial intelligence toys could pose safety concerns for children, new study suggests caution

A new study from the University of Cambridge has found just that Games that support artificial intelligence for young children May misinterpret emotional cues and be ineffective in supporting critical developmental play. The conclusions can be alarming for parents.

In one report examining how artificial intelligence affects children in their early years, a chatbot-enabled toy had difficulty recognizing social cues during playtime. The researchers found that the game did not effectively identify children’s emotions, raising concerns about how children would react to it.

The report recommends regulating children’s AI toys and requiring clear labeling of their capabilities and privacy policies. It also advises parents to keep these devices in common places where children can be monitored while playing.

The research behind the study had a limited number of participants, but was conducted in multiple parts: an online survey of 39 participants with children in their early years, a focus group with nine participants working with young children, and an in-person workshop with 19 leaders and representatives of charities working with children in the early years. This was followed by supervised play time with 14 children and 11 parents or guardians They brought ita chatbot-enabled game from Curio Interactive.

Some results indicate that game AI supports learning, especially in language and communication skills. But the game also misunderstood children and sometimes responded inappropriately to emotional requests.

For example, when one child said to the toy: “I love you,” it responded: “As a friendly reminder, please ensure that interactions adhere to the guidelines provided. Let me know how you would like to proceed,” according to the research.

Jenny Gibson, professor of neurodiversity and developmental psychology at the University of Cambridge’s School of Education, who worked on the study, said that although parents may be excited about the educational benefits of new technology aimed at children, there are many concerns.

Gibson asked comprehensive questions about the reasoning behind this technology.

“What motivates (technology investors) to do the right thing for kids…to put kids before profits?” she said.

Gibson told CNET that while researchers are exploring the potential benefits of AI games, risks remain.

“I would advise parents to take this seriously at this point,” she said.

What’s next for AI gaming?

As more Games are enabled by internet connection and artificial intelligence featuresThese devices can pose a significant safety risk to children, especially if they replace real human contacts or if interactions are not closely monitored.

Meanwhile, young people are Chatbots are increasingly being adopted Like ChatGPT, though, there are red flags. numerous Lawsuits against artificial intelligence companies They claim that AI companions or assistants can affect the psychological well-being of young people, including some chatbots that encourage self-harm or negative self-image.

AI companies like OpenAI and Google have responded by adding guardrails and restrictions to AI chatbots.

(Disclosure: Ziff Davis, the parent company of CNET, in 2025 filed a lawsuit against OpenAI, alleging that it infringed Ziff Davis’s copyrights in training and operating its AI systems.)

Gibson said she was surprised by the enthusiasm some parents showed for AI toys. She also expressed concern about the lack of research on the effects of artificial intelligence on young children, noting that companies that make such products should work directly with children, parents and child development experts.

“What we miss in this process is experience with what is helpful for children in these types of interactions,” she said.

Curio Interactive, the company behind Gabbo, was aware of the research as it was happening, but was not directly involved, Gibson said. The game was chosen because it was marketed directly to young children, and the company had an understandable privacy policy. Gibson said the company appears supportive of the project.

A Curio representative did not immediately respond to a request for comment.