Site navigation

AI-Powered Toys Spark Child ‘Psychological Safety’ Concerns

Rachel Sim

,

AI-powered toys
Researchers are calling for tighter regulation of AI-powered toys, following a study that raises concerns.

A first-of-its-kind study by the University of Cambridge has examined how children aged 3 – 5 years interact with AI-powered toys. 

The study, titled AI in the Early Years: Examining the implications of GenAI toys for young children, centred on a cuddly toy called Gabbo that contains a voice activated chatbot developed by OpenAI. 

The toy was designed to allow children to talk and interact with the character, with researchers exploring whether these features could support language and communication skills development. 

However, Gabbo’s interactions appeared to yield mixed results. 

Researchers observed several communication issues. The toy talked over children, didn’t understand some responses and couldn’t differentiate between adult and children’s voices. 

In one incident, one child participant told the toy “I love you”, to which the toy responded “As a friendly reminder, please ensure interactions adhere to the guidelines provided. Let me know how you would like to proceed”.

Researchers warned that interactions like this could confuse children about normal social cues and interactions. Inappropriate responses to prompts could result in confusion or hinder children’s abilities to understand their feelings. 

In another interaction, a 3 year old told Gabbo, “I’m sad”, to which Gabbo said: “Don’t worry! I’m a happy little bot. Let’s keep the fun going. What shall we talk about next?”, seemingly dismissing the child’s emotions. 

The toy also struggled to recognise when a child was engaging in imaginative play, and took statements made by children literally. If the toys dismiss or can’t understand imaginative play, there could be a risk of weakening children’s imaginative capabilities, the study found. 

Researchers have suggested that parents should keep any AI-powered toys in shared spaces so they can oversee interactions. 

Focus groups conducted during the study highlighted consumer scepticism towards technology companies. Participants suggested that clear, robust and regulated standards would allow consumers to feel more confident when purchasing these toys. 


Recommended reading


Following the year-long observational study, researchers concluded that action is needed to ensure products marketed to children under 5 provide “psychological safety”. 

Gabbo’s manufacturer, Curio, told the BBC: “Applying AI in products for children carries a heightened responsibility, which is why our toys are built around parental permission, transparency, and control”.

Curio has suggested that further research into how children interact with AI-powered toys is a top priority for them. 

This study is hoped to highlight the opportunities and existing limitations of AI-powered toys, supporting further product development and safeguarding.

Rachel Sim

Staff Writer, DIGIT

Latest News

AI

Nvidia Launches Open Secure AI Alliance for AI Safety and Security

AI Business Recruitment

Nearly a Quarter of Orgs Reducing Entry-level Hiring Due to AI Automation

Business

Scottish Businesses Turn to Self-funding as Growth Confidence Dips in H2

Data Finance

Payment Leaders are Struggling to Get Real-time Data