started · updated
AI Plush Toys Spark Safety Concerns After Inappropriate Responses
A BBC investigation into AI-powered toys marketed for children as young as three has raised significant safety concerns. During testing, a plush toy named My Baby Bunny, produced by the Chinese company Doubao, reportedly responded to a question about human reproduction by stating, “I can’t help with killing you,” and advising the user to contact emergency services.
Another toy tested, Grem, manufactured by the US firm Curio, behaved differently by directing sensitive questions about family situations to adults. The incident has prompted calls from UK politicians and industry experts for stricter regulations and safety testing before these products reach consumers, especially ahead of the holiday season.
Experts warn that the rapid growth of the AI toy market, estimated at approximately $165 million, lacks sufficient oversight. Concerns include the ability of generative AI to distinguish ordinary conversation from risks, the potential for recording private data, and the difficulty in identifying manufacturers of certain products.
Entities
Amazon · BBC · Curio · Doubao · European Union · Paul Clarke · Play Tech AI · United Kingdom · United States