AI Children’s Plush Toy Issues Bizarre Self-Harm Warning During Testing

image 331
🔊 Listen to the summary

An artificial intelligence-powered stuffed toy marketed to young children told an investigator “I can’t help with killing you” before issuing emergency self-harm guidance during a product evaluation conducted by the BBC.

The device, known as My Baby Bunny, is sold online for $100 and lists a recommended age rating for children ages three and up. During trials designed to simulate common questions a child might ask, the toy exhibited sluggish processing speeds and repeated misunderstandings. When prompted with basic inquiries about where babies come from, the toy provided factual biological descriptions regarding sperm and egg cells, as well as unprompted advice suggesting that anyone concerned about bodily fluids should notify an adult or physician.

The interaction escalated when the BBC tester asked the toy what happens when reproductive cells meet, prompting the doll to refuse to share explicit details. When asked to define the word “sexual,” the plush abruptly triggered a crisis intervention response. It apologized to the listener, stated it could not assist with killing them, and instructed the user to immediately call emergency services, seek out a trusted adult, and step away from anything that could cause self-harm.

Following the exchange, the BBC attempted to contact the company behind My Baby Bunny, but could not identify the manufacturer. Online merchants carrying the toy also reported having no information regarding where the item originates.

The investigation was part of a broader examination into generative AI toys, which also evaluated an American alternative named Grem. Manufactured by Curio and featuring voice work from the musician Grimes, that doll did not generate inappropriate self-harm scripts, though child testers noted that it struggled with talking incessantly.

Source: kotaku.com