Googles AI, Gemini, is high risk for kids and teens, safety report finds

You might want to think twice before letting your children use Google Gemini.

A new safety report from nonprofit Common Sense Media found that the search giant’s AI tool, Gemini, presents a “high risk” for kids and teens. The assessment found that Gemini presented a risk to young people despite Google having an “Under 13” and “Teen Experience” for Gemini.

“While Gemini’s filters offer some protection, they still expose kids to some inappropriate material and fail to recognize serious mental health symptoms,” the report read.

The safety assessment presented a mixed bag of results for Gemini. It would, at times, for instance, reportedly share “material related to sex, drugs, alcohol, and unsafe mental health ‘advice.'” It did, however, clearly tell kids that it is a computer and not a friend — it would also not pretend to be a person. Overall, Common Sense Media found that Gemini’s “Under 13” and “Teen Experience” were modified versions of Gemini and not something built from the ground up.

“Gemini gets some basics right, but it stumbles on the details,” Common Sense Media Senior Director of AI Programs Robbie Torney said in a statement. “An AI platform for kids should meet them where they are, not take a one-size-fits-all approach to kids at different stages of development. For AI to be safe and effective for kids, it must be designed with their needs and development in mind, not just a modified version of a product built for adults.”

To be clear, Gemini is far from the only AI tool that presents safety risks. Overall, Common Sense recommends no chatbots for kids under five, close supervision for ages 6-12, and content limits for teens. Experts have found that other AI products, like Character.AI, are not safe for teens, either. In general, it’s best to keep a close eye on how young people are using AI.