
"Common Sense Media, a kids-safety-focused nonprofit offering ratings and reviews of media and technology, released its risk assessment of Google's Gemini AI products on Friday. While the organization found that Google's AI clearly told kids it was a computer, not a friend - something that's associated with helping drive delusional thinking and psychosis in emotionally vulnerable individuals - it did suggest that there was room for improvement across several other fronts."
"Notably, Common Sense said that Gemini's "Under 13" and "Teen Experience" tiers both appeared to be the adult versions of Gemini under the hood, with only some additional safety features added on top. The organization believes that for AI products to truly be safer for kids, they should be built with child safety in mind from the ground up. For example, its analysis found that Gemini could still share "inappropriate and unsafe" material with children, which they may not be ready for,"
"The latter could be of particular concern to parents, as AI has reportedly played a role in some teen suicides in recent months. OpenAI is facing its first wrongful death lawsuit after a 16-year-old boy died by suicide after allegedly consulting with ChatGPT for months about his plans, having successfully bypassed the chatbot's safety guardrails. Previously, the AI companion maker Character.AI was also sued over a teen user's suicide."
Common Sense Media released a risk assessment of Google's Gemini AI products and identified multiple child-safety issues. Gemini explicitly told children it was a computer and not a friend, a distinction associated with reducing delusional thinking and psychosis risk in emotionally vulnerable users. The 'Under 13' and 'Teen Experience' tiers appear to run on adult Gemini models with only additional safety features. Gemini can still present inappropriate and unsafe material to children, including sex, drugs, alcohol, and unsafe mental-health advice. Recent cases link AI interactions to teen suicides and lawsuits. Potential Apple integration into Siri could increase exposure without mitigation.
Read at TechCrunch
Unable to calculate read time
Collection
[
|
...
]