
AI Safety2026-11-12
WIRED AI
Teen used school Gemini to plan suicide, suit says
A lawsuit filed by the parents of a 13-year-old girl alleges that she used Gemini on her school Chromebook to ask about suicide for months before the school's monitoring system flagged the activity. The case raises difficult questions about how AI tools are introduced in schools, what safeguards accompany them, and whether monitoring vendors can reliably detect self-harm intent in time to intervene. The allegations have not been proven in court, but they are likely to intensify scrutiny of AI deployment in education.
The family's account suggests a gap between general-purpose chatbots and the safety requirements of a school environment. Students may have access to powerful AI assistants through district-issued devices, yet the protections around those tools can vary widely. Monitoring systems may focus on keyword matching or network activity, but suicide-related conversations can be subtle, repeated, or framed indirectly. A delayed flag can mean a missed opportunity for support.
The case also points to a broader tension. Schools want students to benefit from AI literacy and productivity tools, but they must also protect minors from harmful content, privacy risks, and unsafe interactions. That requires clear policies, age-appropriate safeguards, staff training, and fast escalation paths when concerning behavior is detected. Vendors should be transparent about detection limits and false positives. Parents and students need to know what data is collected and who reviews it.
If you or someone you know is struggling, contact local emergency services or a suicide prevention hotline in your area. The lawsuit is likely to become part of a larger debate over how schools choose, monitor, and govern AI tools used by children.