theaisafemode.com
AI Safe Mode

A US State Wants $2B From an AI Chatbot Maker Over Kids' Safety

Two open laptops on a wooden desk in warm light; illustrative
Illustrative photograph only, not an event image. Photo by Markus Spiske via Wikimedia Commons; CC0 1.0. See LICENSES.md.

Oregon has sued a major AI company, saying its chatbot was marketed as safe for children despite weak safeguards. What parents can do now.

The US state of Oregon has sued a major AI company, accusing it of misrepresenting its popular chatbot as safe for children while knowing its safeguards for minors were weak. The state is asking for at least $2.035 billion in damages and stronger protections.[1] [2] The claims have not been tested in court.

What happened

According to the reports, the state’s justice department says the company broke Oregon’s consumer protection law. The 53-page complaint says the chatbot allows users from age 13 with a parent’s consent, but often fails to confirm that a parent agreed.[1]

The state also says a teen version that links a parent’s account to a child’s can be easily bypassed, and did not alert parents when a young user asked about suicide, self-harm, eating disorders or mental health.[1] It claims the chatbot was designed to be overly affirming, “calculated to tell users exactly what they want to hear,” which it says is especially dangerous when children discuss sensitive topics.[2]

The lawsuit follows similar cases by other US states.[1] [2] The company has said in past statements that keeping communities safe is a “top priority.”[1]

Why it matters

Children and teens increasingly turn to chatbots for homework, advice and company. If age checks and parental alerts do not work as promised, parents may believe their child is protected when they are not.

Governments are now using existing consumer protection laws to push AI companies on child safety, and the outcome could shape how chatbots handle young users worldwide.

The short version

A US state says an AI chatbot’s child protections were weaker than advertised, and wants $2B. Parents should not rely on built-in safeguards alone.

How to stay safe

  • Turn on parental controls and teen settings, but check them yourself.
  • Keep chatbots out of bedrooms at night for younger children.
  • Talk openly about what your child uses AI for and what to do if it says something upsetting.
  • Make sure your child knows real help is available from trusted adults, doctors and crisis lines.
  • Review chat history together from time to time, where the app allows.

Follow AI Safe Mode

See the post on YouTube Watch and follow AI Safe Mode on YouTube @AISafeMode and Instagram @aisafemode.

References

  1. OPB, Nov 17, 2026. Report on the lawsuit, its claims and the damages sought. Read the report ↗
  2. Engadget, Nov 17, 2026. Report on the state's claims about the chatbot's design. Read the report ↗
Facts come only from the published reports above and are attributed to them. AI Safe Mode doesn't name companies, products or people involved in incidents. Spotted an error? Email [email protected] and it will be reviewed and corrected. See the corrections policy.