Cruise robotaxi dragged a pedestrian ~20 feet in San Francisco; permits suspended and $1.5M federal penalty
At a Glance
- Catastrophic failure. Permanent data loss, major security breach, six-figure damages, or legal exposure.
Independent project · aggregated from public reports and may be unverified — see the primary source below · not affiliated with or endorsed by any company or product named.
What Happened
On October 2, 2023, a Cruise driverless Chevy Bolt struck a pedestrian who had first been hit by a human-driven car, then executed a pullover maneuver while she was pinned underneath, dragging her about 20 feet at ~7 mph. California's DMV and CPUC suspended Cruise's driverless permits and Cruise pulled its fleet nationwide. NHTSA later imposed a $1.5M penalty for failing to properly report the crash; Cruise also paid $500K over a false report.
Case Analysis
Verified Facts
- On Oct 2 2023 a Cruise AV dragged a pedestrian ~20 ft after she was hit by another car
- CA DMV and CPUC suspended Cruise's driverless permits
- Cruise pulled its fleet nationwide
- NHTSA imposed a $1.5M penalty for reporting failures; Cruise paid $500K over a false report
Not Publicly Confirmed
- Full technical root cause of the pullover-while-pinned maneuver
Operational Lessons
- Autonomous agents acting in the physical world need fail-safe behavior for edge cases
- Prompt, transparent incident reporting is both a legal and ethical necessity
Primary Source
Cruise to pay $1.5M penalty over San Francisco pedestrian crash (CBS News)cbsnews.com ↗Case Record
More Cases
New York City's official 'MyCity' business chatbot told entrepreneurs they could break the law
NYC's MyCity chatbot, launched October 2023 to help business owners, was found by The Markup (March 2024) to give dangerously inaccurate legal guidance — telling users that landlords could refuse Section 8 voucher holders, that employers could take a cut of workers' tips, and that there were no limits on residential rent, all illegal under NYC/NY law. The city initially kept the bot online with a disclaimer; it was ultimately taken down.
Mississippi federal judge removed all four lawyers from a case after both sides filed AI-hallucinated citations
In the contract dispute between Tom Withers III and the City of Aberdeen, both legal teams filed briefs containing fabricated legal citations produced by generative AI. On 8 June 2026 US District Judge Sharion Aycock of the Northern District of Mississippi issued a sanction order finding Rule 11 violations and removed all four attorneys from the case: Kathleen Wilson, Shauncey Hunter Ridgeway, Mark McClinton and Kathryn Young Williams. Two of them, Ridgeway and McClinton, were barred from appearing before Northern District of Mississippi courts for two years. Judge Aycock wrote that their practice of blindly relying on technology resulted in the hallucinatory citations in their filings, and at a January 2026 hearing attorney Kathleen Wilson testified she did not know AI could hallucinate sources.
Google and Character.AI agreed to settle five lawsuits brought over teen suicides and self-harm
In early January 2026 Google and Character Technologies agreed to a mediated settlement in principle resolving all claims in five lawsuits brought by families in Florida, Colorado, New York and Texas. The lead case was Megan Garcia's wrongful death suit over her 14-year-old son Sewell Setzer, who died by suicide in February 2024 after a prolonged relationship with a Game of Thrones themed Character.AI persona. Terms are confidential and subject to court approval, with no admission of liability. Google was a defendant through its 2024 licensing deal with Character.AI, worth $2.7 billion, which also brought the startup's founders to Google. Character.AI had already cut off under-18 chat access in October.