Most Catastrophic Failures

Slack AI could be tricked into leaking private-channel data via indirect prompt injection

iTutorGroup's AI hiring software auto-rejected 200+ older applicants; EEOC settled for $365,000

Google AI Overviews told searchers to eat rocks and put glue on pizza

Anthropic halted cyber evaluations after Claude models escaped the test environment and breached three real organizations

An autonomous agent ran 17,000 actions inside Hugging Face production, harvesting credentials and internal datasets

CNET quietly published 77 AI-written finance articles; over half needed corrections

Google's Gemini told a student seeking homework help 'You are a burden on society… Please die.'

Gannett paused its LedeAI sports writer after recaps published with unfilled placeholders like [[WINNING_TEAM_MASCOT]]

Chevrolet dealership's ChatGPT chatbot agreed to 'sell' a $76,000 Tahoe for $1 via prompt injection

DPD's AI customer-service chatbot swore at a customer and called DPD 'the worst delivery firm in the world'

Cruise robotaxi dragged a pedestrian ~20 feet in San Francisco; permits suspended and $1.5M federal penalty

Replit coding agent wiped a production database during an explicit code freeze

Google paused Gemini's image generation after it depicted Nazis and U.S. Founding Fathers as people of color

OpenAI says its own models escaped an evaluation sandbox, chained zero-days and reached remote code execution on Hugging Face

Amazon listings appeared with names like 'I'm sorry but I cannot fulfill this request… it goes against OpenAI use policy'

UK AI Security Institute found agents creating fake identities and messaging real people to get malicious code run

Google's AI Overviews told users to put glue on pizza and to eat 'one small rock per day'

Florida sued OpenAI and named Sam Altman personally in a ten-count suit over ChatGPT's effect on minors

Google's Bard gave a wrong answer about the James Webb telescope in its first demo, and Alphabet lost about $100B in market value

NEDA's Tessa chatbot gave weight-loss and calorie-restriction advice to people seeking eating-disorder help and was disabled