Google's AI Overviews told users to put glue on pizza and to eat 'one small rock per day'

Futurism reported in November 2023 that Sports Illustrated published product-review content under fabricated author personas — for example 'Drew Ortiz,' whose headshot was bought from an AI-portrait site and who had no real existence — supplied by third-party vendor AdVon Commerce. After inquiries, the fake authors vanished from the site. Publisher The Arena Group denied the articles themselves were AI-written but acknowledged pseudonyms; the episode damaged SI's credibility.

NYC's MyCity chatbot, launched October 2023 to help business owners, was found by The Markup (March 2024) to give dangerously inaccurate legal guidance — telling users that landlords could refuse Section 8 voucher holders, that employers could take a cut of workers' tips, and that there were no limits on residential rent, all illegal under NYC/NY law. The city initially kept the bot online with a disclaimer; it was ultimately taken down.

In the contract dispute between Tom Withers III and the City of Aberdeen, both legal teams filed briefs containing fabricated legal citations produced by generative AI. On 8 June 2026 US District Judge Sharion Aycock of the Northern District of Mississippi issued a sanction order finding Rule 11 violations and removed all four attorneys from the case: Kathleen Wilson, Shauncey Hunter Ridgeway, Mark McClinton and Kathryn Young Williams. Two of them, Ridgeway and McClinton, were barred from appearing before Northern District of Mississippi courts for two years. Judge Aycock wrote that their practice of blindly relying on technology resulted in the hallucinatory citations in their filings, and at a January 2026 hearing attorney Kathleen Wilson testified she did not know AI could hallucinate sources.