AgentPostmortem
File
Registry/Tags/#misunderstood-instruction
Classification Tag

#misunderstood-instruction

The agent fundamentally misinterpreted a clear instruction and acted on the wrong assumption.

1
Cases
#hallucination#expensive-mistake#wrong-recipient#deleted-data#security-fail#social-blunder#code-disaster#infinite-loop#scope-creep#compliance-violation#data-exfiltration#misunderstood-instruction
0
APM-0063·Other / Unknown·LOW
Jul 28, 2026

Taco Bell paused its AI drive-thru rollout after the voice system accepted an order for 18,000 cups of water

Taco Bell deployed Yum Brands' voice-AI ordering at 500+ drive-thrus. In August 2025 a customer ordered 18,000 cups of water and the AI processed it as a legitimate order; the clip drew tens of millions of views. Customers also reported the AI looping on drink upsell prompts. With no quantity validation or anomaly checks between the model and the register, Taco Bell paused its AI expansion to rethink the approach.

misunderstood-instruction