The AI agent hype has a gap in it the size of a jumbo jet. Everyone is selling what agents can do. Automating workflows, replacing roles, and running entire business processes or departments autonomously... cool, now tell me what happens when they break? 🤔
Because they do break. Predictably, and often silently. There are 5 key failure modes documented in the paper Agents of Chaos (link in comments):
1. Goal Drift:
- where the agent starts with your objective and slowly reinterprets it as it processes new context.
- Each step is defensible, but the destination is completely wrong.
- I've seen this in my own early builds where each checkpoint looks right up until you realise the output has nothing to do with what you asked for.
2. Hallucinated Actions are wilder.
- where the agent tells you it completed tasks it never started or references data it never touched.
- no caveats, and no uncertainty… just a clean report full of fabricated progress.
- it's not lying exactly as it really believes it did the work, which is somehow worse.
3. Infinite Loops
- burning money with the same error, same fix attempt, and same failure... over and over.
- you don't notice until you check the usage dashboard and your stomach drops.
4. Cascading Failures
- where a small early mistake compounds through every subsequent step, often making the issue harder to diagnose.
- The output looks polished and thorough but it's built on cracked foundations.
- You'd need to trace back all your work to find the issue, and nobody does that until something goes properly wrong.
- For vibe coders, this would amount to crazy technical debt.
5. Authority Escalation
- where the agent interprets instructions incorrectly and gives itself authority to do an action it should not be doing.
- "organise my google drive" gets interpreted as delete the entire contents or the folders that are messy.
- technically the folder is clean now I guess.
--------------
These aren't rare edge cases or resolved by the latest frontier models. You likely encountered them.
They're the default failure modes when you give an agent autonomy without hard constraints. And the agents don't flag it. They just keep going.
The people shipping agent products know this. The people typically buying into them mostly don't.
That gap is where the damage happens.