Evaluation & Operations
MDX
Common AI Agent Failure Modes
An operational guide to loops, premature success, bad tool calls, stale state, weak evidence, and silent escalation failures.
Editorial review: clarity, operational relevance, safety boundaries, and source quality.
Action failures
Agents may choose the wrong tool, invent an argument, repeat a call, or execute steps in an unsafe order. Narrow schemas and state-aware validation reduce the blast radius.
Action failures include wrong-tool selection, malformed or semantically invalid arguments, duplicated writes, and unsafe ordering. Reduce them with distinct tool purposes, typed parameters, state-aware guards, dry runs, and idempotency. Measure attempted invalid actions too; a guard preventing harm does not mean the agent is behaving well.
Reasoning failures
An agent can anchor on an early assumption, ignore contradictory observations, or mistake fluent text for evidence. Verification steps should inspect external state rather than ask the same model if it is correct.
Reasoning failures often start with a weak observation: stale context, poor retrieval, ambiguous errors, or a summary that erased uncertainty. Require evidence for important claims and use independent checks. Repeatedly prompting the model to ‘think harder’ rarely repairs missing data or a broken tool contract.
Control failures
Missing limits lead to endless loops, excessive spending, or unauthorized actions. Time, step, cost, and permission boundaries must be visible to both the runtime and operators.
Control failures arise when no layer owns limits or completion. Enforce budgets centrally, use explicit terminal states, scope credentials, and expose a kill switch. Detect lack of progress by repeated actions or unchanged state, not only by a maximum turn count, so loops terminate before consuming the full budget.
Practical example
Diagnosing a repeated search loop
An agent searches the same query six times because the tool returns an empty array without explaining that a date filter is invalid. The fix is not merely a stronger prompt: the tool returns an `invalid_filter` code, the runtime blocks identical no-progress calls, and the evaluation adds this trajectory. The failure spans interface, loop control, and testing, so all three layers change.
Field checklist
Apply it in practice
- Classify failures by observation, decision, action, and control layer.
- Measure blocked unsafe attempts as well as outcomes.
- Return actionable, typed tool errors.
- Detect repeated actions and unchanged state.
Decision framework
Questions to answer before you build
Agent failures rarely belong to the model alone. Diagnose the observation, decision, action, and control layers separately so the fix addresses the actual cause.
Was the observation usable?
Check freshness, retrieval quality, missing metadata, error clarity, and whether summaries preserved uncertainty before changing the prompt.
Was the proposed action valid?
Inspect tool selection, argument semantics, ordering, permissions, and whether the action could safely be retried.
Did the runtime contain the error?
Measure denied attempts, repeated calls, budget exhaustion, and incorrect success claims even when guards prevented external harm.
Common failure signals
Watch for these warning signs
- Responding to every failure by asking the model to reason harder.
- Counting blocked unsafe attempts as successful behavior because no harm occurred.
- Patching one example without adding a general regression case.
Selected primary references
Continue with the source material
These sources inform the wider editorial perspective for this topic. They are not presented as line-by-line citations for every statement.
- NISTAI Risk Management Framework ↗A voluntary framework for governing, mapping, measuring, and managing AI risk.
- OWASPOWASP Top 10 for LLM Applications 2025 ↗A practical catalogue of common security risks in LLM-enabled applications.
- AnthropicDemystifying evals for AI agents ↗Evaluation strategies for multi-step, tool-using agent systems.