Part 7 · Agentic AI Security
ASI10: Rogue Agents
An agent can drift from its purpose while each individual action still appears legitimate.
What it is
Rogue agents are malicious or compromised AI agents that deviate from their intended function or authorized scope, acting harmfully, deceptively, or parasitically within multi-agent or human-agent systems.
Their individual actions may look normal, which creates a containment gap for traditional rule-based controls.
How the failure unfolds
Behavior monitoring looks at patterns over time, and containment limits what a drifting agent can reach.
Common patterns
- Goal drift: behavior moves away from the assigned objective.
- Scope expansion: the agent acquires access it was not given for the task.
- Self-replication: it creates persistent copies or tasks.
- Concealment: logs or reports hide what it is doing.
- Reward hacking: it games the metric used to judge success.
Defenses
- Keep signed audit logs. Record actions, tool calls, and communication.
- Create trust zones. Restrict communication between environments.
- Monitor behavior. Compare activity with an approved baseline.
- Contain quickly. Provide kill switches and credential revocation.
- Attest identity. Verify each agent and its configuration.
- Require re-approval. Review agents before restoring access.
Common misconception
Common belief
"A rogue agent must have been hacked."
In practice
Misalignment and poor objectives can cause an agent to go rogue with no outside attacker.
Key takeaways
- Rogue behavior can emerge with or without an outside attacker.
- Monitor patterns of behavior over time.
- Containment requires isolation and a way to revoke access quickly.