After studying this material, you should be able to:
Think of traditional software like a vending machine:
An AI agent is more like a human employee:
| Traditional Software | AI Agent |
|---|---|
| Executes predefined logic | Reasons dynamically over content |
| Attack surface = APIs and identity | Attack surface includes semantic layer |
| "Can this user access this?" | "Should this agent do this right now?" |
| Threat | Simple Definition |
|---|---|
| Prompt Injection | Malicious instructions hidden in content the agent reads |
| Tool Poisoning | Corrupted tools that manipulate agent behavior |
| Memory Poisoning | Corrupted stored context that misleads the agent |
| Goal Hijacking | Tricking the agent into pursuing unintended objectives |
| Behavioral Drift | Agent gradually deviating from its intended purpose |
| Hallucination-Driven Actions | Agent acting on fabricated information |
Key Insight: An attacker doesn't need to break your login system. They can hide malicious instructions inside a webpage or document the agent reads, and the agent may follow those instructions.
"Is this user allowed to do this?"
"Is this action appropriate given:
- What the user actually requested?
- The agent's defined purpose?
- The user's role and permissions?
- Everything that has happened in this session so far?"
Imagine a customer support AI agent:
Traditional security would have allowed this. Behavioral security catches it.
The framework operates across the full agent lifecycle:
[PROVISIONING] → [RUNTIME ENFORCEMENT] → [CONTINUOUS ASSURANCE]
↑___________________________________________________|
Feedback Loop
What happens before the agent is deployed
Think of this as background checks before hiring an employee.
Analogy: Just as you wouldn't let an unvetted contractor access your building, you shouldn't let unvetted tools access your AI agent.
What happens while the agent is running
This layer extends a familiar security model called PAP → PDP → PEP:
Policy Administration Point (PAP)
↓ defines policies
Policy Decision Point (PDP)
↓ evaluates: "Should this action happen?"
Policy Enforcement Point (PEP)
↓ allows or blocks the action
| Role | Traditional | AI Agent Version |
|---|---|---|
| PAP | Access control policies | AI Registry (personas, intents, constraints) |
| PDP | Authorization engine | AI Guard (semantic evaluation) |
| PEP | API gateway / firewall | Agent Guard runtime hooks |
Beyond "can this user do this?", it asks:
Runtime security must be fast. The solution:
Why this matters: If security checks add too much delay, developers will bypass them. Speed is a security requirement.
What happens after deployment, continuously
Think of this as ongoing auditing and improvement.
| Capability | Purpose |
|---|---|
| End-to-end observability | See everything the agent does |
| Interaction replay | Re-run past sessions against new security rules |
| Automated threat modeling | Continuously map the attack surface |
| Red teaming | Actively try to break the agent's security |
| Feedback loop | Findings update risk scores, policies, and models |
The Problem: An agent takes 20 actions in sequence. How do you know action #17 was actually requested by the user and not injected by a malicious document?
The Solution: Every action is cryptographically linked back to the original user request.
User Request → Action 1 → Action 2 → ... → Action 17
↑_______________________________________________|
Provenance chain maintained
If action #17 cannot be traced back to a legitimate user request, it is flagged or blocked.
Persona: Defines who the agent is and what domain it operates in.
Example: "Customer support agent for ride-hailing, handles billing and trip issues only"
Intents: Explicit list of what the agent is allowed to do.
Example: ["refund_trip", "update_payment_method", "view_trip_history"]
Why this is the most effective control:
"The most effective mitigation we found was also the least glamorous: restricting agents to explicit intents and constraints."
If an action doesn't match a declared intent, it is denied — regardless of whether credentials are valid.
Rules that define under what conditions an action is legitimate.
Example constraints:
Security in agentic systems involves real tradeoffs. These cannot be ignored.
| Tradeoff | Description |
|---|---|
| Security vs. Accuracy | Stronger enforcement → more false blocks of legitimate actions |
| Security vs. Latency | More checks → slower responses |
| Security vs. Cost | More inference → higher compute costs |
| Security vs. Autonomy | Tighter constraints → less flexible agent behavior |
| Security vs. Developer Experience | Complex onboarding → developers bypass controls |
| Challenge | Solution |
|---|---|
| False blocks | Per-agent calibration, shadow-mode testing before enforcement |
| High latency | Parallel execution, small specialized models, local inference |
| Developer friction | Automated onboarding via Argus, pre-generated personas/intents |
| Generic controls | Agent-specific personas, intents, and risk-based calibration |
Core Lesson: Security, accuracy, latency, cost, autonomy, and developer experience must be optimized together, not independently.
Here is how everything connects:
BEFORE DEPLOYMENT
├── Register agent in AI Registry (behavioral contract)
├── Argus analyzes code → auto-generates personas & intents
└── Validate all tools and dependencies
DURING OPERATION
├── Every interaction evaluated by AI Guard
├── Checks: persona match, intent match, constraint compliance,
│ context consistency, provenance chain
└── Small fast models run in parallel for low latency
CONTINUOUSLY
├── All actions logged with full observability
├── Replay past sessions against new rules
├── Red team actively probes for weaknesses
└── Findings feed back into policies and model calibration
| Term | Definition |
|---|---|
| Behavioral Contract | Formal definition of what an agent is designed and permitted to do |
| Prompt Injection | Malicious instructions embedded in content an agent processes |
| Persona | The defined identity and domain scope of an agent |
| Intent | An explicitly permitted action the agent may take |
| Constraint | A condition that must be met for an action to be legitimate |
| Provenance | The traceable origin of an action back to a user request |
| Evidence Chaining | Linking each action in a sequence to its legitimate source |
| Shadow Mode | Running security checks without enforcing them, to measure accuracy |
| Red Teaming | Actively attempting to defeat security controls to find weaknesses |
| MCP Server | Model Context Protocol server — a third-party tool provider for agents |