🤖 AI Summary
Current AI agents rely on large language models to enforce security policies, yet their non-deterministic behavior renders them vulnerable to attacks such as prompt injection, undermining reliable privacy and security guarantees. This work presents the first systematic integration of established network security principles into AI agent design, proposing a hybrid security architecture that combines centralized policy control, distributed execution, capability-based access control, and zero-trust least-privilege enforcement. By unifying deterministic enforcement mechanisms with context-aware semantic policies, the architecture achieves strong security assurances without sacrificing semantic flexibility. The proposed framework offers a reference model and outlines key research directions for building trustworthy AI agent systems.
📝 Abstract
AI agents are rapidly becoming more capable and widely deployed, promising substantial gains in productivity and enabling new classes of applications. However, their growing autonomy also introduces significant privacy and security risks. Existing defenses are predominantly agent-centric, relying on the agent itself to detect threats and enforce privacy and security policies. This approach is fundamentally limited because it entrusts policy enforcement to AI agents whose LLM-driven behavior is inherently nondeterministic and vulnerable to manipulation through attacks such as prompt injection. As a result, current defenses cannot reliably prevent privacy and security threats, highlighting a critical need for a new solution to securing AI agent systems.
The networking community has long grappled with similar challenges and offers insightful principles we can borrow to design a more secure AI agent system. These include centralized control with distributed enforcement, capability-based access for mediating requests to sensitive resources, and least privilege through zero-trust enforcement. Historically, these principles have provided strong deterministic guarantees for networked systems. However, these principles alone are insufficient for AI agents because the safety and appropriateness of an agent's actions often depend on semantic context beyond the expressiveness of static rules.
Building on these principles, we advocate for a systematic approach to AI agent security that combines deterministic enforcement mechanisms, which provide strong security guarantees, with semantic, context-aware policies that enable nuanced decision-making. We then present a reference architecture and identify key research questions and future directions to guide the design of secure and privacy-preserving AI agent systems.