ActGuard: Pre-execution Action Auditing against Indirect Prompt Injection in LLM Agents

📅 2026-09-13
📈 Citations: 0
Influential: 0
📄 PDF
🤖 AI Summary
为解决大语言模型代理因工具调用而遭受间接提示注入攻击的问题,提出ActGuard框架,通过预执行动作审计识别并移除恶意内容,平衡安全与实用性。
📝 Abstract
Large language model (LLM) agents interact with external environments through tool invocation, but tool outputs can also expose them to indirect prompt injection (IPI) attacks. Existing defenses mainly rely on prompt hardening, content filtering, pre-generated plans, or permission constraints. These approaches often struggle with complex tasks or over-sanitize external content, making it difficult to balance security and utility. The key challenge is therefore to preserve execution flexibility while precisely identifying and removing the malicious content that actually induces unsafe actions. To address this challenge, we propose ActGuard, a pre-execution action auditing framework. Rather than judging whether external content is inherently suspicious, ActGuard assesses whether it causes the current action to deviate from a locally reasonable expectation. At each step, ActGuard predicts the tools likely to be used by the upcoming action and constructs a local tool prior without constraining the execution trajectory. Before execution, it compares the candidate action against this prior and performs tool-level contrastive analysis and parameter-level evidence localization to identify deviations in tool selection and action parameters. A verifier then examines the localized evidence, masks only spans confirmed as malicious, and regenerates the action from the sanitized context. This design preserves legitimate planning flexibility while minimizing information loss from indiscriminate filtering. We evaluate ActGuard on challenging benchmarks for tool-using agents. Results show that ActGuard reduces attack success rates to a level comparable to state-of-the-art defenses while maintaining task utility close to the no-attack setting, achieving a favorable security-utility trade-off. Our code is publicly available at: https://github.com/binzhwang/ActGuard.
Problem

Research questions and friction points this paper is trying to address.

indirect prompt injection
large language model
tool invocation
security-utility trade-off
Innovation

Methods, ideas, or system contributions that make the work stand out.

Pre-execution Action Auditing
Indirect Prompt Injection
Tool-level Contrastive Analysis
Parameter-level Evidence Localization
🔎 Similar Papers
💼 Related Jobs
No related jobs found.
Bingzheng Wang
Bingzheng Wang
Institute of Information Engineering, Chinese Academy of Sciences
reinforcement learningconfidential computingprivacy inference
X
Xiaoyan Gu
Institute of Information Engineering, Chinese Academy of Sciences, Beijing, China
W
Wentao Wang
Institute of Information Engineering, Chinese Academy of Sciences, Beijing, China
X
Xingyou Yang
Department of Statistics, University of Wisconsin–Madison, Madison, WI 53706, USA
H
Hongcheng Li
Institute of Information Engineering, Chinese Academy of Sciences, Beijing, China
Rong Yin
Rong Yin
Associate Researcher, Institute of Information Engineering, Chinese Academy of Sciences
LLMGraph Representation LearningStatistical Learning Theory