PriMobiBench: Characterizing Visual Privacy Leakage in VLM-Driven Mobile GUI Agents

2026-09-12

AI Summary

研究提出PriMobiBench基准，用于评估移动GUI代理中的视觉隐私泄露问题，并通过遮蔽敏感UI元素的方法减轻风险。

Abstract

Mobile GUI agents increasingly rely on Vision-Language Models (VLMs) to automate smartphone tasks by interpreting screenshot streams. However, this design introduces serious and underexplored privacy risks, including direct leakage of sensitive on-screen information and unintended user profiling. The absence of standardized benchmarks makes it difficult to quantify these risks in realistic mobile agent workflows. To address this gap, we propose PriMobiBench, the first benchmark for systematically evaluating privacy leakage and visual profiling in screenshot-driven mobile agents. It provides a unified pipeline for data generation, agent trajectory construction, and multi-model evaluation. We also introduce MobiLeak, a dataset of execution traces from 16 apps, covering 25 privacy attributes with 2,960 embedded privacy instances. Our results reveal substantial risks: (1) VLMs can directly extract sensitive information with up to 82.5% success rate; (2) beyond explicit leakage, they can infer user profiles from aggregated visual evidence with approximately 70% success. We further propose a mitigation that masks privacy-sensitive but task-irrelevant UI elements before cloud processing, reducing profiling success by up to 58% with only approximately 8% performance loss. Overall, our work provides the first systematic benchmark for visual privacy risks in mobile GUI agents, demonstrates that both leakage and profiling are feasible at a highly concerning level, and offers a practical direction for mitigation.

Problem

• Visual Privacy Leakage
• Vision-Language Models
• Mobile GUI Agents
• Privacy Risks
• User Profiling

Innovation

• PriMobiBench
• Visual Privacy Leakage
• Mobile GUI Agents
• MobiLeak Dataset
• Privacy Mitigation