Problem
Research questions and friction points this paper is trying to address.
smart glasses
first-person intelligence
perception-action loop
constraint management
system reliability
From Seeing to Acting: Smart Glasses as First-Person Intelligence Platforms
🤖 AI Summary
本文通过统一框架研究智能眼镜，解决感知-状态-交互-行动循环的持续性、正确性和可控性问题，提出L0-L5框架及九维部署方案。
📝 Abstract
Smart glasses are evolving from capture and display accessories into first-person intelligence platforms that connect human perception, persistent context, and digital or physical action. Their on-body viewpoint aligns with the wearer's vision, audition, motion, and hand-object interaction, but must operate under tight energy, thermal, privacy, and feedback constraints. Despite rapid progress in augmented reality, egocentric vision, multimodal models, human-computer interaction, and embodied intelligence, the literature remains fragmented across devices, tasks, and benchmarks. \textit{The key challenge is not whether a model can recognize, answer, remember, or act in isolation, but whether a complete system can sustain a reliable, temporally valid, correctable, and governable perception-state-interaction-action loop.} This survey is \textit{the \textbf{first} to systematically study smart glasses through such a unified framework}. We formalize first-person data flow and constrained task utility, characterize devices along eight verifiable hardware capability axes, organize the literature around seven interdependent foundational capabilities, and introduce an L0-L5 framework spanning capture, reactive perception, contextual assistance, persistent state, governed action, and embodied coupling. Across nine application scenes, we connect tasks with datasets, systems, products, stakeholders, failure consequences, and evidence gaps. We further present a nine-dimensional deployment framework, a claim-conditioned evaluation protocol, and an evidence ladder from controlled measurement to longitudinal field validation and audit. Together, these elements make smart glasses more comparable, deployable, and reproducibly evaluated, while outlining a roadmap toward trustworthy first-person intelligence.
Innovation
Methods, ideas, or system contributions that make the work stand out.
first-person intelligence
unified framework
L0-L5 framework
nine-dimensional deployment framework
claim-conditioned evaluation protocol
🔎 Similar Papers
No similar papers found.
