NaviNote: Enabling In-situ Spatial Annotation Authoring to Support Exploration and Navigation for Blind and Low Vision People
🤖 AI Summary
This study addresses the limitations of conventional GPS-based geotagging systems, which suffer from insufficient positioning accuracy to support precise navigation for blind and low-vision individuals in unfamiliar environments. To overcome this challenge, the authors propose a novel spatial annotation and navigation system that integrates high-precision visual localization, an intelligent agent architecture, and voice-based interaction. For the first time, centimeter-level visual localization is leveraged to enable accurate last-meter navigation and context-aware spatial annotation for visually impaired users, effectively transcending the precision constraints of traditional GPS. A user study involving 18 blind or low-vision participants demonstrated significant improvements in environmental comprehension and autonomous navigation performance, confirming the system’s effectiveness and innovation as an assistive tool.
Application Category
📝 Abstract
GPS and smartphones enable users to place location-based annotations, capturing rich environmental context. Previous research demonstrates that blind and low vision (BLV) people can use annotations to explore unfamiliar areas. However, current commercial systems allowing BLV users to create annotations have never been evaluated, and current GPS-based systems can deviate several meters. Motivated by high-accuracy visual positioning technology, we first conducted a formative study with 24 BLV participants to envision a more accurate and inclusive annotation system. Surprisingly, many participants viewed the high-accuracy technology not just as an annotation system but also as a tool for precise last-few-meters navigation. Guided by participant feedback, we developed NaviNote, which combines vision-based high-precision localization with an agentic architecture to enable voice-based annotation authoring and navigation. Evaluating NaviNote with 18 BLV participants showed that it significantly improved navigation performance and supported users in understanding and annotating their surroundings. Based on these findings, we discuss design considerations for future accessible annotation authoring systems.
Problem
Research questions and friction points this paper is trying to address.
spatial annotation
blind and low vision
navigation
location accuracy
accessibility
Innovation
Methods, ideas, or system contributions that make the work stand out.
vision-based localization
spatial annotation
accessible navigation
agentic architecture
blind and low vision
🔎 Similar Papers
No similar papers found.
