Scene Awareness While Using Multiple Navigation Aids in AR Search

2025-11-20

AI Summary

This study investigates the interference effects of multiple navigation aids on users’ situational awareness in augmented reality (AR) environments. Method: In a large-scale AR treasure-hunt task, we experimentally compared participants’ memory accuracy for real-world objects under three conditions: using only a world-locked arrow, only an on-screen radar, or both aids concurrently. Contribution/Results: Both single and dual navigation aids significantly impaired object recall accuracy (p < 0.01), confirming systematic interference with environmental perception; dual-use induced greater degradation. This work provides the first quantitative evidence of multimodal AR navigation’s negative impact on spatial awareness. Based on these findings, we propose the “perception-adaptive interface” design principle—dynamically modulating aid intensity and timing to preserve navigational efficiency while minimizing perceptual cost. The results offer empirical grounding and a design framework for navigating the trade-off between navigation support and environmental awareness in AR human–computer interaction.

Technology Category

• Intelligent Robots: Multimodal Perception & Sensor Fusion
• Cognitive Modeling & Cognitive Systems: Social Cognition And Interaction
• Humans and AI: Interaction Techniques and Devices

Application Category

• Search and Retrieval-Augmented AI: Web evaluation methodologies and metrics
• User Modeling, Personalization and Recommendation: Fairness-aware retrieval and ranking
• Responsible Web: Machine-in-the-loop, human agency and autonomy

Abstract

Augmented reality (AR) allows virtual information to be presented in the real world, providing support for numerous tasks including search and navigation. Allowing users access to multiple navigation aids may help leverage the benefits of different navigational guidance methods, but may also have negative perceptual and cognitive impacts. In this study, users performed searches for virtual gems within a large-scale augmented environment while choosing to deploy two different navigation aids either independently or simultaneously: world-locked arrows and an on-screen radar. After completing the search, participants were asked to recall objects that may or may not have been present in the scene. The use of navigation aids impacted object recall, with impaired recall of objects in the environment when an aid was switched on. The results point at possible impact factors of object awareness in mobile AR and underscore the potential for adaptable interfaces to support users navigating the physical world.

Problem

• Investigating how multiple AR navigation aids affect scene awareness during search tasks
• Examining cognitive impacts of simultaneous navigation tools on environmental object recall
• Exploring adaptable AR interfaces to balance navigation support and scene awareness

Innovation

• Combining world-locked arrows with on-screen radar
• Studying navigation aids' impact on object awareness
• Proposing adaptable AR interfaces for navigation