Cross-Modal Guidance for Out-of-View Object Search in Simulated Prosthetic Vision

2026-09-01

AI Summary

研究在模拟假体视觉条件下，使用视觉、触觉和听觉引导方法解决视野外物体搜索问题，结果显示非视觉引导方法更有效。

Abstract

Out-of-view guidance is well established in virtual and augmented reality, but its effectiveness may depend on the visual bandwidth available to the user. We test this under simulated prosthetic vision (SPV), where visual guidance must share the same sparse representation used to inspect the scene. Nineteen participants performed object search under two SPV conditions differing in electrode density and phosphene spread (10x10 and 20x20) and four guidance conditions (no guidance, visual, haptic, audio) all driven by the same horizontal target-offset variable. All three modalities reduced search time and head movement. The tested auditory and haptic cues produced approximately 25% faster overall search and 11-13% faster target acquisition than the visual cue, despite similarly direct orienting trajectories. The tested haptic and auditory cues also shortened post-acquisition search. Final head-target angular offset was reduced substantially more in the 10x10 SPV condition; there, all three cues also reduced vertical localization error by approximately 45-58% despite providing no elevation information. Under severe visual constraints, guidance performance depended on cue implementation and search stage.

Problem

• Out-of-View Guidance
• Simulated Prosthetic Vision
• Cross-Modal Cues
• Object Search
• Visual Bandwidth

Innovation

• Cross-Modal Guidance
• Simulated Prosthetic Vision
• Out-of-View Object Search
• Haptic Cues
• Auditory Cues