Smart Glasses for CVI: Co-Designing Extended Reality Solutions to Support Environmental Perception by People with Cerebral Visual Impairment

2025-06-23

AI Summary

This study addresses core perceptual challenges faced by individuals with cerebral visual impairment (CVI)—including object localization, text recognition, face identification, social engagement, and sensory overload—by proposing an Apple Vision Pro–based smart glasses intervention. Employing a dual-diamond co-design framework, the research integrates contextual inquiry through real-world diary studies with iterative, participatory user workshops to ensure CVI-centered technological adaptation. It represents the first systematic investigation into the feasibility and efficacy of extended reality (XR) technologies for CVI support, yielding a lightweight, context-aware visual enhancement prototype. Empirical evaluation demonstrates significant improvements in users’ environmental awareness and functional independence in daily activities, alongside measurable reductions in sensory stress. The work contributes a reusable design paradigm and empirically grounded evidence for CVI assistive technology development, advancing human-centered XR applications in neurodiverse visual rehabilitation.

Technology Category

• Computer Vision: Multi-modal Vision
• Humans and AI: AI for Accessibility
• Intelligent Robots: Multimodal Perception & Sensor Fusion

Application Category

• Responsible Web: Human-perceived consequences of algorithmic deployment on the web
• Search and Retrieval-Augmented AI: Personalized, context-aware and across-device search
• Security and Privacy: Data transparency and provenance

Abstract

Cerebral Visual Impairment (CVI) is the set to be the leading cause of vision impairment, yet remains underrepresented in assistive technology research. Unlike ocular conditions, CVI affects higher-order visual processing-impacting object recognition, facial perception, and attention in complex environments. This paper presents a co-design study with two adults with CVI investigating how smart glasses, i.e. head-mounted extended reality displays, can support understanding and interaction with the immediate environment. Guided by the Double Diamond design framework, we conducted a two-week diary study, two ideation workshops, and ten iterative development sessions using the Apple Vision Pro. Our findings demonstrate that smart glasses can meaningfully address key challenges in locating objects, reading text, recognising people, engaging in conversations, and managing sensory stress. With the rapid advancement of smart glasses and increasing recognition of CVI as a distinct form of vision impairment, this research addresses a timely and under-explored intersection of technology and need.

Problem

• Developing smart glasses to aid environmental perception for CVI patients
• Addressing object recognition and facial perception challenges in CVI
• Exploring extended reality solutions for sensory stress management

Innovation

• Co-designing XR solutions for CVI support
• Using Apple Vision Pro for iterative development
• Smart glasses address object and text challenges