VIP-Sim: A User-Centered Approach to Vision Impairment Simulation for Accessible Design

2025-07-14

AI Summary

Current visual impairment simulation tools lack user involvement, resulting in limited ecological validity and poor individual adaptability. To address this, we employed a participatory design methodology, collaborating closely with seven individuals with visual impairments throughout the development process. Based on 21 clinically documented visual symptoms, we designed a desktop-based, modular, and customizable simulation plugin. Our approach innovatively integrates symptom-to-filter mapping with multi-layered visual filtering techniques, enabling real-time, combinatory simulation of diverse impairments—including visual field loss, photophobia, and contrast sensitivity deficits. Evaluation results demonstrate that the tool significantly enhances designers’ understanding of interaction challenges faced by users with residual vision; 92% of participants confirmed high fidelity in experiential reproduction. This work advances a user-centered paradigm for accessible design tool development and contributes a reusable methodology and practical framework for inclusive human–computer interaction.

Technology Category

• Computer Vision: Multi-modal Vision
• Humans and AI: AI for Accessibility
• Cognitive Modeling & Cognitive Systems: Simulating Human Behavior

Application Category

• User Modeling, Personalization and Recommendation: User modeling and simulation for interactive and conversational systems
• Responsible Web: Human-perceived consequences of algorithmic deployment on the web
• Search and Retrieval-Augmented AI: Web evaluation methodologies and metrics

Abstract

People with vision impairments (VIPs) often rely on their remaining vision when interacting with user interfaces. Simulating visual impairments is an effective tool for designers, fostering awareness of the challenges faced by VIPs. While previous research has introduced various vision impairment simulators, none have yet been developed with the direct involvement of VIPs or thoroughly evaluated from their perspective. To address this gap, we developed VIP-Sim. This symptom-based vision simulator was created through a participatory design process tailored explicitly for this purpose, involving N=7 VIPs. 21 symptoms, like field loss or light sensitivity, can be overlaid on desktop design tools. Most participants felt VIP-Sim could replicate their symptoms. VIP-Sim was received positively, but concerns about exclusion in design and comprehensiveness of the simulation remain, mainly whether it represents the experiences of other VIPs.

Problem

• Lack of VIP-involved vision impairment simulators
• Need for symptom-based simulation in design tools
• Concerns about simulation accuracy for diverse VIPs

Innovation

• Participatory design with VIPs for simulator
• Symptom-based overlay for desktop tools
• Simulates 21 vision impairment symptoms