Video-Based Detection of squint and cataract for accessibility-aware adaptive web interface rendering

2026-07-08

AI Summary

This study addresses visual impairments caused by strabismus and cataracts by proposing an adaptive web interface rendering method tailored for visually impaired users. Leveraging real-time video from a low-cost camera, the approach employs the MediaPipe face mesh model to extract 478 facial landmarks and integrates grayscale intensity with histogram analysis to assess lens opacification, enabling automated screening for both conditions. This work represents the first integration of lightweight video analytics directly into an accessible web system, facilitating large-scale deployment. Experimental results demonstrate high diagnostic accuracy, achieving 98.39% for strabismus detection and 96.90% for cataract classification, thereby offering both clinical precision and practical utility in real-world accessibility applications.

Abstract

Squint and cataract are major ocular disorders that majorly affect visual perception and interaction capability. This paper proposes a real-time video-based automated detection system for squint and cataract detection based on computer vision and image processing methods. The proposed system uses a media-pipe face-mesh (a 478-point facial landmark detection model) to extract geometric ocular features for multi-class squint classification. Simultaneously, The presence and severity cataract is estimated through grayscale intensity and histogram-based lens opacity analysis. The system records short video sequences with standard laptop or mobile cameras, which can be deployed at low costs and on a large scale. The experimental performance has shown great accuracy in the detection of squint (98.39%) and classification of cataract (96.90%). Besides automatic ocular analysis, the proposed framework is also made accessible for visual impairment inference which will be integrated with future adaptive user interface and Web accessibility systems for people with visual impairment.

Problem

• squint
• cataract
• video-based detection
• visual impairment
• accessibility

Innovation

• video-based detection
• MediaPipe face-mesh
• ocular disorder screening
• adaptive web interface
• cataract severity estimation