🤖 AI Summary
This study addresses the significant degradation in robustness of commercial presentation attack detection (PAD) systems for remote authentication under realistic environmental conditions, particularly low illumination and automated image capture. For the first time, it systematically quantifies the impact of these two common perturbations on the performance of mainstream PAD solutions by constructing ecologically valid test scenarios. Through error rate modeling and statistical analysis, the work evaluates shifts in classification accuracy across varying conditions. Results reveal that most systems exhibit approximately a fourfold increase in error rates under low-light conditions and a twofold increase under automated capture, with only one system maintaining a bona fide misclassification rate below 3% across all tested scenarios. The findings advocate for a new evaluation paradigm that mandates PAD robustness validation across diverse real-world settings.
📝 Abstract
Presentation attack detection (PAD) subsystems are an important part of effective and user-friendly remote identity validation (RIV) systems. However, ensuring robust performance across diverse environmental and procedural conditions remains a critical challenge. This paper investigates the impact of low-light conditions and automated image acquisition on the robustness of commercial PAD systems using a scenario test of RIV. Our results show that PAD systems experience a significant decline in performance when utilized in low-light or auto-capture scenarios, with a model-predicted increase in error rates by a factor of about four under low-light conditions and a doubling of those odds under auto-capture workflows. Specifically, only one of the tested systems was robust to these perturbations, maintaining a maximum bona fide presentation classification error rate below 3% across all scenarios. Our findings emphasize the importance of testing across diverse environments to ensure robust and reliable PAD performance in real-world applications.