Prototyping and Evaluating a Real-time Neuro-Adaptive Virtual Reality Flight Training System

2025-12-09

AI Summary

This study addresses the challenge of dynamically aligning task difficulty with cognitive load during flight training. We designed and empirically validated the first real-time EEG-driven neuroadaptive virtual reality (VR) training system tailored for military pilot trainees. The system integrates a pretrained brain–computer interface (BCI), a real-time cognitive load estimation model, and a high-fidelity VR flight simulator to enable neural feedback–based dynamic difficulty adjustment. Dual-dimensional evaluation—using both subjective workload ratings (e.g., NASA-TLX) and objective flight performance metrics—revealed no statistically significant improvement in overall performance or mean subjective load; however, it provided the first empirical evidence of a significant negative correlation between increased subjective workload and degraded flight performance. Trainees consistently endorsed the system’s potential for personalized adaptation and enhanced training experience. This work fills a critical gap in empirical research on real-time neuroadaptive training systems in military contexts and establishes a reproducible methodological framework and key empirical foundation for closed-loop cognitive load regulation.

Technology Category

• Cognitive Modeling & Cognitive Systems: Adaptive Behavior
• Multiagent Systems: Adversarial Agents
• Machine Learning: Hardware-aware ML

Application Category

• User Modeling, Personalization and Recommendation: Practical large-scale studies of user experience
• Search and Retrieval-Augmented AI: Web evaluation methodologies and metrics
• Responsible Web: Machine-in-the-loop, human agency and autonomy

Abstract

Real-time adjustments to task difficulty during flight training are crucial for optimizing performance and managing pilot workload. This study evaluated the functionality of a pre-trained brain-computer interface (BCI) that adapts training difficulty based on real-time estimations of workload from brain signals. Specifically, an EEG-based neuro-adaptive training system was developed and tested in Virtual Reality (VR) flight simulations with military student pilots. The neuro-adaptive system was compared to a fixed sequence that progressively increased in difficulty, in terms of self-reported user engagement, workload, and simulator sickness (subjective measures), as well as flight performance (objective metric). Additionally, we explored the relationships between subjective workload and flight performance in the VR simulator for each condition. The experiments concluded with semi-structured interviews to elicit the pilots' experience with the neuro-adaptive prototype. Results revealed no significant differences between the adaptive and fixed sequence conditions in subjective measures or flight performance. In both conditions, flight performance decreased as subjective workload increased. The semi-structured interviews indicated that, upon briefing, the pilots preferred the neuro-adaptive VR training system over the system with a fixed sequence, although individual differences were observed in the perception of difficulty and the order of changes in difficulty. Even though this study shows performance does not change, BCI-based flight training systems hold the potential to provide a more personalized and varied training experience.

Problem

• Developed a neuro-adaptive VR flight training system using EEG-based BCI
• Compared adaptive difficulty adjustment to fixed sequences in pilot training
• Assessed impact on workload, performance, engagement, and simulator sickness

Innovation

• EEG-based neuro-adaptive system adjusts VR flight difficulty
• Real-time BCI estimates workload from brain signals
• Personalized training via adaptive difficulty in VR simulations