Neural Signatures of Programming Expertise: Classifying Programmer Skill Levels Using EEG Data

2026-06-29

AI Summary

This study addresses the limitations of traditional programming assessment methods in capturing cognitive differences among programmers by integrating electroencephalography (EEG) with machine learning. It presents the first evidence linking programming expertise to distinct patterns of brain region activation and EEG entropy, demonstrating that both resting-state and task-based EEG signals effectively characterize programming proficiency. Through EEG signal processing, spectral band feature extraction, and a random forest classifier, the proposed approach achieves a binary classification accuracy of 91.83% and a three-class accuracy of 78.15% under 10-fold cross-validation. These results substantiate the feasibility and efficacy of leveraging neurophysiological features to construct objective, neural-based models for evaluating programming ability.

Abstract

Accurately assessing a programmer's skill level is critical for hiring, team composition, and performance evaluation in the software industry. Conventional methods, such as coding tests or interviews, often fail to capture the full spectrum of cognitive abilities underlying programming expertise. This study explores using electroencephalography (EEG) and machine learning to investigate neural correlates of programming skill. We analyzed an existing EEG dataset recorded during code comprehension from 37 programmers with 1 to 30 years of experience (8.1 +/- 6.3 years) to examine relationships between neural activity and expertise. Additionally, we conducted classification experiments using Random Forest classifiers with diverse features for binary (experts vs. novices) and multi-class (experts, intermediates, novices) setups.We identified EEG features and brain regions associated with programming expertise. Specifically, EEG entropy showed the strongest correlation with skill level. Furthermore, experts' brains were characterized by highly localized centro-frontal activation, whereas frontal activation in other groups was part of a more distributed network. Regarding classification, our setup achieved an average accuracy of 91.83% (binary) and 78.15% (multi-class) in stratified 10-fold cross-validation, while leave-one-subject-out validation achieved 85.00% and 58.80%, respectively. Individual frequency bands outperformed full-spectrum analyses, and both program comprehension and resting-state data yielded strong results. These findings demonstrate that EEG features effectively capture neural correlates across different skill levels and highlight the potential of neural data to complement traditional methods of skill assessment.

Problem

• programming expertise
• skill assessment
• EEG
• neural correlates
• code comprehension

Innovation

• EEG entropy
• neural correlates of expertise
• program comprehension
• machine learning classification
• centro-frontal activation