An Exploratory Eye Tracking Study on How Developers Classify and Debug Python Code in Different Paradigms

2025-11-10

AI Summary

This study investigates how Python’s multi-paradigm code—object-oriented, procedural, and functional—affects developers’ code comprehension and debugging performance. Using eye-tracking technology within a controlled experiment involving paradigm classification and debugging tasks, we quantitatively analyze visual behavior (e.g., fixation duration, saccade patterns) and subjective cognitive load. Our key contribution is the first empirical demonstration that functional-style code induces significantly higher cognitive load and paradigm identification uncertainty: participants exhibited longer fixations, reduced debugging confidence, and distinctive scanning behaviors—including frequent regressions to critical expressions. Compared to object-oriented and procedural variants, functional code increased average debugging time by 23% and decreased self-reported confidence by 31% (p < 0.01). These findings provide cognition-informed, empirical evidence to guide multi-paradigm language design, IDE-based intelligent assistance (e.g., adaptive code highlighting or refactoring suggestions), and pedagogical strategies in programming education.

Technology Category

• Reasoning under Uncertainty: Probabilistic Programming
• Natural Language Processing: Code Generation / Program Synthesis from Natural Language
• Computer Vision: Multi-modal Vision

Application Category

• User Modeling, Personalization and Recommendation: Practical large-scale studies of user experience
• Search and Retrieval-Augmented AI: Web evaluation methodologies and metrics
• Security and Privacy: Large-scale security measurements

Abstract

Modern programming languages, such as Python, support language features from several paradigms, such as object-oriented, procedural, and functional. Research has shown that code written in some paradigms can be harder to comprehend, but to date, no research has looked at which paradigm-specific language features impact comprehension. To this end, this study seeks to uncover which paradigm-specific features impactcomprehension and debugging of code or how multi-paradigm code might affect a developer's ability to do so. We present an exploratory empirical eye-tracking study to investigate 1) how developers classify the predominant paradigm in Python code and 2) how the paradigm affects their ability to debug Python code. The goal is to uncover if specific language features are looked at more often while classifying and debugging code with a predominant paradigm. Twenty-nine developers (primarily students) were recruited for the study and were each given four classification and four debugging tasks in Python. Eye movements were recorded during all the tasks. The results indicate confusion in labeling Functional and Procedural paradigms, but not Object-Oriented. The code with predominantly functional paradigms also took the longest to complete. Changing the predominant paradigm did not affect the ability to debug the code, though developers did rate themselves with lower confidence for Functional code. We report significant differences in reading patterns during debugging, especially in the Functional code. During classification, results show that developers do not necessarily read paradigm-relevant token types.

Problem

• Investigating how paradigm-specific language features impact Python code comprehension
• Examining how developers classify predominant programming paradigms in Python code
• Analyzing how programming paradigms affect developers' debugging abilities in Python

Innovation

• Eye tracking measures developer reading patterns
• Analyzes paradigm classification and debugging tasks
• Compares functional procedural object-oriented comprehension differences