How AI Impacts Skill Formation
🤖 AI Summary
This study investigates how AI assistance affects novice developers’ acquisition of asynchronous programming skills, revealing that such support may undermine conceptual understanding, code comprehension, and debugging abilities—critical competencies for long-term proficiency. Through a randomized controlled experiment comparing learning with and without AI tools, the research identifies six distinct patterns of AI interaction, three of which sustain cognitive engagement and preserve learning outcomes. Integrating behavioral data, task performance assessments, and AI interaction logs, the findings indicate that AI assistance does not significantly enhance task efficiency on average and can impair the development of deeper programming skills. Although fully delegating tasks to AI yields short-term productivity gains, it comes at the cost of meaningful learning. These results challenge the conflation of efficiency with skill development and offer crucial insights for the pedagogically informed design of AI programming tools.
Application Category
📝 Abstract
AI assistance produces significant productivity gains across professional domains, particularly for novice workers. Yet how this assistance affects the development of skills required to effectively supervise AI remains unclear. Novice workers who rely heavily on AI to complete unfamiliar tasks may compromise their own skill acquisition in the process. We conduct randomized experiments to study how developers gained mastery of a new asynchronous programming library with and without the assistance of AI. We find that AI use impairs conceptual understanding, code reading, and debugging abilities, without delivering significant efficiency gains on average. Participants who fully delegated coding tasks showed some productivity improvements, but at the cost of learning the library. We identify six distinct AI interaction patterns, three of which involve cognitive engagement and preserve learning outcomes even when participants receive AI assistance. Our findings suggest that AI-enhanced productivity is not a shortcut to competence and AI assistance should be carefully adopted into workflows to preserve skill formation -- particularly in safety-critical domains.
Problem
Research questions and friction points this paper is trying to address.
AI assistance
skill formation
novice workers
learning outcomes
productivity
Innovation
Methods, ideas, or system contributions that make the work stand out.
AI assistance
skill formation
cognitive engagement
randomized experiment
learning outcomes
🔎 Similar Papers
No similar papers found.
