You Shall Not Pass! Where and Why Developers Draw The Line on AI Autonomy

2026-07-01

AI Summary

This study investigates how software developers delineate acceptable boundaries of AI autonomy to preserve meaningful human work amid increasing AI involvement in programming. Grounded in cognitive appraisal theory and job design frameworks, the research integrates survey data (N=448) with qualitative interviews to systematically demonstrate, for the first time, that developers’ acceptance of AI autonomy is closely tied to cognitive appraisals such as task identification, sense of accountability, and risk tolerance. Findings reveal that while developers generally endorse supervised AI execution of routine tasks, they remain cautious about granting autonomy to AI in higher-order activities involving professional identity, interpersonal interaction, and architectural design. Moreover, AI usage experience, individual risk preferences, and task characteristics significantly moderate willingness to delegate authority. These insights offer theoretical grounding and practical guidance for designing human-centered AI collaboration tools.

Abstract

As AI takes on more software work, the line between human and AI effort is shifting. Where developers draw that line around AI autonomy bears on how we design tools and roles that preserve meaningful work. Drawing on cognitive appraisal theory, work design, and automation research, we conducted a mixed-methods study of 448 professional developers at Microsoft to investigate their accepted levels of AI autonomy across software engineering work. Most developers accepted AI producing work under their oversight, although accepted autonomy varied substantively across tasks and individuals. Acceptance was lowest for identity-defining, human-facing, and design-oriented work, and higher among developers with more AI experience and risk tolerance. Task accountability was associated with lower odds of allowing AI to act on developers' behalf, whereas task identity was associated with lower odds of granting AI decision-making autonomy. Task demands had the opposite effect, increasing willingness to delegate decision-making to AI. Our findings suggest that preferences for AI autonomy reflect how developers cognitively experience their work, highlighting important considerations for designing meaningful work.

Problem

• AI autonomy
• software engineering
• human-AI collaboration
• work design
• developer preferences

Innovation

• AI autonomy
• work design
• cognitive appraisal theory
• human-AI collaboration
• software engineering