🤖 AI Summary
This study addresses the pervasive “capability–deployment validation gap” that impedes the real-world adoption of advanced AI agent systems in industry. Through in-depth interviews with 16 practitioners across 12 enterprises of varying scales and domains, and by applying a six-level AI maturity framework, the research systematically assesses current agent adoption practices. It reveals, for the first time, that this gap stems primarily from information asymmetry and a lack of organizational readiness. Key technical barriers include large language models’ context limitations, non-deterministic behavior, insufficient support for proprietary languages, and data confidentiality constraints. Findings indicate most organizations operate at Level 1 (AI assistant) or Level 2 (AI compensator), with only one reaching Level 3 (multi-agent orchestration); notably, four firms could not achieve production deployment due to the absence of output validation mechanisms.
📝 Abstract
Agentic AI systems are entering software engineering workflows, yet empirical evidence on how industrial organizations actually adopt them remains sparse. We present a qualitative interview study with sixteen practitioners across twelve companies of varying size and domain. This study characterizes the current agentic AI adoption state of these companies, employing a six-level maturity framework adapted from established AI-driven organizations. The findings reveal that seven companies operate at Level~1 (AI Assistants), four companies at Level~2 (AI Compensators), and only one in Level~3 (Multi-Agent Orchestration), with large and safety-regulated organizations among the most advanced adopters. The primary finding is a capability-deployment verification gap, four companies demonstrated higher-level experimental AI capabilities but cannot integrate them into production workflows because adequate output verification mechanisms are absent, leaving human-in-the-loop as the only trusted verification mechanism. This gap is shaped by four recurring barriers: context window of LLMs constraints especially when diverse knowledge aggregation is needed, under-performance on proprietary programming languages and protocols, non-determinism incompatible with qualification standards, and data confidentiality concerns. Two interdependent dimensions of this gap emerge from these findings (information asymmetry and qualification absence) framing a core open problem for industrial agentic integration.