Problem
Research questions and friction points this paper is trying to address.
Dependency Upgrades
Coding Agents
Software Maintenance
Hidden Breakage
Update from Hell: Can Coding Agents Survive Hidden Breakage in Dependency Upgrades?
🤖 AI Summary
本文通过构建DEPBENCH基准测试，评估编码代理在处理依赖升级导致的隐藏代码更改方面的能力，揭示了现有代理技术与实际软件维护需求之间的差距。
📝 Abstract
Modern software systems rely heavily on third-party dependencies, but upgrading those dependencies remains a costly maintenance activity. Dependency upgrades do not always preserve the function signatures, type systems, APIs, or runtime semantics assumed by existing code. Consequently, developers often need to perform source code adaptations to accommodate dependency-induced changes. However, such code-level changes are often not explicitly communicated to project maintainers, posing a significant challenge to software reliability.
Meanwhile, coding agents have emerged as a new form of software development tool and are increasingly adopted by developers due to their automation capabilities. In this paper, we introduce DEPBENCH, a benchmark consisting of 203 real-world dependency-upgrade tasks across five package ecosystems spanning five language communities, each involving hidden code-level changes that require source code adaptation. We evaluate mainstream coding agents on DEPBENCH. The best completed configuration solves only 104/203 tasks (51.2%), with substantial variation across agent harnesses, models, and ecosystems, highlighting an important gap between current agent capabilities and real-world software maintenance needs.
Innovation
Methods, ideas, or system contributions that make the work stand out.
dependency upgrades
coding agents
DEPBENCH
software maintenance
source code adaptation
🔎 Similar Papers
No similar papers found.
