Problem
Research questions and friction points this paper is trying to address.
Agentic IDEs
end-to-end development
full-stack Web applications
LLM-based agents
Generation of Web Apps with Agentic IDEs: An Empirical Assessment
🤖 AI Summary
研究评估了三种基于LLM的智能IDE（Copilot、Cursor和Windsurf）在从零开始生成五个全栈Web应用时的表现，发现它们在常见模式生成上成熟度高，但在分布式架构生成中错误较多。
📝 Abstract
Agentic IDEs are among the most significant innovations in software engineering, aiming to accelerate application development through LLM-based agents that can assist developers during development. However, their evaluation in end-to-end development tasks involving the generation of complete applications remains limited. To fill this gap, we propose a rigorous comparative analysis of three popular agentic IDEs (Copilot, Cursor, and Windsurf) in the generation of five full-stack Web applications from scratch.
Results show high maturity in the generation of established patterns, such as CRUD operations and authentication features. In contrast, the generation of less common distributed architectures, such as a task queue architecture, produces significantly more errors. Overall, results show that Agentic IDEs cannot replace developers but shift their role toward building software by orchestrating LLM-based agents through natural-language instructions and iterative refinement. Yet, each agentic IDE shows its peculiarities, although differences are narrow.
Innovation
Methods, ideas, or system contributions that make the work stand out.
Agentic IDEs
end-to-end development
full-stack Web applications
LLM-based agents
iterative refinement
🔎 Similar Papers
No similar papers found.
