🤖 AI Summary
This work addresses the fragmentation in current AI research systems—particularly in autonomy, reproducibility, traceability of evidence, and cross-domain robustness—that impedes end-to-end automation. The authors propose AutoResearch, a novel framework that establishes the first developmental spectrum for AI-driven scientific research, structuring the full workflow into literature review, hypothesis generation, experimental validation, iterative refinement, and dissemination, while distinguishing between human-led (Vibe Research) and AI-led paradigms. Centered on control allocation, evidence-chain management, and accountability, the framework introduces a five-dimensional evaluation metric encompassing novelty, validity, impact, reliability, and traceability. Empirical analysis demonstrates that AI research automation performs reliably in structured, executable, and rapidly verifiable settings, yet remains limited in complex scenarios involving embodied interaction, delayed feedback, or ethical accountability.
📝 Abstract
Scientific research is being reshaped by AI systems that move beyond isolated assistance toward longer-horizon workflows spanning literature grounding, hypothesis generation, experimentation, validation, reporting, and revision. This shift marks a transition from task-level AI for science to workflow-level research automation. Yet current systems remain fragmented, differing in autonomy, domain scope, execution environment, validation mechanism, and human oversight, while still struggling with evidence preservation, reproducibility, weak-direction rejection, provenance tracking, cross-domain robustness, and accountable scientific closure. This survey examines these developments through AutoResearch, defined as the developmental spectrum of AI-powered scientific workflow automation. Within it, Vibe Research denotes the human-steered region of prompt-based assistance and human-verified execution, whereas emerging AI-led systems coordinate larger portions of the discovery loop without achieving robust autonomy. We analyze how research systems redistribute control, evidence, execution, validation, and accountability across workflows and organize the field around five workflow conditions: literature and research grounding; hypothesis formation and planning; experimentation and tool use; feedback, validation, and review; and reporting and knowledge communication. We further synthesize AI scientist systems, mixed-initiative co-research frameworks, benchmarks, domain deployments, and open-source infrastructures. Finally, we propose five evaluation dimensions--novelty, validity, impact, reliability, and provenance--and show that AutoResearch autonomy is domain-conditioned, being more credible in structured, executable, and rapidly verifiable settings but limited in embodied, delayed, heterogeneous, ethical, or institutionally accountable contexts.