🤖 AI Summary
This work addresses the absence of standardized evaluation criteria for autonomous scientific experimentation in large-scale user facilities, where existing taxonomies rely on an owner-operator model that is ill-suited to such environments. The authors propose the BASE scale—a six-level (0–5) autonomy classification framework tailored for these facilities—that introduces “reasoning barrier” (Level 3) as a critical threshold, marking the transition from scalar feedback-based decisions to those enabled by semantic digital twins and time-gated mechanisms. Integrating hierarchical architectures, real-time inference, and time-synchronized technologies, the framework supports zero-shot deployment of intelligent agents. It provides facility managers, funding agencies, and scientists with a standardized metric to assess risk, delineate responsibility, and quantify the degree of intelligence embedded in experimental workflows.
📝 Abstract
The transition from automated data collection to fully autonomous discovery requires a shared vocabulary to benchmark progress. While the automotive industry relies on the SAE J3016 standard, current taxonomies for autonomous science presuppose an owner-operator model that is incompatible with the operational rigidities of Large-Scale User Facilities. Here, we propose the Benchmarking Autonomy in Scientific Experiments (BASE) Scale, a 6-level taxonomy (Levels 0-5) specifically adapted for these unique constraints. Unlike owner-operator models, User Facilities require zero-shot deployment where agents must operate immediately without extensive training periods. We define the specific technical requirements for each tier, identifying the Inference Barrier (Level 3) as the critical latency threshold where decisions shift from scalar feedback to semantic digital twins. Fundamentally, this level extends the decision manifold from spatial exploration to temporal gating, enabling the agent to synchronise acquisition with the onset of transient physical events. By establishing these operational definitions, the BASE Scale provides facility directors, funding bodies, and beamline scientists with a standardised metric to assess risk, define liability, and quantify the intelligence of experimental workflows.