OPERA: Operator-residual feedback for reliable autonomous optical experiments with language-model agents
This work addresses the limitation of existing autonomous agents in optical experimentation, whose scoring metrics often fail to faithfully capture physical outcomes, leading to ineffective or detrimental decisions. To overcome this, the authors propose the OPERA framework, which introduces—for the first time—an operator-residual feedback mechanism. Experimental actions are modeled as optical operators, and physically interpretable residuals quantify the deviation between actual outcomes and desired states, explicitly decoupling executable actions from physical state errors. Integrating language model agents, optical operator representations, and digital twin technology, OPERA enables closed-loop autonomous control grounded in measurable physical evidence. Evaluated across three optical tasks, the framework reduces the proportion of invalid decisions from 23.6–39.0% to 0.9–1.9%, substantially improving task success rates, stability, and the efficiency of protocol transfer and reconstruction on real instruments.