Opus: A Quantitative Framework for Workflow Evaluation
This paper addresses the absence of a unified quality quantification standard for automated workflows. We propose Opus, a novel evaluation framework that jointly models four orthogonal dimensions—correctness (success rate), reliability (structural consistency and information hygiene), efficiency (resource consumption), and value (output gain)—integrating reward mechanisms with normative penalties. Grounded in expected utility theory, structured coupling metrics, observability analysis, and information entropy detection, Opus constructs a probabilistic scoring model. The framework enables automatic workflow scoring, cross-process comparison, and multi-objective optimization, and can be embedded into reinforcement learning loops to support end-to-end workflow discovery and iterative refinement. Experimental results demonstrate that Opus significantly improves both efficiency and reliability of automation systems and accurately identifies Pareto-optimal workflows in complex scenarios.