STEP: A Modular Silent Trial Engine for Operational Evaluation of Digital Pathology AI in Routine Workflow

📅 2026-08-27
📈 Citations: 0
Influential: 0
📄 PDF
🤖 AI Summary
本文介绍了STEP平台,通过模块化适配器接口整合不同临床和计算环境,用于病理学AI模型的前瞻性无声试验,以评估其在实际工作流程中的性能和可靠性。
📝 Abstract
Prospective silent trials provide an important bridge between retrospective validation of artificial intelligence (AI) models and their use in clinical care by evaluating model performance and operational reliability on live clinical data without influencing patient management. In computational pathology, conducting silent trials requires integration across laboratory information systems, digital pathology infrastructure, computational resources, and model inference pipelines, and these workflows are often implemented using application-specific software. We developed the Silent Trial Engine for Pathology (STEP), a reusable software platform for orchestrating prospective silent trials of computational pathology AI models across heterogeneous clinical and computational environments. STEP separates common trial orchestration from institution-specific data access and compute infrastructure through modular adapter interfaces. The platform supports scheduled case discovery, per-slide inference submission, deterministic idempotency, failure recovery, result and ancillary-data ingestion, persistent trial and run state, and audit logging, with compute adapters supporting local execution and high-performance computing environments using LSF and Slurm. STEP was deployed at three institutions to support prospective silent evaluation of EAGLE, an AI model for predicting EGFR mutation status from hematoxylin and eosin-stained whole-slide images. By separating trial-level workflow logic from site-specific integrations, STEP enables a common execution framework to operate across heterogeneous pathology environments while maintaining durable and auditable trial state. This approach may reduce duplicated engineering effort and facilitate systematic real-world evaluation of computational pathology AI before interventional clinical deployment.
Problem

Research questions and friction points this paper is trying to address.

silent trials
computational pathology
AI models
clinical and computational environments
software platform
Innovation

Methods, ideas, or system contributions that make the work stand out.

Silent Trial Engine
modular adapter interfaces
deterministic idempotency
failure recovery
heterogeneous environments
🔎 Similar Papers
No similar papers found.
💼 Related Jobs
No related jobs found.
Gabriele Campanella
Gabriele Campanella
Icahn School of Medicine at Mount Sinai
Deep LearningComputer VisionComputational Pathology
M
Matthew Croken
Department of Pathology, Icahn School of Medicine at Mount Sinai, New York
O
Olga Lukatskaya
Department of Pathology, Icahn School of Medicine at Mount Sinai, New York
J
Jane Houldsworth
Department of Pathology, Icahn School of Medicine at Mount Sinai, New York
R
Ricky Kwan
Department of Pathology, Icahn School of Medicine at Mount Sinai, New York
P
Peter Schüffler
Institute of Pathology, Technical University of Munich, Munich
C
Chad Vanderbilt
Department of Pathology, Memorial Sloan Kettering Cancer Center, New York