SmartAlert: Implementing Machine Learning-Driven Clinical Decision Support for Inpatient Lab Utilization Reduction

2025-12-03

AI Summary

Redundant laboratory testing often lacks clinical utility, increasing patient burden and healthcare costs. This study introduces SmartAlert, a probabilistic machine learning system that predicts the stability of complete blood count (CBC) results for hospitalized patients and delivers real-time, actionable clinical decision support via electronic health record (EHR) integration—without imposing rigid ordering restrictions that may disrupt clinical workflow. Our key contributions include: (1) formal quantification of predictive uncertainty integrated directly into clinical workflows; and (2) establishment of a regulatory-compliant governance framework enabling continuous model monitoring and retraining. In a pilot deployment across 9,270 inpatients, SmartAlert significantly reduced CBC repeat testing within 52 hours by 15% (mean rate: 1.54 vs. 1.82 tests/patient, *p* < 0.01), with no adverse impact on safety metrics.

Technology Category

• Machine Learning: Calibration & Uncertainty Quantification
• Reasoning under Uncertainty: Relational Probabilistic Models
• Humans and AI: Planning and Decision Support for Human-Machine Teams

Application Category

• Economics, Online Markets and Human Computation: LLM based quality controls for crowd work
• Responsible Web: Human-perceived consequences of algorithmic deployment on the web
• Semantics and Knowledge: Data modeling to support human-machine intelligence, including LLMs agents, intelligent system behavior, explanations, and user-friendly interactions

Abstract

Repetitive laboratory testing unlikely to yield clinically useful information is a common practice that burdens patients and increases healthcare costs. Education and feedback interventions have limited success, while general test ordering restrictions and electronic alerts impede appropriate clinical care. We introduce and evaluate SmartAlert, a machine learning (ML)-driven clinical decision support (CDS) system integrated into the electronic health record that predicts stable laboratory results to reduce unnecessary repeat testing. This case study describes the implementation process, challenges, and lessons learned from deploying SmartAlert targeting complete blood count (CBC) utilization in a randomized controlled pilot across 9270 admissions in eight acute care units across two hospitals between August 15, 2024, and March 15, 2025. Results show significant decrease in number of CBC results within 52 hours of SmartAlert display (1.54 vs 1.82, p <0.01) without adverse effect on secondary safety outcomes, representing a 15% relative reduction in repetitive testing. Implementation lessons learned include interpretation of probabilistic model predictions in clinical contexts, stakeholder engagement to define acceptable model behavior, governance processes for deploying a complex model in a clinical environment, user interface design considerations, alignment with clinical operational priorities, and the value of qualitative feedback from end users. In conclusion, a machine learning-driven CDS system backed by a deliberate implementation and governance process can provide precision guidance on inpatient laboratory testing to safely reduce unnecessary repetitive testing.

Problem

• Reduces unnecessary repetitive inpatient lab testing
• Predicts stable lab results using machine learning
• Integrates CDS into electronic health records safely

Innovation

• Machine learning predicts stable lab results
• System integrated into electronic health records
• Randomized controlled pilot reduced repetitive testing