Harmonizing Safety and Speed: A Human-Algorithm Approach to Enhance the FDA's Medical Device Clearance Policy

2024-07-16

arXiv.org

AI Summary

The FDA’s 510(k) clearance pathway suffers from high device recall rates and substantial review burdens due to the ambiguity of the “substantial equivalence” standard. To address this, we propose a human-in-the-loop decision-support framework that synergistically integrates machine learning–based risk prediction with expert judgment. Leveraging longitudinal data from over 31,000 medical devices, we develop an interpretable ensemble gradient-boosting tree model for premarket risk assessment. A multi-criteria rule engine dynamically recommends clearance, denial, or expert referral. We further introduce a novel methodology for heterogeneous data cleaning and alignment across FDA and CMS sources. This work establishes the first deployable, interpretable paradigm for regulatory policy optimization. Empirical evaluation demonstrates a 38.9% reduction in postmarket recalls, a 43.0% decrease in reviewer workload, and annual cost savings of $2.4–2.7 billion.

Technology Category

• Humans and AI: Human-in-the-loop Machine Learning
• Machine Learning: Calibration & Uncertainty Quantification
• Search and Optimization: Learning to Search

Application Category

• Responsible Web: Machine-in-the-loop, human agency and autonomy
• User Modeling, Personalization and Recommendation: Fairness-aware retrieval and ranking
• Search and Retrieval-Augmented AI: Web evaluation methodologies and metrics

Abstract

The United States Food and Drug Administration's (FDA's) Premarket Notification 510(K) pathway allows manufacturers to gain approval for a medical device by demonstrating its substantial equivalence to another legally marketed device. However, the inherent ambiguity of this regulatory procedure has led to high recall rates for many devices cleared through this pathway. This trend has raised significant concerns regarding the efficacy of the FDA's current approach, prompting a reassessment of the 510(K) regulatory framework. In this paper, we develop a combined human-algorithm approach to assist the FDA in improving its 510(k) medical device clearance process by reducing the risk of potential recalls and the workload imposed on the FDA. We first develop machine learning methods to estimate the risk of recall of 510(k) medical devices based on the information available at the time of submission. We then propose a data-driven clearance policy that recommends acceptance, rejection, or deferral to FDA's committees for in-depth evaluation. We conduct an empirical study using a unique large-scale dataset of over 31,000 medical devices and 12,000 national and international manufacturers from over 65 countries that we assembled based on data sources from the FDA and Centers for Medicare and Medicaid Service (CMS). A conservative evaluation of our proposed policy based on this data shows a 38.9% improvement in the recall rate and a 43.0% reduction in the FDA's workload. Our analyses also indicate that implementing our policy could result in significant annual cost-savings ranging between $2.4 billion and $2.7 billion, which highlights the value of using a holistic and data-driven approach to improve the FDA's current 510(K) medical device evaluation pathway.

Problem

• Reduce high recall rates in FDA's 510(k) medical device clearance
• Improve FDA's workload efficiency in device approval process
• Enhance safety and speed via human-algorithm regulatory approach

Innovation

• Machine learning estimates device recall risk
• Data-driven policy for FDA clearance decisions
• Combined human-algorithm approach reduces workload