Data (in)equities in data science: Dissecting systemic and systematic biases in pulse oximetry

2026-04-20

AI Summary

This study addresses the systemic measurement bias in pulse oximeters across racial groups, which leads to inequitable health decisions. To tackle this issue, the authors propose a data fairness analysis framework that explicitly decomposes fairness into three actionable dimensions: data, prediction, and decision. Leveraging oracle-based causal simulation and counterfactual attribution analysis, they develop a statistical provenance model that traces how upstream informational biases propagate and amplify into clinical disparities and adverse health outcomes. By translating abstract notions of fairness into empirically testable statistical metrics, the framework establishes a reproducible analytical paradigm for identifying and mitigating such systemic inequities, thereby underscoring the pivotal role of statistics in AI-driven healthcare.

Technology Category

• Philosophy and Ethics of AI: Bias, Fairness & Equity
• Machine Learning: Ethics, Bias, and Fairness
• Computer Vision: Bias, Fairness & Privacy

Application Category

• Social Networks and Social Media: Fairness and bias in social network and social media analysis
• User Modeling, Personalization and Recommendation: Fairness-aware retrieval and ranking
• Economics, Online Markets and Human Computation: Fairness and ethical considerations in crowd work and in human-in-the-loop AI systems

Abstract

Data equity is an emerging framework for responsible data science. However, its core concepts, including fairness, representativeness, and information bias, remain largely abstract and general, lacking the mathematical specificity needed for practical implementation. In this paper, we demonstrate how statisticians can operationalize data equity by translating its tenets into precise, testable formulations tailored to a given problem. Using the well-documented case of differential measurement error across racial groups in pulse oximetry, we first adopt an oracle approach, tracing how a single upstream violation of information bias compounds through the analytic pipeline into treatment disparities, fairness violations, and adverse health outcomes. We then demonstrate the inverse: starting from an observed outcome disparity, the data equity framework provides a principled structure for systematically identifying its statistical sources. Our exposition reveals that data equity, prediction equity, and decision equity are distinct requirements with distinct evaluation and policy needs--a nuance that highlights both the unique role of statisticians in the era of artificial intelligence as well as the necessity of interdisciplinary collaboration.

Problem

• data equity
• systemic bias
• pulse oximetry
• measurement error
• health disparities

Innovation

• data equity
• information bias
• measurement error
• fairness in AI
• statistical operationalization