When Fairness Metrics Disagree: Evaluating the Reliability of Demographic Fairness Assessment in Machine Learning

📅 2026-04-16
📈 Citations: 0
Influential: 0
📄 PDF

career value

202K/year
🤖 AI Summary
This study addresses the inconsistency among fairness metrics in face recognition, where different measures often yield contradictory conclusions about model bias, thereby exposing the limitations of single-metric evaluation. To tackle this issue, the authors propose the Fairness Disagreement Index (FDI) to quantify the degree of disagreement across multiple fairness criteria and introduce a multidimensional evaluation framework that integrates both error rate disparities and performance-oriented fairness metrics. Through systematic experiments under controlled conditions, they demonstrate that such metric disagreement is pervasive across varying decision thresholds and model configurations, revealing a critical flaw in current fairness assessment practices. The work provides both a novel analytical tool and empirical evidence to support more comprehensive and reliable fairness evaluations in face recognition systems.

Technology Category

Application Category

📝 Abstract
The evaluation of fairness in machine learning systems has become a central concern in high-stakes applications, including biometric recognition, healthcare decision-making, and automated risk assessment. Existing approaches typically rely on a small number of fairness metrics to assess model behaviour across group partitions, implicitly assuming that these metrics provide consistent and reliable conclusions. However, different fairness metrics capture distinct statistical properties of model performance and may therefore produce conflicting assessments when applied to the same system. In this work, we investigate the consistency of fairness evaluation by conducting a systematic multi-metric analysis of demographic bias in machine learning models. Using face recognition as a controlled experimental setting, we evaluate model performance across multiple group partitions under a range of commonly used fairness metrics, including error-rate disparities and performance-based measures. Our results demonstrate that fairness assessments can vary significantly depending on the choice of metrics, leading to contradictory conclusions regarding model bias. To quantify this phenomenon, we introduce the Fairness Disagreement Index (FDI), a measure designed to capture the degree of inconsistency across fairness metrics. We further show that disagreement remains high across thresholds and model configurations. These findings highlight a critical limitation in current fairness evaluation practices and suggest that single-metric reporting is insufficient for reliable bias assessment.
Problem

Research questions and friction points this paper is trying to address.

fairness metrics
demographic bias
machine learning fairness
evaluation reliability
metric disagreement
Innovation

Methods, ideas, or system contributions that make the work stand out.

Fairness Disagreement Index
multi-metric fairness evaluation
demographic bias
fairness metrics inconsistency
face recognition
🔎 Similar Papers
No similar papers found.