Fairness May Backfire: When Leveling-Down Occurs in Fair Machine Learning

2026-03-06

AI Summary

This study investigates whether fairness constraints in machine learning genuinely benefit disadvantaged groups or instead induce a “leveling-down” effect. Within a unified framework of Bayes-optimal classification, the work provides the first distribution- and algorithm-agnostic characterization—at the population level—of the conditions under which fairness interventions degrade overall performance. It systematically compares two deployment scenarios: one where sensitive attributes are observable (attribute-aware) and another where they are unobservable (attribute-blind). The analysis reveals that when sensitive attributes are visible, fairness constraints yield only marginal improvements for disadvantaged groups. In contrast, when attributes are hidden, the impact of such constraints critically depends on the underlying data distribution and the presence of “masked” candidates, potentially worsening or improving outcomes for all groups simultaneously—thereby highlighting the fundamental role of sensitive attribute availability in determining the efficacy of fairness interventions.

Technology Category

• Machine Learning: Ethics, Bias, and Fairness
• Computer Vision: Bias, Fairness & Privacy
• Game Theory and Economic Paradigms: Fair Division

Application Category

• User Modeling, Personalization and Recommendation: Fairness-aware retrieval and ranking
• Economics, Online Markets and Human Computation: Fairness, privacy, and diversity in economic environments
• Responsible Web: Human-perceived consequences of algorithmic deployment on the web

Abstract

As machine learning (ML) systems increasingly shape access to credit, jobs, and other opportunities, the fairness of algorithmic decisions has become a central concern. Yet it remains unclear when enforcing fairness constraints in these systems genuinely improves outcomes for affected groups or instead leads to"leveling down,"making one or both groups worse off. We address this question in a unified, population-level (Bayes) framework for binary classification under prevalent group fairness notions. Our Bayes approach is distribution-free and algorithm-agnostic, isolating the intrinsic effect of fairness requirements from finite-sample noise and from training and intervention specifics. We analyze two deployment regimes for ML classifiers under common legal and governance constraints: attribute-aware decision-making (sensitive attributes available at decision time) and attribute-blind decision-making (sensitive attributes excluded from prediction). We show that, in the attribute-aware regime, fair ML necessarily (weakly) improves outcomes for the disadvantaged group and (weakly) worsens outcomes for the advantaged group. In contrast, in the attribute-blind regime, the impact of fairness is distribution-dependent: fairness can benefit or harm either group and may shift both groups'outcomes in the same direction, leading to either leveling up or leveling down. We characterize the conditions under which these patterns arise and highlight the role of"masked"candidates in driving them. Overall, our results provide structural guidance on when pursuing algorithmic fairness is likely to improve group outcomes and when it risks systemic leveling down, informing fair ML design and deployment choices.

Problem

• fairness
• leveling-down
• machine learning
• group outcomes
• algorithmic fairness

Innovation

• Bayes fairness framework
• leveling down
• attribute-blind decision-making
• distribution-free analysis
• masked candidates