The Role of Uncertainty in Assessing the Fairness of Machine Learning Models

📅 2026-09-07
📈 Citations: 0
Influential: 0
📄 PDF
🤖 AI Summary
本文探讨了通过量化不确定性来评估机器学习模型公平性的问题,采用频率学派和贝叶斯方法,并提供了实例分析。
📝 Abstract
Machine learning models are widely used in clinical applications, social media, law enforcement and critical infrastructure. Verifying whether their outputs are biased against disadvantaged groups or individuals is crucial to ensuring they are fair and allowing their use in such settings. A rigorous risk assessment of possible fairness violations requires quantifying the uncertainty associated with selecting and estimating such models. Yet, this is rarely done in the literature, which focuses on identifying a single model with a suitable trade-off between predictive accuracy and fairness. In this paper, we move beyond point estimation and discuss frequentist and Bayesian approaches to uncertainty quantification for fair machine learning, with practical examples and implications for simulated and real data.
Problem

Research questions and friction points this paper is trying to address.

Uncertainty
Fairness
Machine Learning Models
Risk Assessment
Innovation

Methods, ideas, or system contributions that make the work stand out.

Uncertainty Quantification
Fair Machine Learning
Frequentist Approach
Bayesian Approach
F
Francesca Panero
1 Department of Methods and Models for Economics, Territory and Finance, Sapienza Universit`a di Roma, Rome, 00161, Italy; 2 Department of Statistics, London School of Economics and Political Science, London, WC2B 4RR, UK
E
Ernst C. Wit
3 Faculty of Informatics, Universit`a della Svizzera Italiana (USI), Lugano, 6962, Switzerland; 3 Istituto Dalle Molle di Studi sull’Intelligenza Artificiale (IDSIA), Lugano, 6962, Switzerland
Marco Scutari
Marco Scutari
Senior Researcher, IDSIA
Bayesian NetworksCausal DiscoveryFairnessMachine LearningSoftware Engineering