Applied and Filtered: An End-to-End Algorithmic Fairness Audit of A Public Employment Agency
This study addresses the limitations of prevailing algorithmic fairness assessments, which often focus narrowly on technical metrics while neglecting organizational and societal contexts, thereby failing to uncover systemic biases in real-world deployments. It presents the first end-to-end socio-technical audit of a semi-automated hiring system used by Barcelona’s public employment service from 2017 to 2022, analyzing nearly 500,000 candidate–job pipeline records. Integrating disparate impact ratio (DIR), multi-stage tracking, and intersectional fairness measures across gender, age, and salary levels, the analysis reveals that while overall gender representation appears balanced, women are significantly underrepresented in shortlists for mid-salary positions (DIR = 0.786), non-binary individuals are selected at less than one-third the rate of men, and candidates over 55 are entirely absent. The audit further uncovers process-level biases invisible to model-centric evaluations and highlights critical information asymmetries between vendors and deploying institutions.