Algorithmic Hiring and Diversity: Reducing Human-Algorithm Similarity for Better Outcomes

2025-05-20

AI Summary

This paper identifies a critical mechanism behind the decoupling of “shortlist gender balance” and “final hiring diversity” in algorithmic recruitment: even unbiased algorithms can reinforce existing managerial biases—and thus undermine diversity—if their screening criteria closely align with hiring managers’ preferences. To address this, we propose an active “de-similarization” approach to shortlist generation—selecting candidates who meet managerial evaluation criteria yet are systematically overlooked by managers despite comparable qualifications. Leveraging nearly 800,000 tech-sector job applications, we combine causal modeling with counterfactual optimization to evaluate the method. Empirical results demonstrate a statistically significant increase in female hire rates without compromising hiring quality. Our work introduces a scalable, interpretable, and algorithmically embedded paradigm for advancing organizational diversity through deliberate design of recruitment systems.

Technology Category

• Search and Optimization: Algorithm Configuration
• Machine Learning: Ethics, Bias, and Fairness
• Humans and AI: Crowd Sourcing and Human Computation

Application Category

• Responsible Web: Human-perceived consequences of algorithmic deployment on the web
• User Modeling, Personalization and Recommendation: Fairness-aware retrieval and ranking
• Search and Retrieval-Augmented AI: Web learning to rank, online learning, and counterfactual learning for ranking

Abstract

Algorithmic tools are increasingly used in hiring to improve fairness and diversity, often by enforcing constraints such as gender-balanced candidate shortlists. However, we show theoretically and empirically that enforcing equal representation at the shortlist stage does not necessarily translate into more diverse final hires, even when there is no gender bias in the hiring stage. We identify a crucial factor influencing this outcome: the correlation between the algorithm's screening criteria and the human hiring manager's evaluation criteria -- higher correlation leads to lower diversity in final hires. Using a large-scale empirical analysis of nearly 800,000 job applications across multiple technology firms, we find that enforcing equal shortlists yields limited improvements in hire diversity when the algorithmic screening closely mirrors the hiring manager's preferences. We propose a complementary algorithmic approach designed explicitly to diversify shortlists by selecting candidates likely to be overlooked by managers, yet still competitive according to their evaluation criteria. Empirical simulations show that this approach significantly enhances gender diversity in final hires without substantially compromising hire quality. These findings highlight the importance of algorithmic design choices in achieving organizational diversity goals and provide actionable guidance for practitioners implementing fairness-oriented hiring algorithms.

Problem

• Algorithmic hiring fails to ensure diverse final hires despite balanced shortlists
• High correlation between algorithm and human criteria reduces hire diversity
• Proposed approach diversifies shortlists without compromising hire quality

Innovation

• Reduces human-algorithm correlation for diversity
• Selects overlooked yet competitive candidates
• Improves gender diversity without quality loss