Better Together? A Field Experiment on Human-Algorithm Interaction in Child Protection

📅 2025-02-12
📈 Citations: 1
Influential: 0
📄 PDF
🤖 AI Summary
This study addresses inefficiency and inequity in Child Protective Services (CPS) investigation assignment. We conduct a randomized controlled trial (RCT) with frontline caseworkers to evaluate an algorithm-augmented decision-support system. Our key contribution is the empirical identification of *human–algorithm complementarity*: caseworkers deliberately intensify scrutiny of high-risk children whom the algorithm classifies as low-risk—particularly reducing over-investigation of Black children. Causal inference and counterfactual simulations demonstrate that this collaborative dynamic lowers child abuse–related hospitalizations and reduces child injury rates by 29%. Moreover, caseworkers significantly increase their review of supplementary information prompted by algorithmic alerts. To our knowledge, this is the first field study in public service delivery to rigorously validate human–algorithm complementarity while simultaneously improving operational efficiency, procedural fairness, and substantive child welfare outcomes.

Technology Category

Application Category

📝 Abstract
Algorithm tools have the potential to improve public service efficiency, but our understanding of how experts use algorithms is limited, and concerns about resulting bias are widespread. We randomize access to algorithm support for workers allocating Child Protective Services (CPS) investigations. Access to the algorithm reduced maltreatment-related hospitalizations, especially for disadvantaged groups, while reducing CPS surveillance of Black children. Child injuries fell by 29 percent. Workers improved their scrutiny of complementary information emphasized by the algorithm, and targeted investigations to children at greater risk of harm irrespective of algorithm-predicted risk. Algorithm-only counterfactuals confirm human-algorithm complementarity for both efficiency and equity.
Problem

Research questions and friction points this paper is trying to address.

Evaluating human-algorithm collaboration in child protection decisions
Assessing algorithm impact on equity and maltreatment outcomes
Comparing human-algorithm performance against standalone algorithm predictions
Innovation

Methods, ideas, or system contributions that make the work stand out.

Real-time algorithm support for CPS investigation allocation
Human-algorithm collaboration outperforms standalone algorithm performance
LLM-based analysis of worker notes for risk reallocation insights
🔎 Similar Papers
No similar papers found.
M
Marie-Pascale Grimon
Swedish Institute for Social Research, Stockholm University, Stockholm 10691, Sweden
C
Christopher Mills
Department of Economics, University of Notre Dame, Notre Dame, IN 46556, USA