Bridging Prediction and Intervention Problems in Social Systems

2025-07-07

AI Summary

Automated Decision Systems (ADS) have long been confined to predictive paradigms, limiting their capacity to meaningfully intervene in complex socio-technical problems. Method: We propose an intervention-centered ADS design paradigm, grounded in a unified problem formulation framework that integrates causal inference, statistical estimation, and policy evaluation techniques to model the full causal chain—from prediction to decision to outcome. Contribution/Results: First, we establish a theoretical bridge from prediction to intervention, exposing the societal utility bottleneck of isolated predictive tasks. Second, we formalize intervention-oriented evaluation criteria and design principles for ADS. Third, we provide a methodological foundation enabling ADS deployment with enhanced fairness, interpretability, and real-world policy impact—shifting ADS from merely describing reality toward actively shaping improved outcomes. This paradigm advances the operationalization of responsible, socially impactful algorithmic decision-making.

Technology Category

• Multiagent Systems: Adversarial Agents
• Game Theory and Economic Paradigms: Adversarial Learning
• Humans and AI: Planning and Decision Support for Human-Machine Teams

Application Category

• Responsible Web: Human-perceived consequences of algorithmic deployment on the web
• User Modeling, Personalization and Recommendation: Fairness-aware retrieval and ranking
• Search and Retrieval-Augmented AI: Web learning to rank, online learning, and counterfactual learning for ranking

Abstract

Many automated decision systems (ADS) are designed to solve prediction problems -- where the goal is to learn patterns from a sample of the population and apply them to individuals from the same population. In reality, these prediction systems operationalize holistic policy interventions in deployment. Once deployed, ADS can shape impacted population outcomes through an effective policy change in how decision-makers operate, while also being defined by past and present interactions between stakeholders and the limitations of existing organizational, as well as societal, infrastructure and context. In this work, we consider the ways in which we must shift from a prediction-focused paradigm to an interventionist paradigm when considering the impact of ADS within social systems. We argue this requires a new default problem setup for ADS beyond prediction, to instead consider predictions as decision support, final decisions, and outcomes. We highlight how this perspective unifies modern statistical frameworks and other tools to study the design, implementation, and evaluation of ADS systems, and point to the research directions necessary to operationalize this paradigm shift. Using these tools, we characterize the limitations of focusing on isolated prediction tasks, and lay the foundation for a more intervention-oriented approach to developing and deploying ADS.

Problem

• Shift from prediction to intervention in automated decision systems
• Unify statistical frameworks for ADS design and evaluation
• Address limitations of isolated prediction tasks in social systems

Innovation

• Shift from prediction to intervention paradigm
• Unify statistical frameworks for ADS design
• Focus on decision support and outcomes