Garbage in Garbage out: Impacts of data quality on criminal network intervention

2025-01-02

AI Summary

This study investigates how information quality affects the effectiveness of network science–driven interventions against covert criminal networks, such as human trafficking rings. We systematically quantify how data incompleteness and low fidelity undermine graph-theoretic and machine learning–based disruption strategies. Methodologically, we integrate classical graph metric analysis, ML-enhanced robustness evaluation, multi-scenario adversarial simulation, and formal data-missingness modeling with sensitivity analysis. Key findings reveal that data loss significantly increases the robustness of decentralized networks; accuracy in identifying critical nodes drops by over 40%; and conventional targeted attacks fail in 90% of cases under 30% edge missingness. We further propose a lightweight heuristic method to improve the interference resilience of centralized networks. These results provide theoretical foundations and practical pathways for building interoperable intelligence ecosystems and advancing novel network inference paradigms.

Technology Category

• Data Mining & Knowledge Management: Graph Mining, Social Network Analysis & Community
• Machine Learning: Adversarial Learning & Robustness
• Computer Vision: Adversarial Attacks & Robustness

Application Category

• Graph Algorithms and Modeling for the Web: Representation, reconstruction, and subgraph or motif discovery in Web-related graphs
• Web Mining and Content Analysis: Robustness and generalizability of Web mining methods
• Social Networks and Social Media: Influence propagation, information diffusion, and the prediction on networks

Abstract

Criminal networks such as human trafficking rings are threats to the rule of law, democracy and public safety in our global society. Network science provides invaluable tools to identify key players and design interventions for Law Enforcement Agencies (LEAs), e.g., to dismantle their organisation. However, poor data quality and the adaptiveness of criminal networks through self-organization make effective disruption extremely challenging. Although there exists a large body of work building and applying network scientific tools to attack criminal networks, these work often implicitly assume that the network measurements are accurate and complete. Moreover, there is thus far no comprehensive understanding of the impacts of data quality on the downstream effectiveness of interventions. This work investigates the relationship between data quality and intervention effectiveness based on classical graph theoretic and machine learning-based approaches. Decentralization emerges as a major factor in network robustness, particularly under conditions of incomplete data, which renders attack strategies largely ineffective. Moreover, the robustness of centralized networks can be boosted using simple heuristics, making targeted attack more infeasible. Consequently, we advocate for a more cautious application of network science in disrupting criminal networks, the continuous development of an interoperable intelligence ecosystem, and the creation of novel network inference techniques to address data quality challenges.

Problem

• Information Quality
• Criminal Network Analysis
• Network Science Methods

Innovation

• Information Quality
• Network Science
• Criminal Networks