🤖 AI Summary
This study investigates the systemic mechanisms underlying the spread of online hate content and corresponding intervention strategies. It proposes a two-species coalescence-fragmentation model coupled with SIR dynamics to characterize the formation of hate communities, their cross-platform cluster evolution, and regulatory dismantling processes. The work reveals, for the first time, a reinfection threshold phase transition in hate propagation: excessive suppression of community numbers may paradoxically enhance systemic diffusion, challenging the intuitive policy assumption that more regulation is always better. Combining numerical simulations, effective medium theory (EMT), and multiscale analyses beyond EMT, the study derives an analytical expression for the phase boundary and identifies a precise window for effective intervention, offering both theoretical grounding and policy caution for mitigating online hate content.
📝 Abstract
The 2025 Bondi Beach mass-shooting was perpetrated by individuals inspired by ISIS (Islamic State) propaganda that increasingly featured anti-Semitic hate content following the October 2023 start of the Israel-Palestine war. Similar stories hold for other types of hate attacks, e.g. against Muslims on May 18, 2026. There is an urgent need to get ahead of future threats by understanding how and when a newly created piece of hate content will spread system-wide online. We present a two-species coalescence-fragmentation model with Susceptible-Infected-Recovered dynamics that incorporates the following published empirical features: (1) New pieces of hate content tend to be generated and promoted by a subset of in-built communities on less regulated platforms. (2) These `hate' communities create links (hyperlinks) with each other and with non-hate communities across all platforms to form dynamically evolving clusters (i.e. coalescence) across which new hate content can then spread. (3) These clusters can get broken up by moderator shutdowns (i.e. fragmentation). We present numerical solutions and derive two levels of approximate mean-field theory: Effective Medium Theory (EMT) and Beyond Effective Medium Theory (BEMT). Both numerical and analytic solutions reveal that system-wide spreading is governed by re-entrant threshold phases: as the fraction of hate communities varies, the system can transition from spreading to no-spreading and back to spreading. The derived analytic formulae give explicit insight into how these phase boundaries might be manipulated to prevent system-wide spreading. More broadly, the re-entrant phase behavior warns that policies which steadily reduce the number of hate communities can initially succeed but then backfire if pushed further, suggesting that blanket requirements for platforms to simply do `more' are over-simplistic.