The Disruption Index Measures Displacement Between a Paper and Its Most Cited Reference

2025-04-07

AI Summary

This study addresses fundamental ambiguities in the Disruption Index (D-index)—including its unclear theoretical foundation, conceptual conflation between absolute and relative innovation, and potential measurement bias. We formally establish, for the first time, that the D-index intrinsically quantifies a paper’s *replacement strength* with respect to its most frequently cited references—thereby capturing the relative, “new-answer-replacing-old-answer” mechanism underlying scientific progress. To substantiate this interpretation, we develop a causal explanatory framework linking the D-index to scientific replacement dynamics, integrating rigorous mathematical modeling, expert validation via structured surveys, and large-scale empirical analysis across 49 million papers (1800–2024) from OpenAlex. As a key contribution, we release the largest publicly available, robustness-validated D-index dataset to date, substantially enhancing the metric’s interpretability and reliability as a benchmark for identifying breakthrough research.

Technology Category

• Knowledge Representation and Reasoning: Action, Change, and Causality
• Reasoning under Uncertainty: Causality
• Data Mining & Knowledge Management: Representing, Reasoning, and Using Provenance, Trust

Application Category

• Web Mining and Content Analysis: Web data provenance, reliability, and authenticity
• Graph Algorithms and Modeling for the Web: Querying, indexing, and retrieval in Web-related graphs
• Security and Privacy: Data transparency and provenance

Abstract

Initially developed to capture technical innovation and later adapted to identify scientific breakthroughs, the Disruption Index (D-index) offers the first quantitative framework for analyzing transformative research. Despite its promise, prior studies have struggled to clarify its theoretical foundations, raising concerns about potential bias. Here, we show that-contrary to the common belief that the D-index measures absolute innovation-it captures relative innovation: a paper's ability to displace its most-cited reference. In this way, the D-index reflects scientific progress as the replacement of older answers with newer ones to the same fundamental question-much like light bulbs replacing candles. We support this insight through mathematical analysis, expert surveys, and large-scale bibliometric evidence. To facilitate replication, validation, and broader use, we release a dataset of D-index values for 49 million journal articles (1800-2024) based on OpenAlex.

Problem

• Clarifies D-index measures relative not absolute innovation
• Addresses theoretical foundations and bias concerns of D-index
• Provides large-scale D-index dataset for 49 million articles

Innovation

• D-index measures relative innovation displacement
• Mathematical analysis validates D-index foundations
• Open dataset for 49 million articles provided