From "Arbitrary Timberland" To "Skyline Charts": Is Visualization At Risk From The Pollution of Scientific Literature?

2025-10-07

AI Summary

This study reveals the growing misuse of visualization techniques in fraudulent research: while the visualization discipline itself remains free from systemic academic corruption, its concepts and graphical representations are frequently co-opted to obscure low-quality or fabricated findings, proliferating across suspect publications. We propose a tripartite methodological framework integrating scientometric analysis, systematic literature review, and visualization ethics assessment to identify recurrent malpractices—including misleading axes, selective data presentation, and deceptive scaling. Our principal contribution is the first systematic diagnosis of visualization’s “instrumentalization” risk in scholarly misconduct. We further introduce a novel “reverse peer review” mechanism—led by visualization experts—to proactively detect, annotate, and report ethically questionable visual practices. This initiative fosters cross-disciplinary collaboration to safeguard scientific integrity and offers an actionable strategy to prevent the encroachment of academic fraud into the visualization community.

Technology Category

• Data Mining & Knowledge Management: Data Visualization & Summarization
• Computer Vision: Visual Reasoning & Symbolic Representations
• Knowledge Representation and Reasoning: Geometric, Spatial, and Temporal Reasoning

Application Category

• Web Mining and Content Analysis: Web data visualization
• Security and Privacy: Data transparency and provenance
• Responsible Web: Mitigating misinformation and disinformation

Abstract

In this essay, I argue that, while visualization research does not seem to be directly at risk of being corrupted by the current massive wave of polluted research, certain visualization concepts are being used in fraudulent fashions and fields close to ours are being targeted. Worse, the society publishing our work is overwhelmed by thousands of questionable papers that are being, unfortunately, published. As a community, and if we want our research to remain as good as it currently is, I argue that we should all get involved with our variety of skills to help identify and correct the current scientific record. I thus aim to present a few questionable practices that are worth knowing about when reviewing for fields using visualization research, and hopefully will never be useful when reviewing for our main venues. I also argue that our skill set could become particularly relevant in the future and invite scholars of the fields to try to get involved.

Problem

• Visualization concepts are being used fraudulently in research fields
• Scientific societies are overwhelmed by questionable published papers
• Researchers need skills to identify and correct scientific record pollution

Innovation

• Identify questionable scientific practices using skills
• Correct current scientific record collaboratively
• Apply visualization expertise to detect fraud