🤖 AI Summary
Hallucination—generating factually incorrect or fabricated content that appears plausible—severely undermines the reliability and trustworthiness of large language models (LLMs).
Method: This work establishes the first universal theoretical framework for LLM hallucination, formally defining its essence and proving its intrinsic inevitability within computable models. It innovatively distinguishes *intrinsic* from *extrinsic* hallucination and rigorously clarifies the conceptual boundaries between *factual accuracy* and *faithfulness*. A fine-grained taxonomy is developed, covering cross-modal and multi-task scenarios. The analysis integrates theoretical modeling, classification-based formalization, and empirical validation—including data provenance tracing, logical consistency checking, benchmark evaluation, and human-subject experiments.
Contribution/Results: The study systematically uncovers root causes and human perception mechanisms of hallucination. It releases an open-source evaluation benchmark and an online resource platform, providing a unified theoretical foundation and reusable toolset for hallucination detection, mitigation, and governance.
📝 Abstract
Large language models (LLMs) have revolutionized natural language processing, yet their propensity for hallucination, generating plausible but factually incorrect or fabricated content, remains a critical challenge. This report provides a comprehensive taxonomy of LLM hallucinations, beginning with a formal definition and a theoretical framework that posits its inherent inevitability in computable LLMs, irrespective of architecture or training. It explores core distinctions, differentiating between intrinsic (contradicting input context) and extrinsic (inconsistent with training data or reality), as well as factuality (absolute correctness) and faithfulness (adherence to input). The report then details specific manifestations, including factual errors, contextual and logical inconsistencies, temporal disorientation, ethical violations, and task-specific hallucinations across domains like code generation and multimodal applications. It analyzes the underlying causes, categorizing them into data-related issues, model-related factors, and prompt-related influences. Furthermore, the report examines cognitive and human factors influencing hallucination perception, surveys evaluation benchmarks and metrics for detection, and outlines architectural and systemic mitigation strategies. Finally, it introduces web-based resources for monitoring LLM releases and performance. This report underscores the complex, multifaceted nature of LLM hallucinations and emphasizes that, given their theoretical inevitability, future efforts must focus on robust detection, mitigation, and continuous human oversight for responsible and reliable deployment in critical applications.