The Anatomy of an ASR Hallucination

📅 2026-09-03
📈 Citations: 0
Influential: 0
📄 PDF
🤖 AI Summary
研究解决了ASR系统产生无关文本的问题,通过分析两个Conformer-Large模型在不同条件下的表现,发现最终编码阶段是关键,其失败导致输出失去音频基础。
📝 Abstract
ASR systems sometimes produce fluent text that is unrelated to the speech they receive. We view these hallucinations as one possible consequence of a broader grounding failure, in which the transcript is no longer adequately guided by the audio. To understand where this failure becomes possible, we study two independently trained Conformer-Large recognizers - one CTC and one RNN-T - under environmental degradation and speaker-background shift. In both models, the final encoder stage emerges as a critical boundary: bypassing the final block causes divergence on nearly every utterance, whereas bypassing middle blocks has little effect. At this same stage, the representations become more compact, text becomes readable by the trained decoder, and grapheme information becomes explicit. Importantly, the intervention produces garbled or repetitive output rather than fluent fabrication. Our result therefore identifies a mechanistic precondition for hallucination - the failure to produce adequately grounded output - not the complete origin of naturally occurring hallucinations. Together, the results reveal a consistent terminal-stage dependency for grounded recognition across two decoder families and multiple distribution shifts.
Problem

Research questions and friction points this paper is trying to address.

ASR
hallucination
grounding failure
Innovation

Methods, ideas, or system contributions that make the work stand out.

ASR hallucination
grounding failure
final encoder stage
environmental degradation
speaker-background shift
🔎 Similar Papers
No similar papers found.
💼 Related Jobs
No related jobs found.
H
Hamees Sayed
Smallest AI
A
Apoorv Singh
Smallest AI
K
Kumar Aman
Fast Code AI
A
Akshat Mandloi
Smallest AI