SHIFT-M3: Pre-fusion Alignment-based Consistency Screening for Multimodal ECG Record Integrity

📅 2026-09-12
📈 Citations: 0
Influential: 0
📄 PDF
🤖 AI Summary
研究通过SHIFT-M3方法,利用文本预融合对齐一致性筛查解决多模态心电图记录完整性问题,以确保记录各部分属于同一患者。
📝 Abstract
Multimodal clinical AI typically assumes that the waveform, report, metadata, and downstream predictions attached to a record belong to the same patient. In practice, linkage failures can silently assemble individually plausible but cross-patient components, creating a safety problem that standard predictive models are not designed to detect. We study this problem as multimodal record integrity triage: given an assembled record, should its modalities be trusted to belong together? We introduce SHIFT-M3, a lightweight text-based pre-fusion screen that measures alignment-based consistency between two separately produced ECG text views: an LLM-generated interpretation and a clinical report summary. On 784,680 MEETI ECG records, SHIFT-M3 achieves 97.6% TPR@5% FPR for full text-view swaps (AUROC 0.996), 90.3% for partial swaps (AUROC 0.974), and 97.7% for label-matched hard negatives (AUROC 0.996) with only 573,569 parameters. Compared with same-dataset lexical baselines, the gains are largest on partial swaps and hard negatives, suggesting that the model is learning more than surface overlap. We also introduce the CMST (Conflict-type Multimodal Stress Test) evaluation taxonomy, a three-seed stability study, a loss ablation, a temporal-tolerance sweep, and a shared-token masking control. The main remaining failure mode is longitudinal ambiguity: at the default operating point, same-patient cross-visit pairs still produce 87.0% Type-II false positives.
Problem

Research questions and friction points this paper is trying to address.

Multimodal Record Integrity
ECG
Linkage Failures
Consistency Screening
Cross-patient Components
Innovation

Methods, ideas, or system contributions that make the work stand out.

pre-fusion alignment
multimodal ECG record integrity
consistency screening
LLM-generated interpretation
clinical report summary
💼 Related Jobs
No related jobs found.
M
Md Ashik Khan
Department of Computer Science and Engineering, Indian Institute of Technology Kharagpur, Kharagpur, India
M
Md Nahid Siddique
Knight Foundation School of Computing and Information Sciences, Florida International University, Miami, FL, USA