Dual Co-Train: Cross-Dataset Ultrasound Tongue Segmentation Under Extreme Data Scarcity

📅 2026-08-18
📈 Citations: 0
Influential: 0
📄 PDF
🤖 AI Summary
本文提出了一种基于轻量级UltraUNet的无源域适应框架,通过迭代伪标签精炼、质量控制模块和条件GAN生成目标样式图像来解决超声舌分割中数据稀缺问题。
📝 Abstract
Ultrasound tongue contour segmentation remains challenging under cross-dataset domain shift, where limited annotations, probe variability, and acquisition noise often degrade model generalization. We present a source-free domain adaptation framework for robust ultrasound tongue segmentation built on a lightweight UltraUNet backbone. Starting from a checkpoint pretrained on only five labeled source images, simulating an underfitted constrained source model, the proposed method adapts to a fully-unlabeled target domain by iteratively refining pseudo-labels, filtering unreliable masks with a contour-based quality-control module, and generating target-style synthetic image-mask pairs through a segmentation-guided conditional GAN. The student model is then trained on a mixture of clean pseudo-labeled target images, noisy pseudo-labels with consistency regularization, and synthetic samples, enabling closed-loop adaptation without access to source data. We evaluate the method on 12 source-target transfer pairs across eight ultrasound tongue imaging datasets, and conduct source-size scaling experiments and ablation studies. Across all comparisons, the proposed framework improves segmentation overlap and contour accuracy over the baselines, including supervised ones. These results suggest that task-specific pseudo-label refinement and synthetic target-style augmentation can substantially improve source-free adaptation for ultrasound tongue imaging.
Problem

Research questions and friction points this paper is trying to address.

Ultrasound Tongue Segmentation
Cross-Dataset Domain Shift
Data Scarcity
Innovation

Methods, ideas, or system contributions that make the work stand out.

source-free domain adaptation
pseudo-label refinement
synthetic target-style augmentation
ultrasound tongue segmentation
A
Alisher Myrgyyassov
Department of Biomedical Engineering, Hong Kong Polytechnic University, Hong Kong, China
Zhen Song
Zhen Song
Siemens Corporation, Corporate Technology
Building automationbuilding enegy managmentoptimal controlroboticsoptimization
Bruce Xiao Wang
Bruce Xiao Wang
Department of English and Communication, Hong Kong Polytechnic University
forensic phoneticslikelihood ratiouncertaintystatisticsspeech prosody
Y
Yu Sun
Department of Biomedical Engineering, Hong Kong Polytechnic University, Hong Kong, China
M
Min Ney Wong
Department of Language Science and Technology, Hong Kong Polytechnic University, Hong Kong, China
Yihao Zhou
Yihao Zhou
Pennsylvania State University
HCI
Y
Yongping Zheng
Department of Biomedical Engineering, Research Institute for Smart Ageing, Hong Kong Polytechnic University, Hong Kong, China