RT-SEMamba: Real-Time Speech Enhancement Mamba via Progressive Knowledge Distillation
This work addresses the longstanding challenge in real-time speech enhancement of simultaneously achieving high audio quality and low latency. To this end, it introduces Mamba—a state space model—into this domain for the first time, proposing a fully causal architecture built upon causal time-frequency Mamba blocks. To mitigate computational overhead, the authors devise a progressive knowledge distillation strategy that jointly transfers both spectral outputs and intermediate representations from an 8-layer teacher model to a single-layer student model. Evaluated on the Voicebank-DEMAND dataset, the distilled student model achieves a PESQ score of 3.18—improved from 3.06—with only 25 ms of latency and a 2.75× speedup in inference, significantly outperforming current state-of-the-art approaches.