🤖 AI Summary
Audio super-resolution and bandwidth extension are highly ill-posed due to the absence of high-frequency information, making high-fidelity audio reconstruction challenging. This work provides a systematic review of the field’s technical evolution and establishes, for the first time, a structured taxonomy spanning discriminative mapping to generative modeling—including autoregressive models, VAEs, GANs, diffusion models, flow-based methods, and Schrödinger bridge approaches. It critically examines trade-offs in representation domains, architectural designs, and conditioning mechanisms, clarifying the fundamental balance among reconstruction fidelity, perceptual quality, robustness, and computational efficiency. The study identifies key challenges such as phase modeling and generalization to real-world scenarios, and prospectively discusses the potential of integrating large language models and multimodal foundation models, offering a comprehensive roadmap for future research.
📝 Abstract
Audio super-resolution (SR), also referred to as bandwidth extension (BWE), aims to reconstruct high-fidelity signals from low-resolution (LR) or band-limited (BL) observations, an inherently ill-posed task due to the ambiguity of missing high-frequency (HF) content. This survey provides a comprehensive overview of the field, with a particular focus on the paradigm shift from discriminative mapping to modern generative modeling. We first review early discriminative deep neural network (DNN) models, which formulate BWE/SR as a deterministic mapping problem and are prone to regression-to-the-mean effects and spectral over-smoothing. We then systematically review generative approaches, including autoregressive (AR) models, variational autoencoders (VAEs), generative adversarial networks (GANs), diffusion and score-based models, flow-based methods, and Schrödinger bridges. Across these approaches, we examine key design aspects, including representation domain, architecture, conditioning mechanisms, and trade-offs among reconstruction fidelity, perceptual quality, robustness, and computational efficiency. Furthermore, we discuss emerging directions involving large language models (LLMs) and multimodal foundation models, and highlight open challenges in perceptual evaluation, phase modeling, and real-world generalization. By providing a structured taxonomy and unified perspective, this survey establishes a comprehensive foundation and offers a practical roadmap for advancing BWE/SR from deterministic point estimation toward distribution-aware generative modeling.