TFM-Retouche: A Lightweight Input-Space Adapter for Tabular Foundation Models
This work addresses the inflexibility of existing tabular foundation models in adapting to downstream tasks during inference, as conventional fine-tuning or parameter-efficient methods incur substantial computational overhead and rely heavily on internal model architecture. To overcome these limitations, we propose a lightweight, architecture-agnostic input-space residual adapter that operates under a frozen backbone. The adapter learns task-specific input perturbations through end-to-end training and incorporates an identity fallback mechanism, allowing the validation set to automatically determine whether adaptation should be activated—thus balancing performance and robustness. Without modifying any model weights, our approach achieves significant gains on TabArena-Lite, with TabICLv2-Retouche surpassing the baseline by +56 Elo points and attaining a Pareto-optimal trade-off between predictive quality and training/inference efficiency.