Gromov Wasserstein Optimal Transport for Semantic Correspondences
This work proposes an efficient and highly accurate semantic correspondence method that addresses the high computational cost and reliance on multi-model ensembles in existing approaches. By leveraging features extracted from DINOv2, the method introduces a Gromov–Wasserstein optimal transport framework augmented with a spatial smoothness prior to explicitly model geometric consistency. This approach eliminates the need for complex models such as Stable Diffusion while maintaining an end-to-end pipeline. It substantially outperforms the DINOv2 baseline and achieves performance on par with or superior to current state-of-the-art methods that depend on model ensembles, all while offering a 5–10× speedup in inference time.