SGAD: Semantic and Geometric-aware Descriptor for Local Feature Matching
Local feature matching suffers from low regional matching efficiency and heavy reliance on computationally expensive graph optimization. To address this, we propose the Semantic and Geometry-aware Descriptor Network (SGDN), an end-to-end trainable framework for direct region matching. SGDN introduces learnable regional descriptors, jointly supervised by classification and ranking losses, and incorporates a hierarchical containment-based redundancy filtering mechanism to enhance robustness. Geometric constraints are modeled via hierarchical containment graphs—bypassing explicit graph matching computation. Integrated with point-based matchers (e.g., LoFTR, ROMA), SGDN achieves both high accuracy and significant efficiency gains: 60× faster than MESA; outdoor pose estimation accuracy of 65.98 (surpassing DKM); and indoor AUC@5° improved by 7.39%, achieving state-of-the-art performance.