π€ AI Summary
This paper addresses the challenge of computing globally optimal solutions for rotation averaging under anisotropic noise modelingβa problem where conventional isotropic assumptions fail. Methodologically, we propose an enhanced compact semidefinite programming (SDP) relaxation over SE(3), grounded in Lie-algebraic formulation and covariance-weighted residuals, and introduce a perturbation-based deflation strategy to significantly improve relaxation tightness and convergence. Theoretically, our approach guarantees certifiably optimal solutions. Empirically, it recovers the global optimum on all standard benchmark datasets; moreover, reconstruction accuracy surpasses state-of-the-art methods in all but one scenario. To our knowledge, this is the first method to achieve verifiably globally optimal rotation averaging under general anisotropic noise.
π Abstract
Rotation averaging is a key subproblem in applications of computer vision and robotics. Many methods for solving this problem exist, and there are also several theoretical results analyzing difficulty and optimality. However, one aspect that most of these have in common is a focus on the isotropic setting, where the intrinsic uncertainties in the measurements are not fully incorporated into the resulting optimization task. Recent empirical results suggest that moving to an anisotropic framework, where these uncertainties are explicitly included, can result in an improvement of solution quality. However, global optimization for rotation averaging has remained a challenge in this scenario. In this paper we show how anisotropic costs can be incorporated in certifiably optimal rotation averaging. We also demonstrate how existing solvers, designed for isotropic situations, fail in the anisotropic setting. Finally, we propose a stronger relaxation and show empirically that it is able to recover global optima in all tested datasets and leads to a more accurate reconstruction in all but one of the scenes.