Improving Out-of-Distribution Detection via Dynamic Covariance Calibration

2025-06-11

AI Summary

To address geometric distortion in out-of-distribution (OOD) detection caused by static covariance priors under imbalanced training data distributions, this paper proposes a direction-aware dynamic covariance calibration mechanism. Operating in the residual feature space, it adaptively refines the prior covariance structure conditioned on input features, jointly correcting geometric deformations while preserving stability in the principal component subspace. Methodologically, we integrate information-geometric modeling, directional feature projection, and residual-constrained optimization—enabling plug-and-play adaptation across diverse pre-trained models (e.g., DINO). Extensive experiments on CIFAR and ImageNet-1k benchmarks demonstrate significant improvements in OOD detection performance over state-of-the-art methods. The implementation is publicly available.

Technology Category

• Machine Learning: Calibration & Uncertainty Quantification
• Computer Vision: Adversarial Attacks & Robustness
• Data Mining & Knowledge Management: Anomaly/Outlier Detection

Application Category

• Graph Algorithms and Modeling for the Web: Efficient manipulation of static and dynamic Web-related graphs
• User Modeling, Personalization and Recommendation: On-Device user modeling, personalization, and recommendation
• Web Mining and Content Analysis: Large pretrained models with web data

Abstract

Out-of-Distribution (OOD) detection is essential for the trustworthiness of AI systems. Methods using prior information (i.e., subspace-based methods) have shown effective performance by extracting information geometry to detect OOD data with a more appropriate distance metric. However, these methods fail to address the geometry distorted by ill-distributed samples, due to the limitation of statically extracting information geometry from the training distribution. In this paper, we argue that the influence of ill-distributed samples can be corrected by dynamically adjusting the prior geometry in response to new data. Based on this insight, we propose a novel approach that dynamically updates the prior covariance matrix using real-time input features, refining its information. Specifically, we reduce the covariance along the direction of real-time input features and constrain adjustments to the residual space, thus preserving essential data characteristics and avoiding effects on unintended directions in the principal space. We evaluate our method on two pre-trained models for the CIFAR dataset and five pre-trained models for ImageNet-1k, including the self-supervised DINO model. Extensive experiments demonstrate that our approach significantly enhances OOD detection across various models. The code is released at https://github.com/workerbcd/ooddcc.

Problem

• Correcting distorted geometry from ill-distributed samples in OOD detection
• Dynamically adjusting prior covariance matrix for better OOD detection
• Enhancing OOD detection across various pre-trained models

Innovation

• Dynamic covariance matrix updates for OOD detection
• Adjusts prior geometry using real-time input features
• Preserves essential data characteristics via residual space