Towards Robust Artificial Intelligence: Self-supervised Learning Approach for Out-of-Distribution Detection

2025-10-14

ARES

AI Summary

To address the insufficient robustness of AI systems against out-of-distribution (OOD) samples in safety-critical applications (e.g., autonomous driving, healthcare), this paper proposes a fully unsupervised, self-supervised OOD detection method that requires no labeled data. Our approach innovatively integrates self-supervised representation learning with graph-theoretic structural analysis to model semantic relationships among samples in an unsupervised manner, enabling high-accuracy discrimination of OOD instances. Specifically, it learns discriminative features solely from unlabeled data and identifies OOD samples via graph connectivity metrics derived from the learned representations. Evaluated on standard benchmarks, the method achieves an AUROC of 0.99—substantially surpassing current state-of-the-art unsupervised approaches—and marks the first time near-supervised-level OOD detection performance has been attained under completely label-free conditions. This work establishes a scalable, low-dependency paradigm for robust AI deployment.

Technology Category

• Machine Learning: Unsupervised & Self-Supervised Learning
• Computer Vision: Representation Learning for Vision
• Natural Language Processing: Safety and Robustness

Application Category

• Graph Algorithms and Modeling for the Web: Graph embeddings and representation learning for Web-related graphs
• Semantics and Knowledge: Methods to enhance, augment, integrate or synergize semantic models such as knowledge graphs and LLMs
• Search and Retrieval-Augmented AI: Web learning to rank, online learning, and counterfactual learning for ranking

Abstract

Robustness in AI systems refers to their ability to maintain reliable and accurate performance under various conditions, including out-of-distribution (OOD) samples, adversarial attacks, and environmental changes. This is crucial in safety-critical systems, such as autonomous vehicles, transportation, or healthcare, where malfunctions could have severe consequences. This paper proposes an approach to improve OOD detection without the need of labeled data, thereby increasing the AI systems'robustness. The proposed approach leverages the principles of self-supervised learning, allowing the model to learn useful representations from unlabeled data. Combined with graph-theoretical techniques, this enables the more efficient identification and categorization of OOD samples. Compared to existing state-of-the-art methods, this approach achieved an Area Under the Receiver Operating Characteristic Curve (AUROC) = 0.99.

Problem

• Improving out-of-distribution detection without labeled data
• Enhancing AI robustness using self-supervised learning techniques
• Combining graph methods for efficient OOD sample identification

Innovation

• Self-supervised learning for OOD detection without labels
• Graph-theoretical techniques to identify OOD samples
• Achieved 0.99 AUROC for robust AI performance