Independent Component Analysis by Robust Distance Correlation

2025-05-14

AI Summary

Traditional Independent Component Analysis (ICA) is highly sensitive to outliers and lacks robustness. To address this, we propose Robust ICA (RICA), a novel sequential source separation method that minimizes outlier-robust distance correlation (dCor) regularized by the Bowl Transform. RICA preserves the critical equivalence “zero dCor ⇔ statistical independence” while substantially enhancing outlier resistance. This work introduces robust dCor into a sequential ICA framework for the first time, ensuring strong consistency and optimal parametric convergence rates. Theoretical analysis establishes rigorous statistical guarantees, and extensive simulations demonstrate that RICA consistently outperforms state-of-the-art ICA methods in both robustness and separation accuracy. Empirical validation on three real-world tasks—including the cocktail party problem—confirms RICA’s effectiveness and practical utility.

Technology Category

• Machine Learning: Adversarial Learning & Robustness
• Intelligent Robots: State Estimation
• Reasoning under Uncertainty: Sequential Decision Making

Application Category

• Web Mining and Content Analysis: Robustness and generalizability of Web mining methods
• Graph Algorithms and Modeling for the Web: Algorithms and analysis for incomplete, noisy, or partially observed Web-related graphs
• Responsible Web: Algorithmic accountability and transparency on the web

Abstract

Independent component analysis (ICA) is a powerful tool for decomposing a multivariate signal or distribution into fully independent sources, not just uncorrelated ones. Unfortunately, most approaches to ICA are not robust against outliers. Here we propose a robust ICA method called RICA, which estimates the components by minimizing a robust measure of dependence between multivariate random variables. The dependence measure used is the distance correlation (dCor). In order to make it more robust we first apply a new transformation called the bowl transform, which is bounded, one-to-one, continuous, and maps far outliers to points close to the origin. This preserves the crucial property that a zero dCor implies independence. RICA estimates the independent sources sequentially, by looking for the component that has the smallest dCor with the remainder. RICA is strongly consistent and has the usual parametric rate of convergence. Its robustness is investigated by a simulation study, in which it generally outperforms its competitors. The method is illustrated on three applications, including the well-known cocktail party problem.

Problem

• Robust ICA method for outlier-resistant signal decomposition
• Minimizing distance correlation to ensure independent components
• Solving cocktail party problem with improved robustness

Innovation

• Robust ICA using distance correlation (dCor)
• Bowl transform for outlier robustness
• Sequential estimation of independent components