Rethinking Semi-Supervised Imbalanced Node Classification from Bias-Variance Decomposition

πŸ“… 2023-10-28
πŸ›οΈ Neural Information Processing Systems
πŸ“ˆ Citations: 6
✨ Influential: 0
πŸ“„ PDF
πŸ€– AI Summary
This work addresses class imbalance in semi-supervised node classification with graph neural networks (GNNs). For the first time, it introduces bias-variance decomposition theory into graph learning, theoretically revealing that class imbalance predominantly inflates model varianceβ€”not bias. Building on this insight, we propose a variance-aware, theory-driven framework: (i) estimating node-level variance via graph-structure-augmented propagation, and (ii) imposing an explicit, differentiable variance regularization term during training. Unlike existing approaches, our method avoids heuristic resampling or cost-sensitive loss design, ensuring both theoretical consistency and implementation simplicity. Extensive experiments on multiple naturally occurring and synthetically imbalanced graph benchmarks demonstrate consistent and significant improvements over state-of-the-art methods, validating its generalization robustness and effectiveness.
πŸ“ Abstract
This paper introduces a new approach to address the issue of class imbalance in graph neural networks (GNNs) for learning on graph-structured data. Our approach integrates imbalanced node classification and Bias-Variance Decomposition, establishing a theoretical framework that closely relates data imbalance to model variance. We also leverage graph augmentation technique to estimate the variance, and design a regularization term to alleviate the impact of imbalance. Exhaustive tests are conducted on multiple benchmarks, including naturally imbalanced datasets and public-split class-imbalanced datasets, demonstrating that our approach outperforms state-of-the-art methods in various imbalanced scenarios. This work provides a novel theoretical perspective for addressing the problem of imbalanced node classification in GNNs.
Problem

Research questions and friction points this paper is trying to address.

Address class imbalance in GNNs
Integrate Bias-Variance Decomposition
Enhance imbalanced node classification
Innovation

Methods, ideas, or system contributions that make the work stand out.

Integrates Bias-Variance Decomposition
Uses graph augmentation technique
Designs regularization for imbalance
πŸ”Ž Similar Papers
No similar papers found.
D
Divin Yan
Fudan University
G
Gengchen Wei
Fudan University
C
Chen Yang
Fudan University
S
Shengzhong Zhang
Fudan University
Zengfeng Huang
Zengfeng Huang
Fudan University
AlgorithmsGraphsStreamingLearningTheory