🤖 AI Summary
Deep stacking of Graph Neural Networks (GNNs) induces over-smoothing—where node representations converge and lose discriminability—particularly hindering long-range dependency modeling on heterogeneous graphs. Existing mitigation strategies lack a unified analytical perspective.
Method: We propose ATNPA (Augment-Transform-Normalize-Propagate-Aggregate), the first holistic analytical framework covering all paradigms. It systematically decomposes three conceptual categories and six mainstream methods, revealing their shared mechanisms and fundamental distinctions at both graph signal processing and message-passing levels.
Contribution/Results: Leveraging spectral analysis and structural decomposition, we establish the first systematic classification and evaluation framework. It precisely delineates applicability boundaries, strengths, and limitations of each method. This provides a reusable theoretical lens and principled design guidelines for robust deep GNNs, enabling informed architectural evolution and cross-paradigm comparison.
📝 Abstract
Oversmoothing is a commonly observed challenge in graph neural network (GNN) learning, where, as layers increase, embedding features learned from GNNs quickly become similar/indistinguishable, making them incapable of differentiating network proximity. A GNN with shallow layer architectures can only learn short-term relation or localized structure information, limiting its power of learning long-term connection, evidenced by their inferior learning performance on heterophilous graphs. Tackling oversmoothing is crucial to harness deep-layer architectures for GNNs. To date, many methods have been proposed to alleviate oversmoothing. The vast difference behind their design principles, combined with graph complications, make it difficult to understand and even compare their difference in tackling the oversmoothing. In this paper, we propose ATNPA, a unified view with five key steps: Augmentation, Transformation, Normalization, Propagation, and Aggregation, to summarize GNN oversmoothing alleviation approaches. We first outline three themes to tackle oversmoothing, and then separate all methods into six categories, followed by detailed reviews of representative methods, including their relation to the ATNPA, and discussion about their niche, strength, and weakness. The review not only draws in-depth understanding of existing methods in the field, but also shows a clear road map for future study.