mHC-GNN: Manifold-Constrained Hyper-Connections for Graph Neural Networks
This work addresses the limitations of deep graph neural networks (GNNs), which suffer from over-smoothing and are constrained in expressive power by the 1-Weisfeiler-Lehman (1-WL) test. To overcome these issues, the authors propose a manifold-constrained hyperconnection mechanism that constructs multiple parallel representation streams and employs Sinkhorn–Knopp normalization to constrain the stream mixing matrix to the Birkhoff polytope. This approach effectively mitigates over-smoothing and surpasses the 1-WL expressiveness barrier. Notably, it is the first to integrate manifold-constrained hyperconnections into GNNs, achieving consistent performance gains across ten benchmark datasets and four mainstream GNN architectures. Remarkably, the model maintains over 74% accuracy even at a depth of 128 layers, representing an improvement of more than 50 percentage points over standard GNNs.