🤖 AI Summary
This work addresses the tendency of Laplacian-constrained graphical models—such as the Laplacian-constrained Gaussian graphical model (LCGGM) and the Hüsler–Reiss model—to yield overly dense graphs during structure learning, which compromises interpretability and scalability. The paper introduces, for the first time, spectral graph sparsification as a post-processing step: without requiring additional hyperparameter tuning, it replaces the original Laplacian estimate with a spectrally approximated sparse Laplacian and refits the model. This approach effectively enhances both the sparsity and accuracy of the estimated graph structure. Integrating spectral graph theory, Laplacian-constrained Gaussian graphical models, extreme-value graphical models, and graph sparsification techniques, the method demonstrates superior performance on Erdős–Rényi and stochastic block model simulations and validates its practical utility on real-world data.
📝 Abstract
Graph Laplacians encode graph structures in matrix form, and thus facilitate the application of linear algebra to graph theory. In statistics, two related families of probabilistic graphical models can be parameterized by graph Laplacians. The first one is the Laplacian-constrained Gaussian graphical model (LCGGM), which imposes that the (pseudo-)inverse covariance matrix of a Gaussian random vector is a Laplacian matrix. Applications include graph signal processing and network topology learning. The second one is the Hüsler-Reiss graphical model, which is considered as an extremal analog of the Gaussian graphical model, and can be used in extremal dependence modeling of floods, heatwaves, and financial losses. For both models, the restriction to positive edge weights in the graph Laplacian gives rise to an approach for graph structure learning that does not require tuning parameters. While these approaches yield a strong model fit in many settings, the resulting graph estimates are typically much denser than the underlying ground truth, limiting interpretability and scalability. In order to improve the accuracy of Laplacian-constrained graph learning, we propose to use spectral graph sparsification as a post-estimation operation. To do so, we replace the original Laplacian estimate by a sparser Laplacian that is spectrally close, and re-fit the model on the resulting graph. We refer to the two resulting methods as Spectral-LCGGM and Spectral-HR. We investigate the properties of the proposed estimators and show several theoretical results on their performance. Furthermore, we demonstrate that the newly proposed methods perform well by running simulations on Erdős-Rényi and stochastic block model graphs, and we also showcase their applications to real data.