🤖 AI Summary
Addressing the challenge of jointly performing variable clustering and network inference in high-dimensional Gaussian graphical models, this paper proposes Normal-Block: a method that jointly infers inter-cluster association networks atop a variable clustering structure. It introduces a unified framework for simultaneous clustering and graph structure learning, incorporating a zero-inflated normal mixture model to capture inherent sparsity in real-world data, and develops a penalized variational EM algorithm for end-to-end optimization. To ensure both sparsity and statistical consistency, it adopts a two-level Graphical Lasso penalty. The method is implemented as an open-source R package, *normalblockr*. Extensive evaluations on synthetic data and multiple real-world datasets—including proteomics, web text frequencies, and microbiome abundance—demonstrate substantial improvements in clustering accuracy, significant reduction in network false positives, and enhanced interpretability through cluster-level network representations.
📝 Abstract
We consider high dimensional Gaussian graphical models inference. These models provide a rigorous framework to describe a network of statistical dependencies between entities, such as genes in genomic regulation studies or species in ecology. Penalized methods, including the standard Graphical-Lasso, are well-known approaches to infer the parameters of these models. As the number of variables in the model (of entities in the network) grow, the network inference and interpretation become more complex. We propose Normal-Block, a new model that clusters variables and consider a network at the cluster level. Normal-Block both adds structure to the network and reduces its size. We build on Graphical-Lasso to add a penalty on the network's edges and limit the detection of spurious dependencies, we also propose a zero-inflated version of the model to account for real-world data properties. For the inference procedure, we propose a direct heuristic method and another more rigorous one that simultaneously infers the clustering of variables and the association network between clusters, using a penalized variational Expectation-Maximization approach. An implementation of the model in R, in a package called normalblockr, is available on github (https://github.com/jeannetous/normalblockr). We present the results in terms of clustering and network inference using both simulated data and various types of real-world data (proteomics, words occurrences on webpages, and microbiota distribution).