🤖 AI Summary
In spatial transcriptomics, existing spatially variable (SV) gene detection methods suffer from reliance on predefined templates and inconsistent sample selection, limiting their ability to uncover complex, unknown spatial patterns and yielding poor interpretability. To address these limitations, we propose the first cross-sample Bayesian nonparametric spatial modeling framework. Our method introduces a novel two-level shrinkage prior and an adaptive nonparametric spatial process, eliminating template dependence and enabling flexible, interpretable spatial pattern discovery. By integrating multi-sample information, it employs Gaussian process modeling coupled with variational inference for computationally efficient inference. Extensive evaluations on simulated and real datasets demonstrate substantial improvements: SV gene detection sensitivity increases by 12–28%, and spatial pattern resolution accuracy is significantly enhanced. Our approach consistently outperforms state-of-the-art methods—including SPARK, Trendsceek, and BayesSpace—across all benchmarks.
📝 Abstract
Spatial transcriptomics has revolutionized tissue analysis by simultaneously mapping gene expression, spatial topography, and histological context across consecutive tissue sections, enabling systematic investigation of spatial heterogeneity. The detection of spatially variable (SV) genes-molecular signatures with position-dependent expression-provides critical insights into disease mechanisms spanning oncology, neurology, and cardiovascular research. Current methodologies, however, confront dual constraints: predominant reliance on predefined spatial pattern templates restricts detection of novel complex spatial architectures, and inconsistent sample selection strategies compromise analytical stability and biological interpretability. To overcome these challenges, we propose a novel Bayesian hierarchical framework incorporating non-parametric spatial modeling and across-sample integration. It takes advantage of the non-parametric technique and develops an adaptive spatial process accommodating complex pattern discovery. A novel cross-sample bi-level shrinkage prior is further introduced for robust multi-sample SV gene detection, facilitating more effective information fusion. An efficient variational inference is developed for posterior inference ensuring computational scalability. This architecture synergistically addresses spatial complexity through adaptive pattern learning while maintaining biological interpretability. Comprehensive simulations and empirical analyzes confirm the improved performance of the proposed method in resolving complex spatial expression patterns compared to existing analytical frameworks.