Causal Cellular Context Transfer Learning (C3TL): An Efficient Architecture for Prediction of Unseen Perturbation Effects

2026-03-13

AI Summary

This work addresses the challenge of accurately predicting the effects of chemical and genetic perturbations on cellular states in resource-constrained academic or clinical settings where large-scale single-cell data and computational power are limited. The authors propose a lightweight framework that integrates causal transfer learning, biologically informed inductive biases based on invariance principles, and an efficient neural architecture. By leveraging only readily available bulk omics data, the method generalizes effectively to unseen perturbation scenarios. Evaluated across multiple large-scale intervention datasets, it achieves prediction performance comparable to state-of-the-art foundation models while substantially reducing model size, training cost, and data requirements, thereby alleviating dependence on specialized hardware and massive datasets.

Technology Category

• Machine Learning: Causal Learning
• Reasoning under Uncertainty: Causality
• Search and Optimization: Learning to Search

Application Category

• Graph Algorithms and Modeling for the Web: Foundation models and LLMs for Web-related graphs
• Search and Retrieval-Augmented AI: Web learning to rank, online learning, and counterfactual learning for ranking
• Web Mining and Content Analysis: Large pretrained models with web data

Abstract

Predicting the effects of chemical and genetic perturbations on quantitative cell states is a central challenge in computational biology, molecular medicine and drug discovery. Recent work has leveraged large-scale single-cell data and massive foundation models to address this task. However, such computational resources and extensive datasets are not always accessible in academic or clinical settings, hence limiting utility. Here we propose a lightweight framework for perturbation effect prediction that exploits the structured nature of biological interventions and specific inductive biases/invariances. Our approach leverages available information concerning perturbation effects to allow generalization to novel contexts and requires only widely-available bulk molecular data. Extensive testing, comparing predictions of context-specific perturbation effects against real, large-scale interventional experiments, demonstrates accurate prediction in new contexts. The proposed approach is competitive with SOTA foundation models but requires simpler data, much smaller model sizes and less time. Focusing on robust bulk signals and efficient architectures, we show that accurate prediction of perturbation effects is possible without proprietary hardware or very large models, hence opening up ways to leverage causal learning approaches in biomedicine generally.

Problem

• perturbation effect prediction
• computational biology
• single-cell data
• drug discovery
• causal learning

Innovation

• Causal Cellular Context Transfer Learning
• perturbation effect prediction
• bulk molecular data
• lightweight architecture
• inductive bias