GenFAR: A generalized representation of brain structure, derived from 49,246 multi-cohort MRIs via deep learning

📅 2026-08-12
📈 Citations: 0
Influential: 0
📄 PDF
🤖 AI Summary
This study addresses the limitation of existing deep learning models in neuroimaging, which are typically confined to single tasks and struggle with cross-task knowledge transfer. To overcome this, the authors propose GenFAR, a modular deep learning framework trained jointly on 17 cognitive, clinical, and diagnostic tasks using brain MRI data from 49,246 individuals across 11 cohorts. The framework leverages an innovative task-sequencing mechanism and a novel Donor Score metric to identify five pivotal source tasks that substantially enhance sample efficiency and performance on downstream tasks. The resulting general-purpose brain representations demonstrate strong clinical relevance, significantly improving model accuracy on unseen tasks while markedly reducing the required training sample size.
📝 Abstract
Deep learning models for neuroimaging have largely been developed for individual tasks, limiting knowledge transfer across applications. Here we introduce GenFAR, a modular deep learning framework that learns general, clinically informed features from brain MRIs. We trained this modular architecture on 49,246 individuals across 11 cohorts, using 17 diverse classification and regression tasks spanning cognition, clinical, diagnosis, demographics, and biomarkers. This yields aggregated, focused feature sets that capture rich, clinically- and biologically-relevant brain representations. We developed a sequential learning approach where tasks progressively build on previously learned representations. Through an analysis of 5,000 task sequences, we identified an optimal sequence length of six tasks and introduced a Donor Score metric to quantify each task's contribution to downstream performance. This analysis revealed five consistently strong donor tasks (Age, AD/MCI, MMSE, Hypertension, Hyperlipidemia) that formed the base of our sequential model. We demonstrated the utility of our learned representation, in various tasks beyond those included in the training set, to serve as the foundation for specialized secondary predictors. We further showed that using the learned feature representation can substantially increase the sample efficiency of secondary deep learning training tasks and models, as well as improve their accuracy.
Problem

Research questions and friction points this paper is trying to address.

deep learning
neuroimaging
knowledge transfer
brain representation
multi-task learning
Innovation

Methods, ideas, or system contributions that make the work stand out.

GenFAR
modular deep learning
sequential task learning
Donor Score
generalized brain representation
🔎 Similar Papers
V
Vishnu M. Bashyam
Artificial Intelligence in Biomedical Imaging Lab, University of Pennsylvania
G
Guray Erus
Artificial Intelligence in Biomedical Imaging Lab, University of Pennsylvania
J
Junhao Wen
Artificial Intelligence in Biomedical Imaging Lab, University of Pennsylvania
Pratik Chaudhari
Pratik Chaudhari
University of Pennsylvania
Deep LearningMachine LearningRobotics
R
Randa Melhem
Artificial Intelligence in Biomedical Imaging Lab, University of Pennsylvania
S
Sindhuja Govindarajan Tirumalai
Artificial Intelligence in Biomedical Imaging Lab, University of Pennsylvania
G
Gareth Harman
Artificial Intelligence in Biomedical Imaging Lab, University of Pennsylvania
Yong Fan
Yong Fan
Professor at the University of Pennsylvania
Biomedical Data AnalysisImage SegmentationImage RegistrationImage AnalysisMachine Learning
C
Colin L. Masters
Florey Institute of Neuroscience and Mental Health, University of Melbourne
Paul Maruff
Paul Maruff
Florey Institute of Neuroscience and Mental Health, University of Melbourne
Sterling C. Johnson
Sterling C. Johnson
Wisconsin Alzheimer’s Institute, University of Wisconsin School of Medicine and Public Health
Jurgen Fripp
Jurgen Fripp
CSIRO Health and Biosecurity, Australian e-Health Research Centre CSIRO
D
Duygu Tosun
Department of Radiology and Biomedical Imaging, University of California, San Francisco
J
John C. Morris
Department of Neurology, Washington University in St. Louis
D
Daniel S. Marcus
Department of Radiology, Washington University in St. Louis
P
Pamela LaMontagne
Department of Radiology, Washington University in St. Louis
T
Tammie Benzinger
Department of Radiology, Washington University in St. Louis
S
Susan R. Heckbert
Cardiovascular Health Research Unit and Department of Epidemiology, University of Washington
M
Mark Espeland
Department of Biostatistics and Data Science, Wake Forest School of Medicine
M
Marilyn S. Albert
Department of Neurology, Johns Hopkins University School of Medicine
A
Andrew J. Saykin
Indiana Alzheimer’s Disease Research Center, Indiana University
P
Paul M. Thompson
Imaging Genetics Center, Mark and Mary Stevens Neuroimaging and Informatics Institute, Keck School of Medicine, University of Southern California
T
Timothy J. Hohman
Vanderbilt Memory and Alzheimer’s Center, Vanderbilt University School of Medicine
S
Susan M. Resnick
Laboratory of Behavioral Neuroscience, National Institute on Aging
R
R. Nick Bryan
Department of Diagnostic Medicine, University of Texas at Austin