Predicting Parkinson's disease trajectory using clinical and functional MRI features: a reproduction and replication study

📅 2024-02-20
🏛️ arXiv.org
📈 Citations: 0
Influential: 0
📄 PDF
🤖 AI Summary
This study addresses the challenge of individualized prediction of Parkinson’s disease (PD) progression trajectories, evaluating the robustness and reproducibility of resting-state fMRI functional biomarkers—specifically fractional amplitude of low-frequency fluctuations (fALFF) and regional homogeneity (ReHo). Method: Leveraging the Parkinson’s Progression Markers Initiative (PPMI) dataset, we systematically reproduced and extended prior models by integrating demographic, clinical scale, and multimodal fMRI features. Support vector regression (SVR) and random forest regressors were employed for cross-sectional status and longitudinal progression prediction. A rigorous reproducibility assessment framework was established across preprocessing pipelines and independent datasets. Contribution/Results: This is the first end-to-end, rigorously controlled replication study of neuroimaging biomarkers in PD. We demonstrate that data processing choices critically impact model robustness; under optimal reproduction conditions, significant predictive performance was achieved (R² > 0), confirming the reliable prognostic utility of fMRI functional features. We further propose practical guidelines to enhance reproducibility in neuroimaging research.

Technology Category

Application Category

📝 Abstract
Parkinson's disease (PD) is a common neurodegenerative disorder with a poorly understood physiopathology and no established biomarkers for the diagnosis of early stages and for prediction of disease progression. Several neuroimaging biomarkers have been studied recently, but these are susceptible to several sources of variability related for instance to cohort selection or image analysis. In this context, an evaluation of the robustness of such biomarkers to variations in the data processing workflow is essential. This study is part of a larger project investigating the replicability of potential neuroimaging biomarkers of PD. Here, we attempt to reproduce (re-implementing the experiments with the same data, same method) and replicate (different data and/or method) the models described in [1] to predict individual's PD current state and progression using demographic, clinical and neuroimaging features (fALFF and ReHo extracted from resting-state fMRI). We use the Parkinson's Progression Markers Initiative dataset (PPMI, ppmi-info.org), as in [1] and aim to reproduce the original cohort, imaging features and machine learning models as closely as possible using the information available in the paper and the code. We also investigated methodological variations in cohort selection, feature extraction pipelines and sets of input features. Different criteria were used to evaluate the reproduction and compare the reproduced results with the original ones. Notably, we obtained significantly better than chance performance using the analysis pipeline closest to that in the original study (R2 > 0), which is consistent with its findings. Moreover, using derived data provided by the authors of the original study, we were able to make an exact reproduction and managed to obtain results that were close to the original ones. The challenges encountered while reproducing and replicating the original work are likely explained by the complexity of neuroimaging studies, in particular in clinical settings. We provide recommendations to further facilitate the reproducibility of such studies in the future.
Problem

Research questions and friction points this paper is trying to address.

Evaluate robustness of neuroimaging biomarkers for Parkinson's disease.
Reproduce and replicate models predicting Parkinson's disease progression.
Assess impact of methodological variations on biomarker reliability.
Innovation

Methods, ideas, or system contributions that make the work stand out.

Reproduced neuroimaging biomarkers for PD
Replicated machine learning models
Evaluated methodological variations in PD studies
🔎 Similar Papers
No similar papers found.
Elodie Germani
Elodie Germani
Universitätsklinikum Bonn
NeuroimagingfMRImachine learningreproducibilitystatistics
N
Nikhil Baghwat
Department of Neurology and Neurosurgery, McGill University, Montreal, Canada
M
Mathieu Dugr'é
Department of Computer Science and Software Engineering, Concordia University, Montreal, Canada
R
Rémi Gau
Department of Neurology and Neurosurgery, McGill University, Montreal, Canada
A
A. Montillo
Lyda Hill Department of Bioinformatics, University of Texas Southwestern Medical Center, Dallas, USA
K
Kevin Nguyen
Lyda Hill Department of Bioinformatics, University of Texas Southwestern Medical Center, Dallas, USA
A
Andrzej Sokołowski
Department of Computer Science and Software Engineering, Concordia University, Montreal, Canada
M
Madeleine Sharp
Department of Neurology and Neurosurgery, McGill University, Montreal, Canada
J
J. Poline
Department of Neurology and Neurosurgery, McGill University, Montreal, Canada
Tristan Glatard
Tristan Glatard
Centre for Addiction and Mental Health (CAMH)
Neuroinformatics