Volume-Wise Task fMRI Decoding with Deep Learning:Enhancing Temporal Resolution and Cognitive Function Analysis

2025-03-02

AI Summary

Traditional task-based fMRI (tfMRI) decoding relies on block-design analysis, yielding temporal resolution on the order of seconds—insufficient to capture the dynamic nature of cognitive processes. To address this limitation, we propose the first end-to-end deep learning framework for single-volume (~0.7–1 s) tfMRI decoding, integrating convolutional and recurrent neural networks to enable real-time, voxel-wise task-state classification. Our method leverages the Human Connectome Project (HCP) multi-task dataset, incorporating standardized preprocessing, temporal feature modeling, and fine-grained classification, augmented by interpretability-driven visualizations to reveal spatiotemporal brain activation dynamics. Evaluated on motor and gambling tasks, it achieves mean classification accuracies of 94.0% and 79.6%, respectively. This advances temporal resolution by over an order of magnitude and significantly improves the fidelity of cognitive mechanism inference, catalyzing a paradigm shift in fMRI decoding—from block-level to frame-level analysis.

Technology Category

• Cognitive Modeling & Cognitive Systems: Neural Spike Coding
• Machine Learning: Multimodal Learning
• Computer Vision: Multi-modal Vision

Application Category

• Responsible Web: Machine-in-the-loop, human agency and autonomy
• Search and Retrieval-Augmented AI: Web learning to rank, online learning, and counterfactual learning for ranking
• User Modeling, Personalization and Recommendation: Fairness-aware retrieval and ranking

Abstract

In recent years,the application of deep learning in task functional Magnetic Resonance Imaging (tfMRI) decoding has led to significant advancements. However,most studies remain constrained by assumption of temporal stationarity in neural activity,resulting in predominantly block-wise analysis with limited temporal resolution on the order of tens of seconds. This limitation restricts the ability to decode cognitive functions in detail. To address these limitations, this study proposes a deep neural network designed for volume-wise identification of task states within tfMRI data,thereby overcoming the constraints of conventional methods. Evaluated on Human Connectome Project (HCP) motor and gambling tfMRI datasets,the model achieved impressive mean accuracy rates of 94.0% and 79.6%,respectively. These results demonstrate a substantial enhancement in temporal resolution,enabling more detailed exploration of cognitive processes. The study further employs visualization algorithms to investigate dynamic brain mappings during different tasks,marking a significant step forward in deep learning-based frame-level tfMRI decoding. This approach offers new methodologies and tools for examining dynamic changes in brain activities and understanding the underlying cognitive mechanisms.

Problem

• Enhance temporal resolution in task fMRI decoding.
• Overcome temporal stationarity assumptions in neural activity analysis.
• Enable detailed exploration of cognitive processes using deep learning.

Innovation

• Deep neural network for volume-wise tfMRI decoding
• Enhanced temporal resolution in cognitive analysis
• Visualization algorithms for dynamic brain mapping