Are Large Brainwave Foundation Models Capable Yet? Insights from Fine-tuning

2025-07-01

AI Summary

Large EEG foundation models (LBMs) suffer from high fine-tuning costs and marginal performance gains on BCI tasks such as memory decoding and sleep stage classification. Method: This work introduces Low-Rank Adaptation (LoRA) to EEG foundation modeling for the first time and proposes a multi-component collaborative adaptation strategy to improve parameter efficiency and physiological interpretability. Contribution/Results: Full-parameter fine-tuning yields only +0.9–1.2% accuracy improvement over conventional deep models, despite LBMs having three orders of magnitude more parameters. In contrast, LoRA reduces trainable parameters by >90% with no performance degradation. Ablation studies reveal that current LBM architectures are ill-suited to the time-frequency characteristics of EEG signals, highlighting the need for neurophysiologically grounded architectural redesign. This study provides empirical evidence and methodological guidance for developing efficient, interpretable EEG foundation models.

Technology Category

• Cognitive Modeling & Cognitive Systems: Adaptive Behavior
• Machine Learning: Large Multimodal Models (LMMs)
• Natural Language Processing: (Large) Language Models

Application Category

• Graph Algorithms and Modeling for the Web: Foundation models and LLMs for Web-related graphs
• Semantics and Knowledge: Methods to enhance, augment, integrate or synergize semantic models such as knowledge graphs and LLMs
• Economics, Online Markets and Human Computation: Cost models of using LLMs in production systems

Abstract

Foundation Models have demonstrated significant success across various domains in Artificial Intelligence (AI), yet their capabilities for brainwave modeling remain unclear. In this paper, we comprehensively evaluate current Large Brainwave Foundation Models (LBMs) through systematic fine-tuning experiments across multiple Brain-Computer Interface (BCI) benchmark tasks, including memory tasks and sleep stage classification. Our extensive analysis shows that state-of-the-art LBMs achieve only marginal improvements (0.9%-1.2%) over traditional deep architectures while requiring significantly more parameters (millions vs thousands), raising important questions about their efficiency and applicability in BCI contexts. Moreover, through detailed ablation studies and Low-Rank Adaptation (LoRA), we significantly reduce trainable parameters without performance degradation, while demonstrating that architectural and training inefficiencies limit LBMs' current capabilities. Our experiments span both full model fine-tuning and parameter-efficient adaptation techniques, providing insights into optimal training strategies for BCI applications. We pioneer the application of LoRA to LBMs, revealing that performance benefits generally emerge when adapting multiple neural network components simultaneously. These findings highlight the critical need for domain-specific development strategies to advance LBMs, suggesting that current architectures may require redesign to fully leverage the potential of foundation models in brainwave analysis.

Problem

• Evaluating capabilities of Large Brainwave Foundation Models (LBMs) in BCI tasks
• Assessing efficiency of LBMs compared to traditional deep architectures
• Exploring parameter reduction techniques like LoRA for LBMs in brainwave analysis

Innovation

• Systematic fine-tuning of Large Brainwave Foundation Models
• Low-Rank Adaptation reduces trainable parameters efficiently
• LoRA applied to multiple neural network components