🤖 AI Summary
This study addresses the lack of empirical evaluation regarding the systematic advantages of accelerometer-based foundation models in health monitoring tasks. For the first time, it comprehensively benchmarks four open-source foundation models across 19 diverse tasks spanning daily activity recognition, clinical monitoring, and physiological inference. Employing linear probing, frozen feature extraction, and concept discovery analyses, the work systematically assesses model generalization and robustness. Results demonstrate that foundation models—such as UniMTS—significantly outperform supervised baselines in scenarios including fall detection, stress recognition, and varying sensor placements, often surpassing them even without fine-tuning. However, their performance remains limited in sleep staging and sedentary activity classification. The study further proposes a novel direction for continuous inference based on activity profiling and offers practical recommendations for context-aware deployment.
📝 Abstract
Foundation models (FMs) trained on large-scale accelerometer data have been proposed as general-purpose feature extractors for health monitoring, but systematic evidence of their advantages is lacking. We present the first comprehensive evaluation of four open-source accelerometer FMs against supervised baselines covering 19 tasks across the domains of activity recognition including activities of daily living, clinical monitoring, and physiological inference. We find task-dependent performance results: supervised models remain competitive with FMs on human action recognition (HAR), with no consistent advantage for either, while selected FMs lead on fall and stress detection and are the most robust to sensor-placement variation. As frozen feature extractors, FMs are strongest for demographic inference, whereas sleep staging performance remains near chance level for all models. The internal FM representations show strong similarity across layers, highlighting potential for future FM improvements. Linear and frozen probing reveals that UniMTS provides the strongest representations and is the only FM that surpasses the supervised baselines without finetuning. Concept discovery analysis shows all models capture high-intensity activities clearly but struggle with sedentary, complex or ambiguous activities. We provide scenario-based deployment recommendations. Furthermore, we identify FM-derived activity profile inference-moving beyond fixed category classification-as a promising research direction.