π€ AI Summary
Existing AI health coaches suffer from insufficient personalization and lack of evidence-based reliability. Method: We propose the Search-Augmented Predictive Agent (SAPA), a framework integrating personalized time-series forecasting models with retrieval-augmented generation (RAG) to dynamically fuse streaming wearable sensor data and expert-validated, authoritative medical knowledge bases. SAPA employs rolling-origin and grouped cross-validation to ensure generalizability. Results: Personalized models significantly outperform generic baselines; expert blind evaluation confirms clinically meaningful health recommendations (Cliffβs Ξ΄ = 0.3, p = 0.05); and SAPA achieves a quantifiable trade-off between response quality and latency. This work establishes a reproducible methodology and empirical foundation for trustworthy, adaptive, and evidence-based AI health coaching systems.
π Abstract
This paper introduces SePA (Search-enhanced Predictive AI Agent), a novel LLM health coaching system that integrates personalized machine learning and retrieval-augmented generation to deliver adaptive, evidence-based guidance. SePA combines: (1) Individualized models predicting daily stress, soreness, and injury risk from wearable sensor data (28 users, 1260 data points); and (2) A retrieval module that grounds LLM-generated feedback in expert-vetted web content to ensure contextual relevance and reliability. Our predictive models, evaluated with rolling-origin cross-validation and group k-fold cross-validation show that personalized models outperform generalized baselines. In a pilot expert study (n=4), SePA's retrieval-based advice was preferred over a non-retrieval baseline, yielding meaningful practical effect (Cliff's $Ξ΄$=0.3, p=0.05). We also quantify latency performance trade-offs between response quality and speed, offering a transparent blueprint for next-generation, trustworthy personal health informatics systems.