Faster, Cheaper, More Accurate: Specialised Knowledge Tracing Models Outperform LLMs
This study addresses the challenge of efficiently and accurately predicting student response behavior in educational platforms by conducting the first systematic comparison between specialized Knowledge Tracing (KT) models and large language models (LLMs) on real-world student interaction data. Through quantitative evaluation of prediction accuracy, inference latency, and deployment cost, the research demonstrates that KT models significantly outperform LLMs in both accuracy and F1 score, achieve inference speeds several orders of magnitude faster, and incur substantially lower deployment costs. These findings reveal that, for educational prediction tasks, domain-specific models offer marked advantages over general-purpose large language models in both performance and economic efficiency, thereby providing empirical support and practical guidance for model selection in personalized learning interventions.