Efficient Online Continual Foundation Model Fine-Tuning for Predictive Process Monitoring

📅 2026-08-28
📈 Citations: 0
Influential: 0
📄 PDF
🤖 AI Summary
本文提出COMPASS框架,通过在线持续微调基础模型解决预测过程监控中的概念漂移问题,优于现有方法。
📝 Abstract
Predictive Process Monitoring (PPM) models are increasingly deployed in dynamic environments where concept drift causes the underlying process distribution to shift over time. While recent work has moved toward online continual learning, existing methods train compact, task-specific networks entirely from scratch, leaving a persistent cold-start problem. Foundation Models (FMs) offer a compelling solution to this problem, but their continual fine-tuning in the process mining domain remains unexplored. We propose COMPASS (Continual Online foundation Model-based PPM with Adaptive SubSpaces), the first framework for online continual fine-tuning of FMs for PPM. COMPASS adapts loss-plateau drift detection to autonomously identify task boundaries in event streams and maintains a unified knowledge subspace including both pre-trained and task-specific directions. We evaluate our approach on nine event streams covering synthetic and real-world concept drift scenarios, across task-free and task-aware settings with multiple backbones and with consistent hyperparameter tuning across all methods. Our approach outperforms three SOTA non-FM competitors and two update strategy baselines, with particularly strong gains on streams exhibiting recurrent drift and complex, long-running cases, while incurring acceptable computational overhead compared to the non-FM competitors.
Problem

Research questions and friction points this paper is trying to address.

Predictive Process Monitoring
concept drift
online continual learning
cold-start problem
Innovation

Methods, ideas, or system contributions that make the work stand out.

Continual Online Learning
Foundation Models
Adaptive SubSpaces
Loss-Plateau Drift Detection
🔎 Similar Papers
No similar papers found.
💼 Related Jobs
No related jobs found.
S
Sjoerd van Straten
Department of Mathematics and Computer Science, Eindhoven University of Technology, The Netherlands
M
Marwan Hassani
Department of Mathematics and Computer Science, Eindhoven University of Technology, The Netherlands; Department of Mathematics and Computer Science, University of Wuppertal, Germany