GAP-Prompt: Gated Adaptive Prompting for Efficient Continual Learning

📅 2026-08-24
📈 Citations: 0
Influential: 0
📄 PDF
🤖 AI Summary
该研究提出GAP-Prompt方法,通过实例级自适应提示解决持续学习中的灾难性遗忘问题,实现在多个基准测试中达到最先进的性能。
📝 Abstract
Continual learning faces the persistent challenge of catastrophic forgetting, where sequential task updates degrade previously acquired knowledge. While prompt-based methods integrated with pre-trained models offer a compelling solution by freezing the backbone, they often rely on static, task-level prompting strategies that overlook fine-grained intra-task diversity. In this paper, we propose Gated Adaptive Prompting (GAP-Prompt), a novel method that introduces instance-level adaptability to the prompting process. GAP-Prompt consists of three synergistic modules: (1) instance-conditioned gating, which dynamically determines optimal prompt injection layers for each individual image; (2) dynamic knowledge fusion, which performs instance-aware aggregation of current and historical prompts, enabling knowledge integration across tasks; and (3) shared prompt distillation, which anchors foundational knowledge in early shared layers to mitigate forgetting. Extensive evaluations on CIFAR-100, ImageNet-R, and CUB-200 benchmarks demonstrate that GAP-Prompt consistently achieves state-of-the-art performance. Notably, on the fine-grained CUB-200 dataset, GAP-Prompt reaches 87.29% accuracy, approaching the joint training upper bound (88.00%) and outperforming existing methods by a significant margin.
Problem

Research questions and friction points this paper is trying to address.

catastrophic forgetting
continual learning
prompt-based methods
Innovation

Methods, ideas, or system contributions that make the work stand out.

instance-conditioned gating
dynamic knowledge fusion
shared prompt distillation
🔎 Similar Papers
No similar papers found.
T
Trung-Anh Dang
LIFO UR 4022, Université d’Orléans, INSA CVL, Orléans, 45067, France
D
Duy-Cuong Bui
ETIS, CY Cergy Paris University, ENSEA, CNRS, Cergy, 95000, France
N
Ngoc-Son Vu
LIST3N, Université de Technologie de Troyes, Troyes, 10010, France
C
Christel Vrain
LIFO UR 4022, Université d’Orléans, INSA CVL, Orléans, 45067, France
V
Vincent Nguyen
LIFO UR 4022, Université d’Orléans, INSA CVL, Orléans, 45067, France