Parameter isolation with domain-specific experts for incremental audio classification

๐Ÿ“… 2026-09-13
๐Ÿ“ˆ Citations: 0
โœจ Influential: 0
๐Ÿ“„ PDF
๐Ÿค– AI Summary
ๆœฌๆ–‡ๆๅ‡บไบ†ไธ€็ง้ข†ๅŸŸ็‰นๅฎšๅ‚ๆ•ฐ้š”็ฆปๆžถๆž„๏ผŒ้€š่ฟ‡ๅ…จ้˜ถ้€’ๅฝ’ๆ›ดๆ–ฐๅ’Œๆ— ๆ•ฐๆฎ็”Ÿๆˆ้‡ๆ”พๆฅ่งฃๅ†ณ่ทจ้ข†ๅŸŸๅขž้‡ๅญฆไน ไธญ็š„็พ้šพๆ€ง้—ๅฟ˜้—ฎ้ข˜ใ€‚
๐Ÿ“ Abstract
To successfully deploy a model in time-varying environments such as streaming data prediction and sensing control, domain-incremental learning (DIL) has attracted attention since it aims to adapt a previously trained model to newly arriving domains, while reserving knowledge from earlier domains without accessing their data. Incremental learning across domains can be regarded as a recurrent update, in which the current model is obtained by updating the model carried over from previous domains. Conventional DIL approaches that rely on domain-invariant feature learning and weight regularization gradually overwrite or constrain parameters learned in previous domains, leading to catastrophic forgetting. Instead, this paper proposes a new domain-specific parameter-isolation architecture that retains all past domains. The proposed architecture mitigates catastrophic forgetting through a full-order recurrent update, constructing a new expert using domain-specific data conditioned on all previously frozen models. To achieve this, we incorporate data-free generative replay to reconstruct previous-domain data and cross-domain feature generation to recover later expert features missing from earlier domain samples. Finally, we apply the proposed model architecture to domain-agnostic incremental learning for audio classification, as defined in the DCASE 2026 Challenge Task 7. Consequently, we achieve micro and macro accuracies of 78.4% and 78.9%, respectively, representing increases of 33 and 25 percentage points over the Challenge baseline. Ablation studies are conducted to examine the effectiveness of each processing component in terms of classification accuracy.
Problem

Research questions and friction points this paper is trying to address.

domain-incremental learning
catastrophic forgetting
parameter isolation
audio classification
incremental learning
Innovation

Methods, ideas, or system contributions that make the work stand out.

domain-specific parameter-isolation
full-order recurrent update
data-free generative replay
cross-domain feature generation
๐Ÿ”Ž Similar Papers
No similar papers found.
J
Jongyeon Park
Dept. of AI Convergence, Gwangju Institute of Science and Technology (GIST), Gwangju, Korea
D
Do-Hyeon Lim
Dept. of AI Convergence, Gwangju Institute of Science and Technology (GIST), Gwangju, Korea
S
Sang-won Park
Dept. of EECS, Gwangju Institute of Science and Technology (GIST), Gwangju, Korea
H
Hong Kook Kim
Dept. of AI Convergence, Dept. of EECS, Gwangju Institute of Science and Technology (GIST), Gwangju, Korea; AunionAI Co., Ltd., Gwangju, Korea
K
Kyungdeuk Ko
AI Lab., R&D Center, Hanwha Vision, Seongnam, Korea
H
Hyeongcheol Geum
AI Lab., R&D Center, Hanwha Vision, Seongnam, Korea
J
Jeong Eun Lim
AI Lab., R&D Center, Hanwha Vision, Seongnam, Korea