Semi-Supervised Adaptation of Vision-Language Models for Image Classification

📅 2026-08-26
📈 Citations: 0
Influential: 0
📄 PDF
🤖 AI Summary
为解决卫星图像分类中注释样本稀缺的问题,提出SE-CLIP框架,通过半监督方式迭代挖掘高置信度样本,提高模型性能。
📝 Abstract
Vision-language models like CLIP have shown sig- nificant potential in handling natural images, yet their perfor- mance is often limited by the distinct characteristics of satellite imagery. While parameter-efficient adaptation techniques exist, their efficacy is frequently limited by the scarcity of annotated samples. In this letter, we propose Self-Evolutionary CLIP (SE- CLIP), a semi-supervised framework designed for recursive label mining in scene classification. The approach follows a dual-phase pipeline, where an initial warm-up on a few annotated seeds is followed by a recursive discovery phase that iteratively identifies high-confidence samples from unlabeled pools. To maintain the integrity of the evolving support set, we employ a class-balanced selection strategy that prevents the model from being dominated by easily learned categories. Results on the UCM and NWPU benchmarks indicate that SE-CLIP significantly outperforms existing semi-supervised approaches. The framework provides a viable solution for adapting VLMs to the remote sensing domain with minimal human intervention.
Problem

Research questions and friction points this paper is trying to address.

Semi-Supervised
Vision-Language Models
Satellite Imagery
Scene Classification
Annotated Samples
Innovation

Methods, ideas, or system contributions that make the work stand out.

Semi-Supervised
Recursive Label Mining
Class-Balanced Selection
Vision-Language Models
🔎 Similar Papers
No similar papers found.
M
Mohamed L. Mekhalfi
Fondazione Bruno Kessler, Via Sommarive 18, 38123, Povo TN, Italy
M
Mohamad M. Al Rahhal
Applied Computer Science Department, College of Applied Computer Science, King Saud University, 11543, Riyadh, Saudi Arabia
Y
Yakoub Bazi
Computer Engineering Department, College of Computer and Information Sciences, King Saud University, 11543, Riyadh, Saudi Arabia
S
Salah E. Khenfer
Key Laboratory of Tarim Oasis Agriculture, College of Information Engineering, Tarim University, Aral, China
M
Mingdeng Shi
Key Laboratory of Tarim Oasis Agriculture, College of Information Engineering, Tarim University, Aral, China
H
Hua Zou
School of Computer Science, Wuhan University, 430072, Wuhan, China
M
Mansour Zuair
Computer Engineering Department, College of Computer and Information Sciences, King Saud University, 11543, Riyadh, Saudi Arabia