Query-Specific Embedding Co-Adaptation Improve Few-Shot Image Classification
Wen Fu, Li Zhou, Jie Chen · IEEE Signal Processing Letters · 2023
Few-Shot Image Classification aims to identify unseen categories by a limited number of instances. Recently, some metric-based methods have attempted to generate more discriminative task-specific embeddings by embedding adaptation strategies. However, the generated embeddings are either query-agnostic or ignore local relations between instances in each category, resulting in limited performance improvement. To address the above issues, in this letter, we propose QS-CAN, a Query-Specific embedding Co-Adaptation Network, which generates task- and query-specific embeddings by fusing inter-class and intra-class information. The core modules of QS-CAN are Inter-Class Adapter(Inter-A) and Intra-Class Adapter(Intra-A). The Inter-Class Adapter encodes the global relationship within the task, pushing the different categories away from each other. At the same time, the Intra-Class Adapter focuses on modeling the local relationship within each category, pulling the instances within a category closer. Moreover, an Adaptive Fusion Module(AFM) is proposed to integrate two co-adapted embeddings to get a more discriminative space. Experiments show that our method performs comparably to other advanced methods on three widely used datasets.