NAM Net: Meta-Network with Normalization-based Attention for Few-Shot Learning
Qiaoning Yang, Xiuhui Yang, Xiaodong Ji · 2022 2nd International Conference on Computer Science, Electronic Information Engineering and Intelligent Control Technology (CEI) · 2022
Few-shot learning aims to learn a classifier to recognize unseen classes with limited labeled examples. The scarcity of training data remains a challenging problem in few-shot classification. Many few-shot learning methods focus on the structure of meta-network models and there is often no dedicated study of meta-knowledge representation. In this paper, a meta-learning strategy is introduced and a meta-network NAM Net is proposed. Taking the advantage of ‘learning to learn’, the model acquires meta-knowledge via few-shot classification tasks and applies it to new few-shot scenarios. Specifically, the meta-learner learns the best parameters of the feature extraction and similarity metric modules. The distance between the support feature and query feature is obtained by a learnable metric function, which leads to the classification result. The base learner migrates the meta-knowledge to the target class to perform classification in a new few-shot episode. Moreover, the Normalization-based Attention Module is adapted to feature extractor to enhance meta-knowledge representation. Compared with few-shot learning benchmarks, NAM Net is effective and achieves higher accuracy in both 5-way 1-shot and 5-shot classification tasks.