MetAdapt: Meta-learned task-adaptive architecture for few-shot classification

Sivan Doveh, Eli Schwartz, Chao Xue, Rogerio Feris, Alex Bronstein, Raja Giryes, Leonid Karlinsky

Research output: Contribution to journalArticlepeer-review

Abstract

Recently, great progress has been made in the field of Few-Shot Learning (FSL). While many different methods have been proposed, one of the key factors leading to higher FSL performance is surprisingly simple. It is the backbone network architecture used to embed the images of the few-shot tasks. While first works on FSL resorted to small architectures with just a few convolution layers, recent works show that large architectures pre-trained on the training portion of FSL datasets produce strong features that are more easily transferable to novel few-shot tasks, thus attaining significant gains to methods using them. Despite these observations, little to no work has been done towards finding the right backbone for FSL. In this paper we propose MetAdapt that not only meta-searches for an optimized architecture for FSL using Network Architecture Search (NAS), but also results in a model that can adaptively ‘re-wire’ itself predicting the better architecture for a given novel few-shot task. Using the proposed approach we observe strong results on two popular few-shot benchmarks: miniImageNet and FC100.

Original languageEnglish
Pages (from-to)130-136
Number of pages7
JournalPattern Recognition Letters
Volume149
DOIs
StatePublished - Sep 2021

Fingerprint

Dive into the research topics of 'MetAdapt: Meta-learned task-adaptive architecture for few-shot classification'. Together they form a unique fingerprint.

Cite this