Improving the Generalization of Meta-learning on Unseen Domains via Adversarial Shift

07/23/2021
by   Pinzhuo Tian, et al.
0

Meta-learning provides a promising way for learning to efficiently learn and achieves great success in many applications. However, most meta-learning literature focuses on dealing with tasks from a same domain, making it brittle to generalize to tasks from the other unseen domains. In this work, we address this problem by simulating tasks from the other unseen domains to improve the generalization and robustness of meta-learning method. Specifically, we propose a model-agnostic shift layer to learn how to simulate the domain shift and generate pseudo tasks, and develop a new adversarial learning-to-learn mechanism to train it. Based on the pseudo tasks, the meta-learning model can learn cross-domain meta-knowledge, which can generalize well on unseen domains. We conduct extensive experiments under the domain generalization setting. Experimental results demonstrate that the proposed shift layer is applicable to various meta-learning frameworks. Moreover, our method also leads to state-of-the-art performance on different cross-domain few-shot classification benchmarks and produces good results on cross-domain few-shot regression.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/29/2021

Cross-Domain Few-Shot Classification via Adversarial Task Augmentation

Few-shot classification aims to recognize unseen classes with few labele...
research
10/31/2020

Combining Domain-Specific Meta-Learners in the Parameter Space for Cross-Domain Few-Shot Classification

The goal of few-shot classification is to learn a model that can classif...
research
07/15/2020

Learning to Learn with Variational Information Bottleneck for Domain Generalization

Domain generalization models learn to generalize to previously unseen do...
research
11/01/2020

Discriminative Adversarial Domain Generalization with Meta-learning based Cross-domain Validation

The generalization capability of machine learning models, which refers t...
research
07/04/2020

Shape-aware Meta-learning for Generalizing Prostate MRI Segmentation to Unseen Domains

Model generalization capacity at domain shift (e.g., various imaging pro...
research
01/23/2020

Cross-Domain Few-Shot Classification via Learned Feature-Wise Transformation

Few-shot classification aims to recognize novel categories with only few...
research
03/31/2022

CADG: A Model Based on Cross Attention for Domain Generalization

In Domain Generalization (DG) tasks, models are trained by using only tr...

Please sign up or login with your details

Forgot password? Click here to reset