TripleE: Easy Domain Generalization via Episodic Replay

10/04/2022
by   Xiaomeng Li, et al.
9

Learning how to generalize the model to unseen domains is an important area of research. In this paper, we propose TripleE, and the main idea is to encourage the network to focus on training on subsets (learning with replay) and enlarge the data space in learning on subsets. Learning with replay contains two core designs, EReplayB and EReplayD, which conduct the replay schema on batch and dataset, respectively. Through this, the network can focus on learning with subsets instead of visiting the global set at a glance, enlarging the model diversity in ensembling. To enlarge the data space in learning on subsets, we verify that an exhaustive and singular augmentation (ESAug) performs surprisingly well on expanding the data space in subsets during replays. Our model dubbed TripleE is frustratingly easy, based on simple augmentation and ensembling. Without bells and whistles, our TripleE method surpasses prior arts on six domain generalization benchmarks, showing that this approach could serve as a stepping stone for future research in domain generalization.

READ FULL TEXT
research
09/30/2022

B2RL: An open-source Dataset for Building Batch Reinforcement Learning

Batch reinforcement learning (BRL) is an emerging research area in the R...
research
01/09/2018

Deep In-GPU Experience Replay

Experience replay allows a reinforcement learning agent to train on samp...
research
10/09/2017

Deeper, Broader and Artier Domain Generalization

The problem of domain generalization is to learn from multiple training ...
research
10/29/2018

Marginal Replay vs Conditional Replay for Continual Learning

We present a new replay-based method of continual classification learnin...
research
11/25/2020

Batch Normalization Embeddings for Deep Domain Generalization

Domain generalization aims at training machine learning models to perfor...
research
02/10/2023

Cross-Corpora Spoken Language Identification with Domain Diversification and Generalization

This work addresses the cross-corpora generalization issue for the low-r...
research
08/10/2023

Composable Core-sets for Diversity Approximation on Multi-Dataset Streams

Core-sets refer to subsets of data that maximize some function that is c...

Please sign up or login with your details

Forgot password? Click here to reset