SelfMatch: Combining Contrastive Self-Supervision and Consistency for Semi-Supervised Learning

01/16/2021
by   Byoungjip Kim, et al.
0

This paper introduces SelfMatch, a semi-supervised learning method that combines the power of contrastive self-supervised learning and consistency regularization. SelfMatch consists of two stages: (1) self-supervised pre-training based on contrastive learning and (2) semi-supervised fine-tuning based on augmentation consistency regularization. We empirically demonstrate that SelfMatch achieves the state-of-the-art results on standard benchmark datasets such as CIFAR-10 and SVHN. For example, for CIFAR-10 with 40 labeled examples, SelfMatch achieves 93.19 previous methods such as MixMatch (52.46 and FixMatch (86.19 supervised learning (95.87 only a few labels for each class.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/19/2023

ContraCluster: Learning to Classify without Labels by Contrastive Self-Supervision and Prototype-Based Semi-Supervision

The recent advances in representation learning inspire us to take on the...
research
06/18/2020

Recovering Petaflops in Contrastive Semi-Supervised Learning of Visual Representations

We investigate a strategy for improving the computational efficiency of ...
research
11/23/2020

CoMatch: Semi-supervised Learning with Contrastive Graph Regularization

Semi-supervised learning has been an effective paradigm for leveraging u...
research
11/23/2021

CoDiM: Learning with Noisy Labels via Contrastive Semi-Supervised Learning

Labels are costly and sometimes unreliable. Noisy label learning, semi-s...
research
03/14/2022

S5CL: Unifying Fully-Supervised, Self-Supervised, and Semi-Supervised Learning Through Hierarchical Contrastive Learning

In computational pathology, we often face a scarcity of annotations and ...
research
06/14/2018

Improving Consistency-Based Semi-Supervised Learning with Weight Averaging

Recent advances in deep unsupervised learning have renewed interest in s...
research
03/09/2019

Interpolation Consistency Training for Semi-Supervised Learning

We introduce Interpolation Consistency Training (ICT), a simple and comp...

Please sign up or login with your details

Forgot password? Click here to reset