TOHAN: A One-step Approach towards Few-shot Hypothesis Adaptation

06/11/2021
by   Haoang Chi, et al.
0

In few-shot domain adaptation (FDA), classifiers for the target domain are trained with accessible labeled data in the source domain (SD) and few labeled data in the target domain (TD). However, data usually contain private information in the current era, e.g., data distributed on personal phones. Thus, the private information will be leaked if we directly access data in SD to train a target-domain classifier (required by FDA methods). In this paper, to thoroughly prevent the privacy leakage in SD, we consider a very challenging problem setting, where the classifier for the TD has to be trained using few labeled target data and a well-trained SD classifier, named few-shot hypothesis adaptation (FHA). In FHA, we cannot access data in SD, as a result, the private information in SD will be protected well. To this end, we propose a target orientated hypothesis adaptation network (TOHAN) to solve the FHA problem, where we generate highly-compatible unlabeled data (i.e., an intermediate domain) to help train a target-domain classifier. TOHAN maintains two deep networks simultaneously, where one focuses on learning an intermediate domain and the other takes care of the intermediate-to-target distributional adaptation and the target-risk minimization. Experimental results show that TOHAN outperforms competitive baselines significantly.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/29/2020

Clarinet: A One-step Approach Towards Budget-friendly Unsupervised Domain Adaptation

In unsupervised domain adaptation (UDA), classifiers for the target doma...
research
07/12/2023

Diversity-enhancing Generative Network for Few-shot Hypothesis Adaptation

Generating unlabeled data has been recently shown to help address the fe...
research
05/19/2019

Butterfly: A Panacea for All Difficulties in Wildly Unsupervised Domain Adaptation

In unsupervised domain adaptation (UDA), classifiers for the target doma...
research
08/12/2022

Private Domain Adaptation from a Public Source

A key problem in a variety of applications is that of domain adaptation ...
research
06/15/2023

Differentially Private Domain Adaptation with Theoretical Guarantees

In many applications, the labeled data at the learner's disposal is subj...
research
08/02/2021

Domain Adaptation for Autoencoder-Based End-to-End Communication Over Wireless Channels

The problem of domain adaptation conventionally considers the setting wh...
research
06/21/2018

Target Contrastive Pessimistic Discriminant Analysis

Domain-adaptive classifiers learn from a source domain and aim to genera...

Please sign up or login with your details

Forgot password? Click here to reset