Non-generative Generalized Zero-shot Learning via Task-correlated Disentanglement and Controllable Samples Synthesis

03/10/2022
by   Yaogong Feng, et al.
0

Synthesizing pseudo samples is currently the most effective way to solve the Generalized Zero Shot Learning (GZSL) problem. Most models achieve competitive performance but still suffer from two problems: (1) Feature confounding, the overall representations confound task-correlated and task-independent features, and existing models disentangle them in a generative way, but they are unreasonable to synthesize reliable pseudo samples with limited samples; (2) Distribution uncertainty, that massive data is needed when existing models synthesize samples from the uncertain distribution, which causes poor performance in limited samples of seen classes. In this paper, we propose a non-generative model to address these problems correspondingly in two modules: (1) Task-correlated feature disentanglement, to exclude the task-correlated features from task-independent ones by adversarial learning of domain adaption towards reasonable synthesis; (2) Controllable pseudo sample synthesis, to synthesize edge-pseudo and center-pseudo samples with certain characteristics towards more diversity generated and intuitive transfer. In addation, to describe the new scene that is the limit seen class samples in the training process, we further formulate a new ZSL task named the 'Few-shot Seen class and Zero-shot Unseen class learning' (FSZU). Extensive experiments on four benchmarks verify that the proposed method is competitive in the GZSL and the FSZU tasks.

READ FULL TEXT

page 1

page 7

research
02/01/2020

Domain segmentation and adjustment for generalized zero-shot learning

In the generalized zero-shot learning, synthesizing unseen data with gen...
research
03/17/2020

Latent Embedding Feedback and Discriminative Features for Zero-Shot Classification

Zero-shot learning strives to classify unseen categories for which no da...
research
09/10/2019

A Meta-Learning Framework for Generalized Zero-Shot Learning

Learning to classify unseen class samples at test time is popularly refe...
research
03/02/2021

Few-shot Open-set Recognition by Transformation Consistency

In this paper, we attack a few-shot open-set recognition (FSOSR) problem...
research
03/19/2017

Zero-Shot Learning by Generating Pseudo Feature Representations

Zero-shot learning (ZSL) is a challenging task aiming at recognizing nov...
research
03/19/2021

DFS: A Diverse Feature Synthesis Model for Generalized Zero-Shot Learning

Generative based strategy has shown great potential in the Generalized Z...
research
12/11/2022

DiffAlign : Few-shot learning using diffusion based synthesis and alignment

We address the problem of few-shot classification where the goal is to l...

Please sign up or login with your details

Forgot password? Click here to reset