Addressing target shift in zero-shot learning using grouped adversarial learning

by   Saneem Ahmed Chemmengath, et al.

In this paper, we present a new paradigm to zero-shot learning (ZSL) that is trained by utilizing additional information (such as attribute-class mapping) for specific set of unseen classes. We conjecture that such additional information about unseen classes is more readily available than unsupervised image sets. Further, on close examination of the underlying attribute predictors of popular ZSL algorithms, we find that they often leverage attribute correlations to make predictions. While attribute correlations that remain intact in the unseen classes (test) benefit the prediction of difficult attributes, change in correlations can have an adverse effect on ZSL performance. For example, detecting an attribute 'brown' may be the same as detecting 'fur' over an animals' image dataset captured in the tropics. However, such a model might fail on unseen images of Arctic animals. To address this effect, termed target-shift in ZSL, we utilize our proposed framework to design grouped adversarial learning. We introduce grouping of attributes to enable the model to continue to benefit from useful correlations, while restricting cross-group correlations that may be harmful for generalization. Our analysis shows that it is possible to not only constrain the model from leveraging unwanted correlations, but also adjust them to specific test setting using only the additional information (the already available attribute-class mapping). We show empirical results for zero-shot predictions on standard benchmark datasets, namely, aPY, AwA2, SUN and CUB datasets. We further introduce to the research community, a new experimental train-test split that maximizes target-shift to further study its effects.


A Generative Framework for Zero-Shot Learning with Adversarial Domain Adaptation

In this paper, we present a domain adaptation based generative framework...

Prior Knowledge about Attributes: Learning a More Effective Potential Space for Zero-Shot Recognition

Zero-shot learning (ZSL) aims to recognize unseen classes accurately by ...

Attributes2Classname: A discriminative model for attribute-based unsupervised zero-shot learning

We propose a novel approach for unsupervised zero-shot learning (ZSL) of...

Beyond Attributes: Adversarial Erasing Embedding Network for Zero-shot Learning

In this paper, an adversarial erasing embedding network with the guidanc...

Zero-Shot Kernel Learning

In this paper, we address an open problem of zero-shot learning. Its pri...

Toward Zero-Shot Unsupervised Image-to-Image Translation

Recent studies have shown remarkable success in unsupervised image-to-im...

Tight Lower Bounds on Worst-Case Guarantees for Zero-Shot Learning with Attributes

We develop a rigorous mathematical analysis of zero-shot learning with a...

Please sign up or login with your details

Forgot password? Click here to reset