Structured (De)composable Representations Trained with Neural Networks

07/07/2020
by   Graham Spinks, et al.
0

The paper proposes a novel technique for representing templates and instances of concept classes. A template representation refers to the generic representation that captures the characteristics of an entire class. The proposed technique uses end-to-end deep learning to learn structured and composable representations from input images and discrete labels. The obtained representations are based on distance estimates between the distributions given by the class label and those given by contextual information, which are modeled as environments. We prove that the representations have a clear structure allowing to decompose the representation into factors that represent classes and environments. We evaluate our novel technique on classification and retrieval tasks involving different modalities (visual and language data).

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/26/2021

Mining Contextual Information Beyond Image for Semantic Segmentation

This paper studies the context aggregation problem in semantic image seg...
research
06/29/2020

Deep Ordinal Regression with Label Diversity

Regression via classification (RvC) is a common method used for regressi...
research
05/14/2018

Deep Attentional Structured Representation Learning for Visual Recognition

Structured representations, such as Bags of Words, VLAD and Fisher Vecto...
research
09/22/2016

Image-embodied Knowledge Representation Learning

Entity images could provide significant visual information for knowledge...
research
12/01/2022

Neural Representations Reveal Distinct Modes of Class Fitting in Residual Convolutional Networks

We leverage probabilistic models of neural representations to investigat...
research
09/25/2019

MIC: Mining Interclass Characteristics for Improved Metric Learning

Metric learning seeks to embed images of objects suchthat class-defined ...
research
12/14/2022

Learning useful representations for shifting tasks and distributions

Does the dominant approach to learn representations (as a side effect of...

Please sign up or login with your details

Forgot password? Click here to reset