Learning Deep Context-Network Architectures for Image Annotation

by   Mingyuan Jiu, et al.

Context plays an important role in visual pattern recognition as it provides complementary clues for different learning tasks including image classification and annotation. In the particular scenario of kernel learning, the general recipe of context-based kernel design consists in learning positive semi-definite similarity functions that return high values not only when data share similar content but also similar context. However, in spite of having a positive impact on performance, the use of context in these kernel design methods has not been fully explored; indeed, context has been handcrafted instead of being learned. In this paper, we introduce a novel context-aware kernel design framework based on deep learning. Our method discriminatively learns spatial geometric context as the weights of a deep network (DN). The architecture of this network is fully determined by the solution of an objective function that mixes content, context and regularization, while the parameters of this network determine the most relevant (discriminant) parts of the learned context. We apply this context and kernel learning framework to image classification using the challenging ImageCLEF Photo Annotation benchmark; the latter shows that our deep context learning provides highly effective kernels for image classification as corroborated through extensive experiments.


Deep Context-Aware Kernel Networks

Context plays a crucial role in visual recognition as it provides comple...

End-to-end training of deep kernel map networks for image classification

Deep kernel map networks have shown excellent performances in various cl...

Image Annotation based on Deep Hierarchical Context Networks

Context modeling is one of the most fertile subfields of visual recognit...

Attending Category Disentangled Global Context for Image Classification

In this paper, we propose a general framework for image classification u...

Learning Kernel for Conditional Moment-Matching Discrepancy-based Image Classification

Conditional Maximum Mean Discrepancy (CMMD) can capture the discrepancy ...

A Novel Deep Learning Architecture for Testis Histology Image Classification

Unlike other histology analysis, classification of tubule status in test...

Abuse is Contextual, What about NLP? The Role of Context in Abusive Language Annotation and Detection

The datasets most widely used for abusive language detection contain lis...

Please sign up or login with your details

Forgot password? Click here to reset