Cross-modal Zero-shot Hashing

by   Xuanwu Liu, et al.

Hashing has been widely studied for big data retrieval due to its low storage cost and fast query speed. Zero-shot hashing (ZSH) aims to learn a hashing model that is trained using only samples from seen categories, but can generalize well to samples of unseen categories. ZSH generally uses category attributes to seek a semantic embedding space to transfer knowledge from seen categories to unseen ones. As a result, it may perform poorly when labeled data are insufficient. ZSH methods are mainly designed for single-modality data, which prevents their application to the widely spread multi-modal data. On the other hand, existing cross-modal hashing solutions assume that all the modalities share the same category labels, while in practice the labels of different data modalities may be different. To address these issues, we propose a general Cross-modal Zero-shot Hashing (CZHash) solution to effectively leverage unlabeled and labeled multi-modality data with different label spaces. CZHash first quantifies the composite similarity between instances using label and feature information. It then defines an objective function to achieve deep feature learning compatible with the composite similarity preserving, category attribute space learning, and hashing coding function learning. CZHash further introduces an alternative optimization procedure to jointly optimize these learning objectives. Experiments on benchmark multi-modal datasets show that CZHash significantly outperforms related representative hashing approaches both on effectiveness and adaptability.


page 2

page 3

page 5

page 6

page 7

page 8

page 9

page 10


Cross-modal Zero-shot Hashing by Label Attributes Embedding

Cross-modal hashing (CMH) is one of the most promising methods in cross-...

Attribute-Guided Network for Cross-Modal Zero-Shot Hashing

Zero-Shot Hashing aims at learning a hashing model that is trained only ...

Ranking-based Deep Cross-modal Hashing

Cross-modal hashing has been receiving increasing interests for its low ...

Weakly-paired Cross-Modal Hashing

Hashing has been widely adopted for large-scale data retrieval in many d...

Zero-Shot Sketch-Image Hashing

Recent studies show that large-scale sketch-based image retrieval (SBIR)...

Meta Cross-Modal Hashing on Long-Tailed Data

Due to the advantage of reducing storage while speeding up query time on...

Information-Theoretic Hashing for Zero-Shot Cross-Modal Retrieval

Zero-shot cross-modal retrieval (ZS-CMR) deals with the retrieval proble...

Please sign up or login with your details

Forgot password? Click here to reset