Deep Learning Techniques for Future Intelligent Cross-Media Retrieval

by   Sadaqat ur Rehman, et al.

With the advancement in technology and the expansion of broadcasting, cross-media retrieval has gained much attention. It plays a significant role in big data applications and consists in searching and finding data from different types of media. In this paper, we provide a novel taxonomy according to the challenges faced by multi-modal deep learning approaches in solving cross-media retrieval, namely: representation, alignment, and translation. These challenges are evaluated on deep learning (DL) based methods, which are categorized into four main groups: 1) unsupervised methods, 2) supervised methods, 3) pairwise based methods, and 4) rank based methods. Then, we present some well-known cross-media datasets used for retrieval, considering the importance of these datasets in the context in of deep learning based cross-media retrieval approaches. Moreover, we also present an extensive review of the state-of-the-art problems and its corresponding solutions for encouraging deep learning in cross-media retrieval. The fundamental objective of this work is to exploit Deep Neural Networks (DNNs) for bridging the "media gap", and provide researchers and developers with a better understanding of the underlying problems and the potential solutions of deep learning assisted cross-media retrieval. To the best of our knowledge, this is the first comprehensive survey to address cross-media retrieval under deep learning methods.


Cross-Media Scientific Research Achievements Retrieval Based on Deep Language Model

Science and technology big data contain a lot of cross-media information...

Deep Learning and Synthetic Media

Deep learning algorithms are rapidly changing the way in which audiovisu...

An Overview of Cross-media Retrieval: Concepts, Methodologies, Benchmarks and Challenges

Multimedia retrieval plays an indispensable role in big data utilization...

Research on Cross-media Science and Technology Information Data Retrieval

Since the era of big data, the Internet has been flooded with all kinds ...

A multimodal deep learning framework for scalable content based visual media retrieval

We propose a novel, efficient, modular and scalable framework for conten...

Leveraging Deep Learning Approaches for Deepfake Detection: A Review

Conspicuous progression in the field of machine learning and deep learni...

Writer Retrieval and Writer Identification in Greek Papyri

The analysis of digitized historical manuscripts is typically addressed ...

Please sign up or login with your details

Forgot password? Click here to reset