MemeSequencer: Sparse Matching for Embedding Image Macros

by   Abhimanyu Dubey, et al.

The analysis of the creation, mutation, and propagation of social media content on the Internet is an essential problem in computational social science, affecting areas ranging from marketing to political mobilization. A first step towards understanding the evolution of images online is the analysis of rapidly modifying and propagating memetic imagery or `memes'. However, a pitfall in proceeding with such an investigation is the current incapability to produce a robust semantic space for such imagery, capable of understanding differences in Image Macros. In this study, we provide a first step in the systematic study of image evolution on the Internet, by proposing an algorithm based on sparse representations and deep learning to decouple various types of content in such images and produce a rich semantic embedding. We demonstrate the benefits of our approach on a variety of tasks pertaining to memes and Image Macros, such as image clustering, image retrieval, topic prediction and virality prediction, surpassing the existing methods on each. In addition to its utility on quantitative tasks, our method opens up the possibility of obtaining the first large-scale understanding of the evolution and propagation of memetic imagery.


page 4

page 5

page 9


Examining Similar and Ideologically Correlated Imagery in Online Political Communication

This paper investigates the kinds of visual media US national politician...

Two Computational Models for Analyzing Political Attention in Social Media

Understanding how political attention is divided and over what subjects ...

C-CLIP: Contrastive Image-Text Encoders to Close the Descriptive-Commentative Gap

The interplay between the image and comment on a social media post is on...

Learning to Learn from Web Data through Deep Semantic Embeddings

In this paper we propose to learn a multimodal image and text embedding ...

Automatic Image Filtering on Social Networks Using Deep Learning and Perceptual Hashing During Crises

The extensive use of social media platforms, especially during disasters...

Using Social Media Images for Building Function Classification

Urban land use on a building instance level is crucial geo-information f...

Modeling Image Virality with Pairwise Spatial Transformer Networks

The study of virality and information diffusion online is a topic gainin...

Please sign up or login with your details

Forgot password? Click here to reset