Emotion-Based Crowd Representation for Abnormality Detection

by   Hamidreza Rabiee, et al.

In crowd behavior understanding, a model of crowd behavior need to be trained using the information extracted from video sequences. Since there is no ground-truth available in crowd datasets except the crowd behavior labels, most of the methods proposed so far are just based on low-level visual features. However, there is a huge semantic gap between low-level motion/appearance features and high-level concept of crowd behaviors. In this paper we propose an attribute-based strategy to alleviate this problem. While similar strategies have been recently adopted for object and action recognition, as far as we know, we are the first showing that the crowd emotions can be used as attributes for crowd behavior understanding. The main idea is to train a set of emotion-based classifiers, which can subsequently be used to represent the crowd motion. For this purpose, we collect a big dataset of video clips and provide them with both annotations of "crowd behaviors" and "crowd emotions". We show the results of the proposed method on our dataset, which demonstrate that the crowd emotions enable the construction of more descriptive models for crowd behaviors. We aim at publishing the dataset with the article, to be used as a benchmark for the communities.


page 2

page 5

page 9


ACSEE: Antagonistic Crowd Simulation model with Emotional contagion and Evolutionary game

Antagonistic crowd behaviors are often observed in cases of serious conf...

LCrowdV: Generating Labeled Videos for Simulation-based Crowd Behavior Learning

We present a novel procedural framework to generate an arbitrary number ...

Density-based clustering with fully-convolutional networks for crowd flow detection from drones

Crowd analysis from drones has attracted increasing attention in recent ...

Crowd Saliency Detection via Global Similarity Structure

It is common for CCTV operators to overlook inter- esting events taking ...

Edge Based Grid Super-Imposition for Crowd Emotion Recognition

Numerous automatic continuous emotion detection system studies have exam...

Estimation of Linear Motion in Dense Crowd Videos using Langevin Model

Crowd gatherings at social and cultural events are increasing in leaps a...

Predicting First Impressions with Deep Learning

Describable visual facial attributes are now commonplace in human biomet...

Please sign up or login with your details

Forgot password? Click here to reset