TinyVIRAT: Low-resolution Video Action Recognition

by   Ugur Demir, et al.

The existing research in action recognition is mostly focused on high-quality videos where the action is distinctly visible. In real-world surveillance environments, the actions in videos are captured at a wide range of resolutions. Most activities occur at a distance with a small resolution and recognizing such activities is a challenging problem. In this work, we focus on recognizing tiny actions in videos. We introduce a benchmark dataset, TinyVIRAT, which contains natural low-resolution activities. The actions in TinyVIRAT videos have multiple labels and they are extracted from surveillance videos which makes them realistic and more challenging. We propose a novel method for recognizing tiny actions in videos which utilizes a progressive generative approach to improve the quality of low-resolution actions. The proposed method also consists of a weakly trained attention mechanism which helps in focusing on the activity regions in the video. We perform extensive experiments to benchmark the proposed TinyVIRAT dataset and observe that the proposed method significantly improves the action recognition performance over baselines. We also evaluate the proposed approach on synthetically resized action recognition datasets and achieve state-of-the-art results when compared with existing methods. The dataset and code is publicly available at https://github.com/UgurDemir/Tiny-VIRAT.


page 2

page 3

page 5


TinyAction Challenge: Recognizing Real-world Low-resolution Activities in Videos

This paper summarizes the TinyAction challenge which was organized in Ac...

Gabriella: An Online System for Real-Time Activity Detection in Untrimmed Surveillance Videos

Activity detection in surveillance videos is a difficult problem due to ...

Learning Action Changes by Measuring Verb-Adverb Textual Relationships

The goal of this work is to understand the way actions are performed in ...

Low-Resolution Action Recognition for Tiny Actions Challenge

Tiny Actions Challenge focuses on understanding human activities in real...

Inferring Temporal Compositions of Actions Using Probabilistic Automata

This paper presents a framework to recognize temporal compositions of at...

Recognizing Video Events with Varying Rhythms

Recognizing Video events in long, complex videos with multiple sub-activ...

Let's Play for Action: Recognizing Activities of Daily Living by Learning from Life Simulation Video Games

Recognizing Activities of Daily Living (ADL) is a vital process for inte...

Please sign up or login with your details

Forgot password? Click here to reset