Large-Scale Video Analytics through Object-Level Consolidation

by   Daniel Rivas, et al.

As the number of installed cameras grows, so do the compute resources required to process and analyze all the images captured by these cameras. Video analytics enables new use cases, such as smart cities or autonomous driving. At the same time, it urges service providers to install additional compute resources to cope with the demand while the strict latency requirements push compute towards the end of the network, forming a geographically distributed and heterogeneous set of compute locations, shared and resource-constrained. Such landscape (shared and distributed locations) forces us to design new techniques that can optimize and distribute work among all available locations and, ideally, make compute requirements grow sublinearly with respect to the number of cameras installed. In this paper, we present FoMO (Focus on Moving Objects). This method effectively optimizes multi-camera deployments by preprocessing images for scenes, filtering the empty regions out, and composing regions of interest from multiple cameras into a single image that serves as input for a pre-trained object detection model. Results show that overall system performance can be increased by 8x while accuracy improves 40 by-product of the methodology, all using an off-the-shelf pre-trained model with no additional training or fine-tuning.


page 1

page 2

page 3

page 4


Towards Unsupervised Fine-Tuning for Edge Video Analytics

Judging by popular and generic computer vision challenges, such as the I...

Scaling Video Analytics Systems to Large Camera Deployments

New computer vision techniques, which enable accurate extraction of insi...

ApproxDet: Content and Contention-Aware Approximate Object Detection for Mobiles

Advanced video analytic systems, including scene classification and obje...

Spherical formulation of moving object geometric constraints for monocular fisheye cameras

In this paper, we introduce a moving object detection algorithm for fish...

Approximate Query Processing on Autonomous Cameras

Surveillance IoT cameras are becoming autonomous: they operate on batter...

ISP Distillation

Nowadays, many of the images captured are "observed" by machines only an...

Please sign up or login with your details

Forgot password? Click here to reset