Event-based Motion Segmentation by Cascaded Two-Level Multi-Model Fitting

by   Xiuyuan Lu, et al.

Among prerequisites for a synthetic agent to interact with dynamic scenes, the ability to identify independently moving objects is specifically important. From an application perspective, nevertheless, standard cameras may deteriorate remarkably under aggressive motion and challenging illumination conditions. In contrast, event-based cameras, as a category of novel biologically inspired sensors, deliver advantages to deal with these challenges. Its rapid response and asynchronous nature enables it to capture visual stimuli at exactly the same rate of the scene dynamics. In this paper, we present a cascaded two-level multi-model fitting method for identifying independently moving objects (i.e., the motion segmentation problem) with a monocular event camera. The first level leverages tracking of event features and solves the feature clustering problem under a progressive multi-model fitting scheme. Initialized with the resulting motion model instances, the second level further addresses the event clustering problem using a spatio-temporal graph-cut method. This combination leads to efficient and accurate event-wise motion segmentation that cannot be achieved by any of them alone. Experiments demonstrate the effectiveness and versatility of our method in real-world scenes with different motion patterns and an unknown number of independently moving objects.


page 1

page 7


Event-based Motion Segmentation with Spatio-Temporal Graph Cuts

Identifying independently moving objects is an essential task for dynami...

Event-Based Motion Segmentation by Motion Compensation

In contrast to traditional cameras, whose pixels have a common exposure ...

MOMS with Events: Multi-Object Motion Segmentation With Monocular Event Cameras

Segmentation of moving objects in dynamic scenes is a key process in sce...

Independent Motion Detection with Event-driven Cameras

Unlike standard cameras that send intensity images at a constant frame r...

See before you see: Real-time high speed motion prediction using fast aperture-robust event-driven visual flow

Optical flow is a crucial component of the feature space for early visua...

Moving Objects Detection with a Moving Camera: A Comprehensive Review

During about 30 years, a lot of research teams have worked on the big ch...

GNEP Based Dynamic Segmentation and Motion Estimation for Neuromorphic Imaging

This paper explores the application of event-based cameras in the domain...

Please sign up or login with your details

Forgot password? Click here to reset