Detecting Object States vs Detecting Objects: A New Dataset and a Quantitative Experimental Study

by   Filippos Gouidis, et al.

The detection of object states in images (State Detection - SD) is a problem of both theoretical and practical importance and it is tightly interwoven with other important computer vision problems, such as action recognition and affordance detection. It is also highly relevant to any entity that needs to reason and act in dynamic domains, such as robotic systems and intelligent agents. Despite its importance, up to now, the research on this problem has been limited. In this paper, we attempt a systematic study of the SD problem. First, we introduce the Object State Detection Dataset (OSDD), a new publicly available dataset consisting of more than 19,000 annotations for 18 object categories and 9 state classes. Second, using a standard deep learning framework used for Object Detection (OD), we conduct a number of appropriately designed experiments, towards an in-depth study of the behavior of the SD problem. This study enables the setup of a baseline on the performance of SD, as well as its relative performance in comparison to OD, in a variety of scenarios. Overall, the experimental outcomes confirm that SD is harder than OD and that tailored SD methods need to be developed for addressing effectively this significant problem.


page 1

page 2

page 3


MVA2023 Small Object Detection Challenge for Spotting Birds: Dataset, Methods, and Results

Small Object Detection (SOD) is an important machine vision topic becaus...

FOD-A: A Dataset for Foreign Object Debris in Airports

Foreign Object Debris (FOD) detection has attracted increased attention ...

Waste detection in Pomerania: non-profit project for detecting waste in environment

Waste pollution is one of the most significant environmental issues in t...

A systematic study of the foreground-background imbalance problem in deep learning for object detection

The class imbalance problem in deep learning has been explored in severa...

The EuroCity Persons Dataset: A Novel Benchmark for Object Detection

Big data has had a great share in the success of deep learning in comput...

Identifying Object States in Cooking-Related Images

Understanding object states is as important as object recognition for ro...

Cooking State Recognition From Images Using Inception Architecture

A kitchen robot properly needs to understand the cooking environment to ...

Please sign up or login with your details

Forgot password? Click here to reset