CADDY Underwater Stereo-Vision Dataset for Human-Robot Interaction (HRI) in the Context of Diver Activities

by   Arturo Gomez Chavez, et al.

In this article we present a novel underwater dataset collected from several field trials within the EU FP7 project "Cognitive autonomous diving buddy (CADDY)", where an Autonomous Underwater Vehicle (AUV) was used to interact with divers and monitor their activities. To our knowledge, this is one of the first efforts to collect a large dataset in underwater environments targeting object classification, segmentation and human pose estimation tasks. The first part of the dataset contains stereo camera recordings ( 10K) of divers performing hand gestures to communicate and interact with an AUV in different environmental conditions. These gestures samples serve to test the robustness of object detection and classification algorithms against underwater image distortions i.e., color attenuation and light backscatter. The second part includes stereo footage ( 12.7K) of divers free-swimming in front of the AUV, along with synchronized IMUs measurements located throughout the diver's suit (DiverNet) which serve as ground-truth for human pose and tracking methods. In both cases, these rectified images allow investigation of 3D representation and reasoning pipelines from low-texture targets commonly present in underwater scenarios. In this paper we describe our recording platform, sensor calibration procedure plus the data format and the utilities provided to use the dataset.


page 1

page 2

page 3

page 4

page 5


Underwater inspection and intervention dataset

This paper presents a novel dataset for the development of visual naviga...

Diver Interest via Pointing: Human-Directed Object Inspection for AUVs

In this paper, we present the Diver Interest via Pointing (DIP) algorith...

DARE: AI-based Diver Action Recognition System using Multi-Channel CNNs for AUV Supervision

With the growth of sensing, control and robotic technologies, autonomous...

Robust Gesture-Based Communication for Underwater Human-Robot Interaction in the context of Search and Rescue Diver Missions

We propose a robust gesture-based communication pipeline for divers to i...

Fast Underwater Image Enhancement for Improved Visual Perception

In this paper, we present a conditional generative adversarial network-b...

Underwater autonomous mapping and characterization of marine debris in urban water bodies

Marine debris originating from human activity has been accumulating in u...

Tracking Live Fish from Low-Contrast and Low-Frame-Rate Stereo Videos

Non-extractive fish abundance estimation with the aid of visual analysis...

Please sign up or login with your details

Forgot password? Click here to reset