GRADE: Generating Realistic Animated Dynamic Environments for Robotics Research

03/08/2023
by   Elia Bonetto, et al.
0

Simulation engines like Gazebo, Unity and Webots are widely adopted in robotics. However, they lack either full simulation control, ROS integration, realistic physics, or photorealism. Recently, synthetic data generation and realistic rendering advanced tasks like target tracking and human pose estimation. However, when focusing on vision applications, there is usually a lack of information like sensor measurements (e.g. IMU, LiDAR, joint state), or time continuity. On the other hand, simulations for most robotics applications are obtained in (semi)static environments, with specific sensor settings and low visual fidelity. In this work, we present a solution to these issues with a fully customizable framework for generating realistic animated dynamic environments (GRADE) for robotics research. The data produced can be post-processed, e.g. to add noise, and easily expanded with new information using the tools that we provide. To demonstrate GRADE, we use it to generate an indoor dynamic environment dataset and then compare different SLAM algorithms on the produced sequences. By doing that, we show how current research over-relies on well-known benchmarks and fails to generalize. Furthermore, our tests with YOLO and Mask R-CNN provide evidence that our data can improve training performance and generalize to real sequences. Finally, we show GRADE's flexibility by using it for indoor active SLAM, with diverse environment sources, and in a multi-robot scenario. In doing that, we employ different control, asset placement, and simulation techniques. The code, results, implementation details, and generated data are provided as open-source. The main project page is https://eliabntt.github.io/grade-rr while the accompanying video can be found at https://youtu.be/cmywCSD-9TU.

READ FULL TEXT

page 1

page 4

page 5

page 7

page 13

research
05/07/2023

Simulation of Dynamic Environments for SLAM

Simulation engines are widely adopted in robotics. However, they lack ei...
research
05/07/2023

Learning from synthetic data generated with GRADE

Recently, synthetic data generation and realistic rendering has advanced...
research
02/13/2023

Mini bot 3D: A ROS based Gazebo Simulation

The recent adoption of the Robot Operating System (ROS) as a software st...
research
07/29/2021

Towards developing a realistic robotics simulation environment of an indoor vegetable greenhouse

This article presents a method for developing a realistic robotics simul...
research
05/16/2023

NerfBridge: Bringing Real-time, Online Neural Radiance Field Training to Robotics

This work was presented at the IEEE International Conference on Robotics...
research
03/01/2022

Render-in-the-loop aerial robotics simulator: Case Study on Yield Estimation in Indoor Agriculture

Inspired by recent promising results in sim-to-real transfer in deep lea...
research
09/03/2020

SEDRo: A Simulated Environment for Developmental Robotics

Even with impressive advances in application-specific models, we still l...

Please sign up or login with your details

Forgot password? Click here to reset