Towards Generalization and Data Efficient Learning of Deep Robotic Grasping

by   Zhixin Chen, et al.

Deep reinforcement learning (DRL) has been proven to be a powerful paradigm for learning complex control policy autonomously. Numerous recent applications of DRL in robotic grasping have successfully trained DRL robotic agents end-to-end, mapping visual inputs into control instructions directly, but the amount of training data required may hinder these applications in practice. In this paper, we propose a DRL based robotic visual grasping framework, in which visual perception and control policy are trained separately rather than end-to-end. The visual perception produces physical descriptions of grasped objects and the policy takes use of them to decide optimal actions based on DRL. Benefiting from the explicit representation of objects, the policy is expected to be endowed with more generalization power over new objects and environments. In addition, the policy can be trained in simulation and transferred in real robotic system without any further training. We evaluate our framework in a real world robotic system on a number of robotic grasping tasks, such as semantic grasping, clustered object grasping, moving object grasping. The results show impressive robustness and generalization of our system.


page 3

page 5

page 6

page 7

page 9


DexRepNet: Learning Dexterous Robotic Grasping Network with Geometric and Spatial Hand-Object Representations

Robotic dexterous grasping is a challenging problem due to the high degr...

Deep Reinforcement Learning for Vision-Based Robotic Grasping: A Simulated Comparative Evaluation of Off-Policy Methods

In this paper, we explore deep reinforcement learning algorithms for vis...

Directional Semantic Grasping of Real-World Objects: From Simulation to Reality

We present a deep reinforcement learning approach to grasp semantically ...

Efficient entity-based reinforcement learning

Recent deep reinforcement learning (DRL) successes rely on end-to-end le...

An A* Curriculum Approach to Reinforcement Learning for RGBD Indoor Robot Navigation

Training robots to navigate diverse environments is a challenging proble...

A Robotic Visual Grasping Design: Rethinking Convolution Neural Network with High-Resolutions

High-resolution representations are important for vision-based robotic g...

Please sign up or login with your details

Forgot password? Click here to reset