Grasp Proposal Networks: An End-to-End Solution for Visual Learning of Robotic Grasps

by   Chaozheng Wu, et al.

Learning robotic grasps from visual observations is a promising yet challenging task. Recent research shows its great potential by preparing and learning from large-scale synthetic datasets. For the popular, 6 degree-of-freedom (6-DOF) grasp setting of parallel-jaw gripper, most of existing methods take the strategy of heuristically sampling grasp candidates and then evaluating them using learned scoring functions. This strategy is limited in terms of the conflict between sampling efficiency and coverage of optimal grasps. To this end, we propose in this work a novel, end-to-end Grasp Proposal Network (GPNet), to predict a diverse set of 6-DOF grasps for an unseen object observed from a single and unknown camera view. GPNet builds on a key design of grasp proposal module that defines anchors of grasp centers at discrete but regular 3D grid corners, which is flexible to support either more precise or more diverse grasp predictions. To test GPNet, we contribute a synthetic dataset of 6-DOF object grasps; evaluation is conducted using rule-based criteria, simulation test, and real test. Comparative results show the advantage of our methods over existing ones. Notably, GPNet gains better simulation results via the specified coverage, which helps achieve a ready translation in real test. We will make our dataset publicly available.


page 11

page 13


Beyond Top-Grasps Through Scene Completion

Current end-to-end grasp planning methods propose grasps in the order of...

REGNet: REgion-based Grasp Network for Single-shot Grasp Detection in Point Clouds

Learning a robust representation of robotic grasping from point clouds i...

End-to-end Trainable Deep Neural Network for Robotic Grasp Detection and Semantic Segmentation from RGB

In this work, we introduce a novel, end-to-end trainable CNN-based archi...

End-to-End Learning to Grasp from Object Point Clouds

The ability to grasp objects is an essential skill that enables many rob...

6-DoF Contrastive Grasp Proposal Network

Proposing grasp poses for novel objects is an essential component for an...

Uncertainty-driven Exploration Strategies for Online Grasp Learning

Existing grasp prediction approaches are mostly based on offline learnin...

S4G: Amodal Single-view Single-Shot SE(3) Grasp Detection in Cluttered Scenes

Grasping is among the most fundamental and long-lasting problems in robo...

Please sign up or login with your details

Forgot password? Click here to reset