DGCM-Net: Dense Geometrical Correspondence Matching Network for Incremental Experience-based Robotic Grasping

by   Timothy Patten, et al.

This article presents a method for grasping novel objects by learning from experience. Successful attempts are remembered and then used to guide future grasps such that more reliable grasping is achieved over time. To generalise the learned experience to unseen objects, we introduce the dense geometric correspondence matching network (DGCM-Net). This applies metric learning to encode objects with similar geometry nearby in feature space. Retrieving relevant experience for an unseen object is thus a nearest neighbour search with the encoded feature maps. DGCM-Net also reconstructs 3D-3D correspondences using the view-dependent normalised object coordinate space to transform grasp configurations from retrieved samples to unseen objects. In comparison to baseline methods, our approach achieves an equivalent grasp success rate. However, the baselines are significantly improved when fusing the knowledge from experience with their grasp proposal strategy. Offline experiments with a grasping dataset highlight the capability to generalise within and between object classes as well as to improve success rate over time from increasing experience. Lastly, by learning task-relevant grasps, our approach can prioritise grasps that enable the functional use of objects.


page 4

page 6

page 8

page 10

page 12

page 13

page 14

page 15


Accelerating Grasp Exploration by Leveraging Learned Priors

The ability of robots to grasp novel objects has industry applications i...

Robotic Grasping through Combined image-Based Grasp Proposal and 3D Reconstruction

We present a novel approach to robotic grasp planning using both a learn...

PEGG-Net: Background Agnostic Pixel-Wise Efficient Grasp Generation Under Closed-Loop Conditions

Performing closed-loop grasping at close proximity to an object requires...

GP-net: Grasp Proposal for Mobile Manipulators

We present the Grasp Proposal Network (GP-net), a Convolutional Neural N...

Online Self-Supervised Learning for Object Picking: Detecting Optimum Grasping Position using a Metric Learning Approach

Self-supervised learning methods are attractive candidates for automatic...

Improving Data Efficiency of Self-supervised Learning for Robotic Grasping

Given the task of learning robotic grasping solely based on a depth came...

Robust and fast generation of top and side grasps for unknown objects

In this work, we present a geometry-based grasping algorithm that is cap...

Please sign up or login with your details

Forgot password? Click here to reset