Learning Pregrasp Manipulation of Objects from Ungraspable Poses

by   Zhaole Sun, et al.

In robotic grasping, objects are often occluded in ungraspable configurations such that no pregrasp pose can be found, eg large flat boxes on the table that can only be grasped from the side. Inspired by humans' bimanual manipulation, eg one hand to lift up things and the other to grasp, we address this type of problems by introducing pregrasp manipulation - push and lift actions. We propose a model-free Deep Reinforcement Learning framework to train control policies that utilize visual information and proprioceptive states of the robot to autonomously discover robust pregrasp manipulation. The robot arm learns to first push the object towards a support surface and establishes a pivot to lift up one side of the object, thus creating a clearance between the object and the table for possible grasping solutions. Furthermore, we show the effectiveness of our proposed learning framework in training robust pregrasp policies that can directly transfer from simulation to real hardware through suitable design of training procedures, state, and action space. Lastly, we evaluate the effectiveness and the generalisation ability of the learned policies in real-world experiments, and demonstrate pregrasp manipulation of objects with various size, shape, weight, and surface friction.


page 1

page 4

page 5

page 6

page 7

page 8


DexTransfer: Real World Multi-fingered Dexterous Grasping with Minimal Human Demonstrations

Teaching a multi-fingered dexterous robot to grasp objects in the real w...

Intelligent flat-and-textureless object manipulation in Service Robots

This work introduces our approach to the flat and textureless object gra...

Dynamic Flex-and-Flip Manipulation of Deformable Linear Objects

This paper presents the technique of flex-and-flip manipulation. It is s...

Split Deep Q-Learning for Robust Object Singulation

Extracting a known target object from a pile of other objects in a clutt...

Sampling-based Exploration for Reinforcement Learning of Dexterous Manipulation

In this paper, we present a novel method for achieving dexterous manipul...

Benchmarking Robot Manipulation with the Rubik's Cube

Benchmarks for robot manipulation are crucial to measuring progress in t...

Controlled illumination for perception and manipulation of Lambertian objects

Controlling illumination can generate high quality information about obj...

Please sign up or login with your details

Forgot password? Click here to reset