Intent-based Object Grasping by a Robot using Deep Learning

by   Faheem Zunjani, et al.

A robot needs to predict an ideal rectangle for optimal object grasping based on the intent for that grasp. Mask Regional - Convolutional Neural Network (Detectron) can be used to generate the object mask and for object detection and a Convolutional Neural Network (CNN) can be used for ideal grasp rectangle prediction according to the supplied intent, as described in this paper. The masked image obtained from Detectron along with the metadata of the intent type has been fed to the Fully-Connected layers of the CNN which would generate the desired optimal rectangle for the specific intent and object. Before settling for a CNN for optimal rectangle prediction, conventional Neural Networks with different hidden layers have been tried and the accuracy achieved was low. A CNN has then been developed and tested with different layers and sizes of pool and strides to settle on the final CNN model that has been discussed here. The optimal predicted rectangle is then fed to a robot, ROS simulation of Baxter robot in this case, to perform the actual grasping of the object at the predicted location.


page 1

page 2

page 3

page 4

page 5


Object affordance as a guide for grasp-type recognition

Recognizing human grasping strategies is an important factor in robot te...

Improved GQ-CNN: Deep Learning Model for Planning Robust Grasps

Recent developments in the field of robot grasping have shown great impr...

Associating Grasp Configurations with Hierarchical Features in Convolutional Neural Networks

In this work, we provide a solution for posturing the anthropomorphic Ro...

Including Image-based Perception in Disturbance Observer for Warehouse Drones

Grasping and releasing objects would cause oscillations to delivery dron...

Optimising the Input Image to Improve Visual Relationship Detection

Visual Relationship Detection is defined as, given an image composed of ...

Learning to Grasp 3D Objects using Deep Residual U-Nets

Affordance detection is one of the challenging tasks in robotics because...

Deep Learning of Movement Intent and Reaction Time for EEG-informed Adaptation of Rehabilitation Robots

Mounting evidence suggests that adaptation is a crucial mechanism for re...

Please sign up or login with your details

Forgot password? Click here to reset