Rotational Slippage Prediction from Segmentation of Tactile Images

by   Julio Castaño-Amoros, et al.

Adding tactile sensors to a robotic system is becoming a common practice to achieve more complex manipulation skills than those robotics systems that only use external cameras to manipulate objects. The key of tactile sensors is that they provide extra information about the physical properties of the grasping. In this paper, we implemented a system to predict and quantify the rotational slippage of objects in hand using the vision-based tactile sensor known as Digit. Our system comprises a neural network that obtains the segmented contact region (object-sensor), to later calculate the slippage rotation angle from this region using a thinning algorithm. Besides, we created our own tactile segmentation dataset, which is the first one in the literature as far as we are concerned, to train and evaluate our neural network, obtaining results of 95 and 91 able to predict rotational slippage with a maximum mean rotational error of 3 degrees with previously unseen objects. Thus, our system can be used to prevent an object from falling due to its slippage.


Towards Learning to Detect and Predict Contact Events on Vision-based Tactile Sensors

In essence, successful grasp boils down to correct responses to multiple...

Tactile-Filter: Interactive Tactile Perception for Part Mating

Humans rely on touch and tactile sensing for a lot of dexterous manipula...

Collision-aware In-hand 6D Object Pose Estimation using Multiple Vision-based Tactile Sensors

In this paper, we address the problem of estimating the in-hand 6D pose ...

Multi-Modal Geometric Learning for Grasping and Manipulation

This work provides an architecture that incorporates depth and tactile i...

Object recognition for robotics from tactile time series data utilising different neural network architectures

Robots need to exploit high-quality information on grasped objects to in...

Placing by Touching: An empirical study on the importance of tactile sensing for precise object placing

Tactile sensors are promising tools for endowing robots with embodied in...

Please sign up or login with your details

Forgot password? Click here to reset