Learning to Detect Slip through Tactile Measures of the Contact Force Field and its Entropy

by   Xiaohai Hu, et al.

Detection of slip during object grasping and manipulation plays a vital role in object handling. Existing solutions largely depend on visual information to devise a strategy for grasping. Nonetheless, in order to achieve proficiency akin to humans and achieve consistent grasping and manipulation of unfamiliar objects, the incorporation of artificial tactile sensing has become a necessity in robotic systems. In this work, we propose a novel physics-informed, data-driven method to detect slip continuously in real time. The GelSight Mini, an optical tactile sensor, is mounted on custom grippers to acquire tactile readings. Our work leverages the inhomogeneity of tactile sensor readings during slip events to develop distinctive features and formulates slip detection as a classification problem. To evaluate our approach, we test multiple data-driven models on 10 common objects under different loading conditions, textures, and materials. Our results show that the best classification algorithm achieves an average accuracy of 99 the application of this work in a dynamic robotic manipulation task in which real-time slip detection and prevention algorithm is implemented.


page 1

page 2

page 3

page 6


Slip Detection with Combined Tactile and Visual Information

Slip detection plays a vital role in robotic manipulation and it has lon...

Leveraging distributed contact force measurements for slip detection: a physics-based approach enabled by a data-driven tactile sensor

Grasping objects whose physical properties are unknown is still a great ...

Visual-tactile sensing for Real-time liquid Volume Estimation in Grasping

We propose a deep visuo-tactile model for realtime estimation of the liq...

DenseTact-Mini: An Optical Tactile Sensor for Grasping Multi-Scale Objects From Flat Surfaces

Dexterous manipulation, especially of small daily objects, continues to ...

Neuromorphic Event-Based Slip Detection and suppression in Robotic Grasping and Manipulation

Slip detection is essential for robots to make robust grasping and fine ...

Real-Time Marker Localization Learning for GelStereo Tactile Sensing

Visuotactile sensing technology is becoming more popular in tactile sens...

Deep Instance Segmentation and Visual Servoing to Play Jenga with a Cost-Effective Robotic System

The game of Jenga represents an inspiring benchmark for developing innov...

Please sign up or login with your details

Forgot password? Click here to reset