Bayesian and Neural Inference on LSTM-based Object Recognition from Tactile and Kinesthetic Information

by   Francisco Pastor, et al.

Recent advances in the field of intelligent robotic manipulation pursue providing robotic hands with touch sensitivity. Haptic perception encompasses the sensing modalities encountered in the sense of touch (e.g., tactile and kinesthetic sensations). This letter focuses on multimodal object recognition and proposes analytical and data-driven methodologies to fuse tactile- and kinesthetic-based classification results. The procedure is as follows: a three-finger actuated gripper with an integrated high-resolution tactile sensor performs squeeze-and-release Exploratory Procedures (EPs). The tactile images and kinesthetic information acquired using angular sensors on the finger joints constitute the time-series datasets of interest. Each temporal dataset is fed to a Long Short-term Memory (LSTM) Neural Network, which is trained to classify in-hand objects. The LSTMs provide an estimation of the posterior probability of each object given the corresponding measurements, which after fusion allows to estimate the object through Bayesian and Neural inference approaches. An experiment with 36-classes is carried out to evaluate and compare the performance of the fused, tactile, and kinesthetic perception systems.The results show that the Bayesian-based classifiers improves capabilities for object recognition and outperforms the Neural-based approach.


page 1

page 3

page 5

page 6


Object recognition for robotics from tactile time series data utilising different neural network architectures

Robots need to exploit high-quality information on grasped objects to in...

CNN-based Methods for Object Recognition with High-Resolution Tactile Sensors

Novel high-resolution pressure-sensor arrays allow treating pressure rea...

Simple Kinesthetic Haptics for Object Recognition

Object recognition is an essential capability when performing various ta...

Object Recognition from Short Videos for Robotic Perception

Deep neural networks have become the primary learning technique for obje...

iCLAP: Shape Recognition by Combining Proprioception and Touch Sensing

For humans, both the proprioception and touch sensing are highly utilize...

E-TRoll: Tactile Sensing and Classification via A Simple Robotic Gripper for Extended Rolling Manipulations

Robotic tactile sensing provides a method of recognizing objects and the...

TactileSGNet: A Spiking Graph Neural Network for Event-based Tactile Object Recognition

Tactile perception is crucial for a variety of robot tasks including gra...

Please sign up or login with your details

Forgot password? Click here to reset