Towards vision-based robotic skins: a data-driven, multi-camera tactile sensor

10/31/2019
by   Camill Trueeb, et al.
7

This paper describes the design of a multi-camera optical tactile sensor that provides information about the contact force distribution applied to its soft surface. This information is contained in the motion of spherical particles spread within the surface, which deforms when subject to force. The small embedded cameras capture images of the different particle patterns that are then mapped to the three-dimensional contact force distribution through a machine learning architecture. The design proposed in this paper exhibits a larger contact surface and a thinner structure than most of the existing camera-based tactile sensors, without the use of additional reflecting components such as mirrors. A modular implementation of the learning architecture is discussed that facilitates the scalability to larger surfaces such as robotic skins.

READ FULL TEXT

page 1

page 2

page 4

research
12/21/2020

Sim-to-real for high-resolution optical tactile sensing: From images to 3D contact force distributions

The images captured by vision-based tactile sensors carry information ab...
research
01/08/2013

A novel processing pipeline for optical multi-touch surfaces

In this thesis a new approach for touch detection on optical multi-touch...
research
11/10/2021

A soft thumb-sized vision-based sensor with accurate all-round force perception

Vision-based haptic sensors have emerged as a promising approach to robo...
research
08/25/2023

WSTac: Interactive Surface Perception based on Whisker-Inspired and Self-Illuminated Vision-Based Tactile Sensor

Modern Visual-Based Tactile Sensors (VBTSs) use cost-effective cameras t...
research
06/07/2021

Traction chain networks: Insights beyond force chain networks for non-spherical particle systems

Force chain networks are generally applied in granular materials to gain...
research
09/29/2021

Towards a Pantograph-based Interventional AUV for Under-ice Measurement

This paper addresses the design of a novel interventional robotic platfo...
research
03/05/2020

Learning the sense of touch in simulation: a sim-to-real strategy for vision-based tactile sensing

Data-driven approaches to tactile sensing aim to overcome the complexity...

Please sign up or login with your details

Forgot password? Click here to reset