Robust Shape Estimation for 3D Deformable Object Manipulation

09/26/2018
by   Tao Han, et al.
0

Existing shape estimation methods for deformable object manipulation suffer from the drawbacks of being off-line, model dependent, noise-sensitive or occlusion-sensitive, and thus are not appropriate for manipulation tasks requiring high precision. In this paper, we present a real-time shape estimation approach for autonomous robotic manipulation of 3D deformable objects. Our method fulfills all the requirements necessary for the high-quality deformable object manipulation in terms of being real-time, model-free and robust to noise and occlusion. These advantages are accomplished using a joint tracking and reconstruction framework, in which we track the object deformation by aligning a reference shape model with the stream input from the RGB-D camera, and simultaneously upgrade the reference shape model according to the newly captured RGB-D data. We have evaluated the quality and robustness of our real-time shape estimation pipeline on a set of deformable manipulation tasks implemented on physical robots. Videos are available at https://lifeisfantastic.github.io/DeformShapeEst/

READ FULL TEXT

page 2

page 3

page 6

page 7

research
11/09/2022

ViSE: Vision-Based 3D Real-Time Shape Estimation of Continuously Deformable Robots

The precise control of soft and continuum robots requires knowledge of t...
research
01/18/2023

HMDO: Markerless Multi-view Hand Manipulation Capture with Deformable Objects

We construct the first markerless deformable interaction dataset recordi...
research
04/10/2020

Shape Estimation for Elongated Deformable Object using B-spline Chained Multiple Random Matrices Model

In this paper, a B-spline chained multiple random matrices representatio...
research
05/31/2023

Neural Textured Deformable Meshes for Robust Analysis-by-Synthesis

Human vision demonstrates higher robustness than current AI algorithms u...
research
06/06/2023

Learning to Simulate Tree-Branch Dynamics for Manipulation

We propose to use a simulation driven inverse inference approach to mode...
research
11/21/2017

Dynamic High Resolution Deformable Articulated Tracking

The last several years have seen significant progress in using depth cam...
research
03/22/2022

Semantic State Estimation in Cloth Manipulation Tasks

Understanding of deformable object manipulations such as textiles is a c...

Please sign up or login with your details

Forgot password? Click here to reset