Contact Points Discovery for Soft-Body Manipulations with Differentiable Physics

by   Sizhe Li, et al.

Differentiable physics has recently been shown as a powerful tool for solving soft-body manipulation tasks. However, the differentiable physics solver often gets stuck when the initial contact points of the end effectors are sub-optimal or when performing multi-stage tasks that require contact point switching, which often leads to local minima. To address this challenge, we propose a contact point discovery approach (CPDeform) that guides the stand-alone differentiable physics solver to deform various soft-body plasticines. The key idea of our approach is to integrate optimal transport-based contact points discovery into the differentiable physics solver to overcome the local minima from initial contact points or contact switching. On single-stage tasks, our method can automatically find suitable initial contact points based on transport priorities. On complex multi-stage tasks, we can iteratively switch the contact points of end-effectors based on transport priorities. To evaluate the effectiveness of our method, we introduce PlasticineLab-M that extends the existing differentiable physics benchmark PlasticineLab to seven new challenging multi-stage soft-body manipulation tasks. Extensive experimental results suggest that: 1) on multi-stage tasks that are infeasible for the vanilla differentiable physics solver, our approach discovers contact points that efficiently guide the solver to completion; 2) on tasks where the vanilla solver performs sub-optimally or near-optimally, our contact point discovery method performs better than or on par with the manipulation performance obtained with handcrafted contact points.


page 2

page 3

page 5

page 6

page 7

page 18


PlasticineLab: A Soft-Body Manipulation Benchmark with Differentiable Physics

Simulated virtual environments serve as one of the main driving forces b...

Fast and Feature-Complete Differentiable Physics for Articulated Rigid Bodies with Contact

We present a fast and feature-complete differentiable physics engine tha...

Uncertain Pose Estimation during Contact Tasks using Differentiable Contact Features

For many robotic manipulation and contact tasks, it is crucial to accura...

Optimisation of Body-ground Contact for Augmenting Whole-Body Loco-manipulation of Quadruped Robots

Legged robots have great potential to perform loco-manipulation tasks, y...

Learning Tool Morphology for Contact-Rich Manipulation Tasks with Differentiable Simulation

When humans perform contact-rich manipulation tasks, customized tools ar...

Differentiable solver for time-dependent deformation problems with contact

We introduce a general differentiable solver for time-dependent deformat...

One-shot Learning for Autonomous Aerial Manipulation

This paper is concerned with learning transferable contact models for ae...

Please sign up or login with your details

Forgot password? Click here to reset