To Stir or Not to Stir: Online Estimation of Liquid Properties for Pouring Actions

by   Tatiana Lopez-Guevara, et al.

Our brains are able to exploit coarse physical models of fluids to solve everyday manipulation tasks. There has been considerable interest in developing such a capability in robots so that they can autonomously manipulate fluids adapting to different conditions. In this paper, we investigate the problem of adaptation to liquids with different characteristics. We develop a simple calibration task (stirring with a stick) that enables rapid inference of the parameters of the liquid from RBG data. We perform the inference in the space of simulation parameters rather than on physically accurate parameters. This facilitates prediction and optimization tasks since the inferred parameters may be fed directly to the simulator. We demonstrate that our "stirring" learner performs better than when the robot is calibrated with pouring actions. We show that our method is able to infer properties of three different liquids -- water, glycerin and gel -- and present experimental results by executing stirring and pouring actions on a UR10. We believe that decoupling of the training actions from the goal task is an important step towards simple, autonomous learning of the behavior of different fluids in unstructured environments.


page 1

page 2

page 3

page 4

page 5


Manipulation-Oriented Object Perception in Clutter through Affordance Coordinate Frames

In order to enable robust operation in unstructured environments, robots...

Robust Planning for Multi-stage Forceful Manipulation

Multi-step forceful manipulation tasks, such as opening a push-and-twist...

Online Replanning in Belief Space for Partially Observable Task and Motion Problems

To solve multi-step manipulation tasks in the real world, an autonomous ...

Detecting Features of Tools, Objects, and Actions from Effects in a Robot using Deep Learning

We propose a tool-use model that can detect the features of tools, targe...

Perceiving and Reasoning About Liquids Using Fully Convolutional Networks

Liquids are an important part of many common manipulation tasks in human...

Shared Autonomy with Learned Latent Actions

Assistive robots enable people with disabilities to conduct everyday tas...

Independently Controllable Features

Finding features that disentangle the different causes of variation in r...

Please sign up or login with your details

Forgot password? Click here to reset