Synthesis and Execution of Communicative Robotic Movements with Generative Adversarial Networks

03/29/2022
by   Luca Garello, et al.
22

Object manipulation is a natural activity we perform every day. How humans handle objects can communicate not only the willfulness of the acting, or key aspects of the context where we operate, but also the properties of the objects involved, without any need for explicit verbal description. Since human intelligence comprises the ability to read the context, allowing robots to perform actions that intuitively convey this kind of information would greatly facilitate collaboration. In this work, we focus on how to transfer on two different robotic platforms the same kinematics modulation that humans adopt when manipulating delicate objects, aiming to endow robots with the capability to show carefulness in their movements. We choose to modulate the velocity profile adopted by the robots' end-effector, inspired by what humans do when transporting objects with different characteristics. We exploit a novel Generative Adversarial Network architecture, trained with human kinematics examples, to generalize over them and generate new and meaningful velocity profiles, either associated with careful or not careful attitudes. This approach would allow next generation robots to select the most appropriate style of movement, depending on the perceived context, and autonomously generate their motor action execution.

READ FULL TEXT

page 1

page 3

research
06/08/2021

Property-Aware Robot Object Manipulation: a Generative Approach

When transporting an object, we unconsciously adapt our movement to its ...
research
10/24/2022

If You Are Careful, So Am I! How Robot Communicative Motions Can Influence Human Approach in a Joint Task

As humans, we have a remarkable capacity for reading the characteristics...
research
08/03/2022

Robots with Different Embodiments Can Express and Influence Carefulness in Object Manipulation

Humans have an extraordinary ability to communicate and read the propert...
research
09/01/2021

From Movement Kinematics to Object Properties: Online Recognition of Human Carefulness

When manipulating objects, humans finely adapt their motions to the char...
research
03/02/2021

Careful with That! Observation of Human Movements to Estimate Objects Properties

Humans are very effective at interpreting subtle properties of the partn...
research
04/16/2018

Defo-Net: Learning Body Deformation using Generative Adversarial Networks

Modelling the physical properties of everyday objects is a fundamental p...
research
11/15/2022

Simulated Mental Imagery for Robotic Task Planning

Traditional AI-planning methods for task planning in robotics require sy...

Please sign up or login with your details

Forgot password? Click here to reset