Training Robots without Robots: Deep Imitation Learning for Master-to-Robot Policy Transfer

02/19/2022
by   Heecheol Kim, et al.
0

Deep imitation learning is a promising method for dexterous robot manipulation because it only requires demonstration samples for learning manipulation skills. In this paper, deep imitation learning is applied to tasks that require force feedback, such as bottle opening. However, simple visual feedback systems, such as teleoperation, cannot be applied because they do not provide force feedback to operators. Bilateral teleoperation has been used for demonstration with force feedback; however, this requires an expensive and complex bilateral robot system. In this paper, a new master-to-robot (M2R) transfer learning system is presented that does not require robots but can still teach dexterous force feedback-based manipulation tasks to robots. The human directly demonstrates a task using a low-cost controller that resembles the kinematic parameters of the robot arm. Using this controller, the operator can naturally feel the force feedback without any expensive bilateral system. Furthermore, the M2R transfer system can overcome domain gaps between the master and robot using the gaze-based imitation learning framework and a simple calibration method. To demonstrate this, the proposed system was evaluated on a bottle-cap-opening task that requires force feedback only for the master demonstration.

READ FULL TEXT

page 1

page 2

page 3

page 4

page 6

research
02/10/2022

Memory-based gaze prediction in deep imitation learning for robot manipulation

Deep imitation learning is a promising approach that does not require ha...
research
01/22/2023

Immersive Demonstrations are the Key to Imitation Learning

Achieving successful robotic manipulation is an essential step towards r...
research
11/06/2022

Leveraging Haptic Feedback to Improve Data Quality and Quantity for Deep Imitation Learning Models

Learning from demonstration (LfD) is a proven technique to teach robots ...
research
03/16/2021

A New Autoregressive Neural Network Model with Command Compensation for Imitation Learning Based on Bilateral Control

In the near future, robots are expected to work with humans or operate a...
research
09/20/2023

Cloud-Based Hierarchical Imitation Learning for Scalable Transfer of Construction Skills from Human Workers to Assisting Robots

Assigning repetitive and physically-demanding construction tasks to robo...
research
02/02/2021

Gaze-based dual resolution deep imitation learning for high-precision dexterous robot manipulation

A high-precision manipulation task, such as needle threading, is challen...
research
03/13/2019

Cleaning tasks knowledge transfer between heterogeneous robots: a deep learning approach

Nowadays, autonomous service robots are becoming an important topic in r...

Please sign up or login with your details

Forgot password? Click here to reset