Human Motion Control of Quadrupedal Robots using Deep Reinforcement Learning

by   Sunwoo Kim, et al.

A motion-based control interface promises flexible robot operations in dangerous environments by combining user intuitions with the robot's motor capabilities. However, designing a motion interface for non-humanoid robots, such as quadrupeds or hexapods, is not straightforward because different dynamics and control strategies govern their movements. We propose a novel motion control system that allows a human user to operate various motor tasks seamlessly on a quadrupedal robot. We first retarget the captured human motion into the corresponding robot motion with proper semantics using supervised learning and post-processing techniques. Then we apply the motion imitation learning with curriculum learning to develop a control policy that can track the given retargeted reference. We further improve the performance of both motion retargeting and motion imitation by training a set of experts. As we demonstrate, a user can execute various motor tasks using our system, including standing, sitting, tilting, manipulating, walking, and turning, on simulated and real quadrupeds. We also conduct a set of studies to analyze the performance gain induced by each component.


page 1

page 7

page 8

page 9


From Knowing to Doing: Learning Diverse Motor Skills through Instruction Learning

Recent years have witnessed many successful trials in the robot learning...

Adaptive Learning based Upper-Limb Rehabilitation Training System with Collaborative Robot

Rehabilitation training for patients with motor disabilities usually req...

Toward a Framework for Adaptive Impedance Control of an Upper-limb Prosthesis

This paper describes a novel framework for a human-machine interface tha...

Learning a Single Policy for Diverse Behaviors on a Quadrupedal Robot using Scalable Motion Imitation

Learning various motor skills for quadrupedal robots is a challenging pr...

Deep Visual Foresight for Planning Robot Motion

A key challenge in scaling up robot learning to many skills and environm...

Imitation and Adaptation Based on Consistency: A Quadruped Robot Imitates Animals from Videos Using Deep Reinforcement Learning

The essence of quadrupeds' movements is the movement of the center of gr...

Self-Imitation Learning of Locomotion Movements through Termination Curriculum

Animation and machine learning research have shown great advancements in...

Please sign up or login with your details

Forgot password? Click here to reset