Saving the Limping: Fault-tolerant Quadruped Locomotion via Reinforcement Learning

10/02/2022
by   Dikai Liu, et al.
0

Quadruped locomotion now has acquired the skill to traverse or even sprint on uneven terrains in remote uncontrolled environment. However, surviving in the wild requires not only the maneuverability, but also the ability to handle unexpected hardware failures. We present the first deep reinforcement learning based methodology to train fault-tolerant controllers, which can bring an injured quadruped back home safely and speedily. We adopt the teacher-student framework to train the controller with close-to-reality joint-locking failure in the simulation, which can be zero-shot transferred to the physical robot without any fine-tuning. Extensive simulation and real-world experiments demonstrate that our fault-tolerant controller can efficiently lead a quadruped stably when it faces joint failure during locomotion.

READ FULL TEXT

page 1

page 4

page 6

research
11/19/2021

Reinforcement Learning with Adaptive Curriculum Dynamics Randomization for Fault-Tolerant Robot Control

This study is aimed at addressing the problem of fault tolerance of quad...
research
08/10/2020

Comparison of Model Predictive and Reinforcement Learning Methods for Fault Tolerant Control

A desirable property in fault-tolerant controllers is adaptability to sy...
research
04/08/2022

Sim-to-Real Learning of Robust Compliant Bipedal Locomotion on Torque Sensor-Less Gear-Driven Humanoid

In deep reinforcement learning, sim-to-real is the mainstream method as ...
research
02/16/2022

Soft Actor-Critic Deep Reinforcement Learning for Fault Tolerant Flight Control

Fault-tolerant flight control faces challenges, as developing a model-ba...
research
03/06/2023

Learning Humanoid Locomotion with Transformers

We present a sim-to-real learning-based approach for real-world humanoid...
research
11/11/2020

Zero-Shot Terrain Generalization for Visual Locomotion Policies

Legged robots have unparalleled mobility on unstructured terrains. Howev...
research
09/27/2021

Nonlinear MPC for Quadrotor Fault-Tolerant Control

The mechanical simplicity, hover capabilities, and high agility of quadr...

Please sign up or login with your details

Forgot password? Click here to reset