Approximate Inverse Reinforcement Learning from Vision-based Imitation Learning

04/17/2020
by   Keuntaek Lee, et al.
0

In this work, we present a method for obtaining an implicit objective function for vision-based navigation. The proposed methodology relies on Imitation Learning, Model Predictive Control (MPC), and Deep Learning. We use Imitation Learning as a means to do Inverse Reinforcement Learning in order to create an approximate costmap generator for a visual navigation challenge. The resulting costmap is used in conjunction with a Model Predictive Controller for real-time control and outperforms other state-of-the-art costmap generators combined with MPC in novel environments. The proposed process allows for simple training and robustness to out-of-sample data. We apply our method to the task of vision-based autonomous driving in multiple real and simulated environments using the same weights for the costmap predictor in all environments.

READ FULL TEXT

page 6

page 7

page 8

research
03/27/2018

Safe end-to-end imitation learning for model predictive control

We propose the use of Bayesian networks, which provide both a mean value...
research
02/21/2022

Vision-based Autonomous Driving for Unstructured Environments Using Imitation Learning

Unstructured environments are difficult for autonomous driving. This is ...
research
10/04/2022

Learning Perception-Aware Agile Flight in Cluttered Environments

Recently, neural control policies have outperformed existing model-based...
research
12/10/2018

Vision-based Navigation with Language-based Assistance via Imitation Learning with Indirect Intervention

We present Vision-based Navigation with Language-based Assistance (VNLA)...
research
09/22/2022

Learning Model Predictive Controllers with Real-Time Attention for Real-World Navigation

Despite decades of research, existing navigation systems still face real...
research
06/15/2021

Causal Navigation by Continuous-time Neural Networks

Imitation learning enables high-fidelity, vision-based learning of polic...
research
04/13/2022

Task-Driven Data Augmentation for Vision-Based Robotic Control

Today's robots often interface data-driven perception and planning model...

Please sign up or login with your details

Forgot password? Click here to reset