The NVIDIA PilotNet Experiments

by   Mariusz Bojarski, et al.

Four years ago, an experimental system known as PilotNet became the first NVIDIA system to steer an autonomous car along a roadway. This system represents a departure from the classical approach for self-driving in which the process is manually decomposed into a series of modules, each performing a different task. In PilotNet, on the other hand, a single deep neural network (DNN) takes pixels as input and produces a desired vehicle trajectory as output; there are no distinct internal modules connected by human-designed interfaces. We believe that handcrafted interfaces ultimately limit performance by restricting information flow through the system and that a learned approach, in combination with other artificial intelligence systems that add redundancy, will lead to better overall performing systems. We continue to conduct research toward that goal. This document describes the PilotNet lane-keeping effort, carried out over the past five years by our NVIDIA PilotNet group in Holmdel, New Jersey. Here we present a snapshot of system status in mid-2020 and highlight some of the work done by the PilotNet group.


page 4

page 5

page 9

page 13

page 18

page 19

page 20

page 23


Preprocessing Methods of Lane Detection and Tracking for Autonomous Driving

In the past few years, researches on advanced driver assistance systems ...

On Evaluation of Embodied Navigation Agents

Skillful mobile operation in three-dimensional environments is a primary...

Data and Knowledge for Overtaking Scenarios in Autonomous Driving

Autonomous driving has become one of the most popular research topics wi...

Vision-based DRL Autonomous Driving Agent with Sim2Real Transfer

To achieve fully autonomous driving, vehicles must be capable of continu...

Experimental Analysis of Trajectory Control Using Computer Vision and Artificial Intelligence for Autonomous Vehicles

Perception of the lane boundaries is crucial for the tasks related to au...

SLAS: Speed and Lane Advisory System for Highway Navigation

This paper proposes a hierarchical autonomous vehicle navigation archite...

Please sign up or login with your details

Forgot password? Click here to reset