A deep Q-Learning based Path Planning and Navigation System for Firefighting Environments

by   Manish Bhattarai, et al.

Live fire creates a dynamic, rapidly changing environment that presents a worthy challenge for deep learning and artificial intelligence methodologies to assist firefighters with scene comprehension in maintaining their situational awareness, tracking and relay of important features necessary for key decisions as they tackle these catastrophic events. We propose a deep Q-learning based agent who is immune to stress induced disorientation and anxiety and thus able to make clear decisions for navigation based on the observed and stored facts in live fire environments. As a proof of concept, we imitate structural fire in a gaming engine called Unreal Engine which enables the interaction of the agent with the environment. The agent is trained with a deep Q-learning algorithm based on a set of rewards and penalties as per its actions on the environment. We exploit experience replay to accelerate the learning process and augment the learning of the agent with human-derived experiences. The agent trained under this deep Q-learning approach outperforms agents trained through alternative path planning systems and demonstrates this methodology as a promising foundation on which to build a path planning navigation assistant capable of safely guiding fire fighters through live fire environments.


page 1

page 3

page 4

page 7


Integrating Deep Learning and Augmented Reality to Enhance Situational Awareness in Firefighting Environments

We present a new four-pronged approach to build firefighter's situationa...

Behavior and path planning for the coalition of cognitive robots in smart relocation tasks

In this paper we outline the approach of solving special type of navigat...

A pedestrian path-planning model in accordance with obstacle's danger with reinforcement learning

Most microscopic pedestrian navigation models use the concept of "forces...

QCQP-Tunneling: Ellipsoidal Constrained Agent Navigation

This paper presents a convex-QCQP based novel path planning algorithm na...

An Improved Algorithm of Robot Path Planning in Complex Environment Based on Double DQN

Deep Q Network (DQN) has several limitations when applied in planning a ...

Lightweight Neural Path Planning

Learning-based path planning is becoming a promising robot navigation me...

Waypoint Generation in Row-based Crops with Deep Learning and Contrastive Clustering

The development of precision agriculture has gradually introduced automa...

Please sign up or login with your details

Forgot password? Click here to reset