Adaptive Frequency Green Light Optimal Speed Advisory based on Hybrid Actor-Critic Reinforcement Learning

by   Ming Xu, et al.

Green Light Optimal Speed Advisory (GLOSA) system suggests speeds to vehicles to assist them in passing through intersections during green intervals, thus reducing traffic congestion and fuel consumption by minimizing the number of stops and idle times at intersections. However, previous research has focused on optimizing the GLOSA algorithm, neglecting the frequency of speed advisory by the GLOSA system. Specifically, some studies provide speed advisory profile at each decision step, resulting in redundant advisory, while others calculate the optimal speed for the vehicle only once, which cannot adapt to dynamic traffic. In this paper, we propose an Adaptive Frequency GLOSA (AF-GLOSA) model based on Hybrid Proximal Policy Optimization (H-PPO), which employs an actor-critic architecture with a hybrid actor network. The hybrid actor network consists of a discrete actor that outputs advisory frequency and a continuous actor that outputs acceleration profiles. Additionally, we design a novel reward function that considers both travel efficiency and fuel consumption. The AF-GLOSA model is evaluated in comparison to traditional GLOSA and learning-based GLOSA methods in a three-lane intersection with a traffic signal in SUMO, under three different levels of traffic density. The results demonstrate that the AF-GLOSA model performs best in reducing average stop times, fuel consumption and CO2 emissions.


Hybrid Actor-Critic Reinforcement Learning in Parameterized Action Space

In this paper we propose a hybrid architecture of actor-critic algorithm...

CVLight: Deep Reinforcement Learning for Adaptive Traffic Signal Control with Connected Vehicles

This paper develops a reinforcement learning (RL) scheme for adaptive tr...

Partially Detected Intelligent Traffic Signal Control: Environmental Adaptation

Partially Detected Intelligent Traffic Signal Control (PD-ITSC) systems ...

Adversarially Guided Actor-Critic

Despite definite success in deep reinforcement learning problems, actor-...

FeSAC: Federated Learning-Based Soft Actor-Critic Traffic Offloading in Space-Air-Ground Integrated Network

With the increase of intelligent devices leading to increasing demand fo...

Speed Optimization In Unplanned Traffic Using Bio-Inspired Computing And Population Knowledge Base

Bio-Inspired Algorithms on Road Traffic Congestion and safety is a very ...

Please sign up or login with your details

Forgot password? Click here to reset