Deep reinforcement learning-based dynamic green wave control strategy

Hualong Zhang; Na Ren; Qi Wang

doi:10.1117/12.3054569

20 December 2024 Deep reinforcement learning-based dynamic green wave control strategy

Hualong Zhang, Na Ren, Qi Wang

Author Affiliations +

Proceedings Volume 13421, Eighth International Conference on Traffic Engineering and Transportation System (ICTETS 2024); 134212G (2024) https://doi.org/10.1117/12.3054569
Event: Eighth International Conference on Traffic Engineering and Transportation System (ICTETS 2024), 2024, Dalian, China

Abstract

The complexity of the existing urban road network is high, and the cost of coordinated control of the entire road network with green waves is high, green wave sections are now widely used in cities. Therefore, aiming at the limitations of traditional green wave control methods, this paper proposes a dynamic green wave coordinated control model based on DQN, which aims to optimize the traffic efficiency of green wave sections in urban road networks. Deep reinforcement learning technology is used. In the model, the intelligent body (intersection) realizes real-time perception and response to the dynamic traffic environment by learning the experience of traffic condition and historical decision making. By optimizing the phase difference and public signal period, the model is able to carry out intelligent green wave coordinated control of urban arterial roads under different time periods, traffic flows and bus demand conditions. Finally, simulations are created using SUMO to validate the offline coordinated control scheme, genetic algorithm and dynamic model proposed in this paper. The simulation results show that the dynamic control model coordinated with the green wave reduces the average vehicle deceleration by 27.8% and 8.3%, the lane occupancy by 50.8% and 44.8%, and the total number of starts and stops by 54.3% and 49% reduced upside direction compared to the two schemes. In the downstream direction, there was a reduction in average delay by 23.6% and 6.6% respectively, lane occupancy by 27.9% and 2.3%, and total starts and stops by 38.7% and 17.5%.

(2024) Published by SPIE. Downloading of the abstract is permitted for personal use only.

Citation Download Citation

Hualong Zhang, Na Ren, and Qi Wang "Deep reinforcement learning-based dynamic green wave control strategy", Proc. SPIE 13421, Eighth International Conference on Traffic Engineering and Transportation System (ICTETS 2024), 134212G (20 December 2024); https://doi.org/10.1117/12.3054569

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

;

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $17.00

Non-members: $21.00 ADD TO CART

PROCEEDINGS
6 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY

GET CITATION

RIGHTS & PERMISSIONS

Get copyright permission Get copyright permission on Copyright Marketplace

KEYWORDS

Roads

Control systems

Deep learning

Mathematical optimization

Machine learning

Simulations

Transportation

Show All Keywords

Keywords/Phrases

Search In:

Publication Years