Research on regional signal control algorithm based on multi-agent DDQN

Yitao Yu; Tangxiao Yuan; Junshan Xu

doi:10.1117/12.3054542

20 December 2024 Research on regional signal control algorithm based on multi-agent DDQN

Yitao Yu, Tangxiao Yuan, Junshan Xu

Author Affiliations +

Proceedings Volume 13421, Eighth International Conference on Traffic Engineering and Transportation System (ICTETS 2024); 134211E (2024) https://doi.org/10.1117/12.3054542
Event: Eighth International Conference on Traffic Engineering and Transportation System (ICTETS 2024), 2024, Dalian, China

Abstract

Traditional traffic signal timing control and single-intersection control methods face challenges in addressing the complexity and dynamics of modern traffic systems. Methods such as Discrete Traffic State Code(DSTE) and image-like approaches have been employed to address difficulties in setting the state space. This paper introduces a multi-agent deep reinforcement learning algorithm based on the Double Deep Q-Network (DDQN) and proposes a state space setting approach utilizing one-hot coding to effectively reduce data dimensionality. By leveraging collaborative multi-agent reinforcement learning methods and "local centralization" strategies, issues such as dimensionality explosion and unstable training are successfully mitigated. To assess the algorithm's performance, a road network model was constructed using SUMO, demonstrating a 22% reduction in waiting time compared to the original algorithm. The results confirm that the regional signal control model and methodology presented in this paper can significantly decrease regional traffic delays and enhance the traffic efficiency of the road network.

(2024) Published by SPIE. Downloading of the abstract is permitted for personal use only.

Citation Download Citation

Yitao Yu, Tangxiao Yuan, and Junshan Xu "Research on regional signal control algorithm based on multi-agent DDQN", Proc. SPIE 13421, Eighth International Conference on Traffic Engineering and Transportation System (ICTETS 2024), 134211E (20 December 2024); https://doi.org/10.1117/12.3054542

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

;

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE