August 2023

Conference Paper

Traffic Signal Optimization by Integrating Reinforcement Learning and Digital Twins

By:
Kumarasamy, Vijayalakshmi; Saroj, Abhilasha J; Liang, Yu; Wu, Dalei; Hunter, Michael; Guin, Angshuman; Sartipi, Mina
Page Number:
1-8
Book Title:
2023 IEEE Smart World Congress (SWC)
Publication Date:
August 2023
Publisher Location:
IEEE, New Jersey, United States of America
Conference Name:
2023 IEEE Smart World Congress (SWC)
Conference Location:
Portsmouth, United Kingdom
Conference Sponsor:
VTO
View DOI Listing:
https://doi.org/10.1109/SWC57546.2023.10448974

Abstract

Machine learning (ML) methods, especially reinforcement learning (RL), have been widely considered for traffic signal optimization in intelligent transportation systems. Most of these ML methods are centralized, lacking in scalability and adaptability in large traffic networks. Further, it is challenging to train such ML models due to the lack of training platforms and/or the cost of deploying and training in a real traffic networks. This paper presents an approach for the integration of decentralized graph-based multi-agent reinforcement learning (DGMARL) with a Digital Twin (DT) to optimize traffic signals for the reduction of traffic congestion and network-wide fuel consumption related to stopping. Specifically, the DGMARL agents learn traffic state patterns and make decisions regarding traffic signal control with assistance from a Digital Twin module, which simulates and replicates the traffic behaviors of a real traffic network. The proposed approach was evaluated using PTV-Vissim [1], a microscopic traffic simulation platform. PTV-Vissim is also the simulation engine of the DT, enabling emulation and optimization of the traffic signals on the MLK Smart Corridor in Chattanooga, Tennessee. Compared to an actuated signal control baseline approach, experiment results show that Eco_PI, a developed performance measure capturing the impact of stops on fuel consumption, was reduced by 44.27% in a 24-hour and an average of 29.88% in a PM-peak-hour scenario.


Related Researchers