Deep Q-network-based traffic signal control models

PLoS One. 2021 Sep 2;16(9):e0256405. doi: 10.1371/journal.pone.0256405. eCollection 2021.

Abstract

Traffic congestion has become common in urban areas worldwide. To solve this problem, the method of searching a solution using artificial intelligence has recently attracted widespread attention because it can solve complex problems such as traffic signal control. This study developed two traffic signal control models using reinforcement learning and a microscopic simulation-based evaluation for an isolated intersection and two coordinated intersections. To develop these models, a deep Q-network (DQN) was used, which is a promising reinforcement learning algorithm. The performance was evaluated by comparing the developed traffic signal control models in this research with the fixed-time signal optimized by Synchro model, which is a traffic signal optimization model. The evaluation showed that the developed traffic signal control model of the isolated intersection was validated, and the coordination of intersections was superior to that of the fixed-time signal control method.

Publication types

  • Research Support, Non-U.S. Gov't

MeSH terms

  • Automobile Driving
  • Computer Simulation
  • Humans
  • Motor Vehicles / statistics & numerical data*
  • Neural Networks, Computer*

Grants and funding

This study was partially supported by Korea Institute of Police Technology (KIPoT) grant funded by the Korea government (KNPA) (No. 092021C29S01000) and by the Basic Science Research Program through the National Research Foundation of Korea (NRF), funded by the Ministry of Education (NRF-2020R1I1A1A01072166). There was no additional external funding received for this study.