Cooperative traffic signal control method for multi-intersection:an approach based on spatiotemporal dependence multi-agent reinforcement learning
In the face of increasingly serious traffic congestion,intelligent traffic signal control has become an indispensable means to improve the performance of urban road network.In this paper,a spatiotemporal traffic light control(STLight)based on multi-agent reinforcement learning algorithm is proposed.Through the spatiotemporal dependent module(STDM)based on the attention mechanism,STLight can extract the initial traffic observation data as spatiotemporal features,so as to effectively capture the spatiotemporal dependence relationship between intersections.In addition,based on the extracted spatiotemporal characteristics,STLight further introduces global spatiotemporal information to each agent on the basis of the multi-agent reinforcement learning algorithm based on the centralized training decentralized execution framework,so as to further improve the cooperation ability among multi-agents.The experimental results show that STLight has significant advantages in improving the performance of urban road networks,and helps to alleviate the traffic congestion problem of current large-scale urban road networks.
multi-agent reinforcement learningmulti-intersection traffic signal controlattention mechanismMarkov gamespatiotemporal dependent
国家科技期刊平台
NSTL
万方数据
