大规模智慧交通信号控制中的强化学习和深度强化学习方法综述

当前在交通信号控制系统中引入智能化检测和控制已是大势所趋，特别是强化学习和深度强化学习方法在可扩展性、稳定性和可推广性等方面展现出巨大的技术优势，已成为该领域的研究热点。针对基于强化学习的交通信号控制任务进行了研究，在广泛调研交通信号控制方法研究成果的基础上，系统地梳理了强化学习和深度强化学习在智慧交通信号控制领域的分类及应用；并归纳了使用多智能体合作的方法解决大规模交通信号控制问题的可行方案，对大规模交通信号控制的交通场景影响因素进行了分类概述；从提高交通信号控制器性能的角度提出了本领域当前所面临的挑战和未来可能极具潜力的研究方向。

Review of reinforcement learning and deep reinforcement learning methods in large-scale intelligent traffic signal control

At present, it is a general trend to introduce intelligent detection and control into traffic signal control system, especially reinforcement learning and deep reinforcement learning methods show great technical advantages in scalability, stability and extensibility, and have become a research hotspot in this field. This paper studied traffic signal control tasks based on reinforcement learning, systematically sorted out the classification and application of reinforcement learning and deep reinforcement learning in the field of intelligent traffic signal control on the basis of extensive research results on traffic signal control methods, and summarized feasible solutions to large-scale traffic signal control problems by using multi-agent cooperation. This paper classified and summarized the factors affecting the traffic scene of large-scale traffic signal control, put forward the current challenges and potential research directions in this field from the perspective of improving the performance of traffic signal controllers.