可编程数据平面下基于DDPG的路由优化方法

针对于数据中心网络不均衡的流量分布,和在使用固定功能交换机的软件定义网络中部署强化学习模型时,不能精确感知网络状态导致的路由决策偏差问题,设计了一种在具有可编程数据平面的软件定义网络中,基于深度确定性策略梯度(DDPG)强化学习模型的路由优化方法.通过在可编程数据平面自定义数据包处理逻辑,获取细粒度、高精度的网络状态参...

Routing Optimization Method Based on DDPG and Programmable Data Plane

For uneven flow distribution in the data center network, and the routing decision bias caused by inaccurate network status measurement when deploying the reinforcement learning model in software-defined networks（SDN） with fixed function switches, a routing optimization method based on deep deterministic policy gradient（DDPG） model of reinforcement learning and SDN with programmable data plane is proposed. By customizing the packet processing logic on the programmable data plane, the fine-grained and high-precision network state parameters are obtained, and the link weights of multiple alternative paths are determined according to the network state parameters using the DDPG model on the control plane. The routing path with the maximum residual load capacity is selected for the data flow, and the flow table is issued in the way of source routing. The experimental results show that the proposed method can improve the network throughput and link utilization, and reduce the end-to-end transmission delay and southbound communication overhead.