基于强化学习的旋翼无人机智能追踪方法

针对旋翼无人机追踪场景中常用的PID控制方法与视觉伺服控制方法的不足，该文尝试将视觉伺服控制与强化学习结合，提出了一种基于强化学习的旋翼无人机智能追踪方法。首先使用基于图像的视觉伺服实现旋翼无人机的闭环控制，然后建立使用Sarsa学习算法调节伺服增益的强化学习模型，通过训练可以使得旋翼无人机自主选择视觉伺服增益。该文设计了旋翼无人机在实物场景与仿真场景下的运动目标追踪实验，实验结果论证了该方法相对于PID控制与基于图像的视觉伺服控制方法具有更好的追踪效果。

An Intelligent Tracking Method of Rotor UAV Based on Reinforcement Learning

Aiming at the deficiencies of PID control method and visual servo control method commonly used in the tracking scene of Rotor UAV(unmanned aerial vehicle), this paper attempts to combine visual servo control with reinforcement learning, and proposes an intelligent tracking method for Rotor UAV based on reinforcement learning. Firstly, image-based visual servo is used to track the closed-loop control of the Rotor UAV, and then a reinforcement learning model is established to adjust the servo gain with Sarsa learning algorithm. After many training sessions, the Rotor UAV can choose its own visual servo gain. In this paper, the experiment of tracking the moving target of Rotor UAV in physical and simulation scenarios is designed. The experimental results demonstrate that the proposed method has better tracking effect than PID control and classical image-based visual servo control method.