Image Based and Hybrid Visual Servo Control of an Unmanned Aerial Vehicle

The use of unmanned aerial vehicles (UAVs) for military, scientific, and civilian sectors are increasing drastically in recent years. This study presents algorithms for the visual-servo control of an UAV, in which a quadrotor helicopter has been stabilized with visual information through the control loop. Unlike previous study that use pose estimation approach which is time consuming and subject to various errors, the visual-servo control is more reliable and fast. The method requires a camera on-board the vehicle, which is already available on various UAV systems. The UAV with a camera behaves like an eye-in-hand visual servoing system. In this study the controller was designed by using two different approaches; image based visual servo control method and hybrid visual servo control method. Various simulations are developed on Matlab, in which the quadrotor aerial vehicle has been visual-servo controlled. In order to show the effectiveness of the algorithms, experiments were performed on a model quadrotor UAV, which suggest successful performance.     

四旋翼无人机可视化轨迹跟踪仿真系统

为了便于对四旋翼无人机控制算法进行实验仿真和验证,联合Solidworks和Matlab/SimMechanics工具箱设计了一种四旋翼无人机可视化轨迹跟踪仿真系统;利用Solidworks搭建了四旋翼无人机三维实体模型,并通过Solidworks和Matlab转换接口将该实体模型导入到Matlab/SimMechanics中;Matlab/SimMechanics提供了了三维可视化窗口,可以显示无人机的实时仿真状态;仿真平台在Matlab/SimMechanics环境中实现,与Matlab/Simulink通信方便,可方便的将Simulink设计好的控制算法添加到仿真系统中,以进行验证和参数整定,还具有姿态分析和数据分析等功能;轨迹跟踪仿真结果表明,四旋翼无人机可视化轨迹跟踪仿真系统直观可视,准确可靠,能较好地对控制算法进行研究和测试,对四旋翼无人机以及控制算法的研究和开发具有重要价值。     

带时延补偿的视觉跟踪控制

在实际的视觉伺服系统中, 由于摄像机到图像处理设备的传输延迟和图像处理本身占用的时间, 视觉信息的获取会产生时延. 对此, 给出了一个带有时延补偿的视觉跟踪控制方法. 通过实时拟合图像雅可比矩阵, 实现了对机械手末端执行器图像特征信息的实时预测, 从而减小了估计误差. 在此基础上, 设计了一个带有时延补偿的控制方案. 通过对运动目标进行跟踪的仿真实验, 验证了本文时延补偿方法的有效性.     

基于Adept机器人的视觉伺服控制系统

机器人视觉伺服控制在理论和应用等方面还有许多问题需要研究,例如特征选择、系统标定和伺服控制算法等.针对Adept机器人,提出了一种简单快速的不需要精确标定摄像机内外部参数的摄像机标定方法,完成了从被观测物体表面所在的视觉平面坐标系到机器人基坐标系的坐标变换.使用图像的全局特征,即图像矩特征进行伺服跟踪;利用所推导的图像雅可比矩阵,设计了由图像反馈与目标运动自适应补偿组成的视觉伺服控制器.将算法对静态目标的定位实验进行了验证,然后又将其应用到移动目标的跟踪上,通过调节和优选控制参数,实现了稳定的伺服跟踪和抓取.实验结果表明采用图像矩作为图像特征能够避免复杂的特征匹配过程,并且能够获得较好的跟踪精度.     

四旋翼无人机抗干扰轨迹跟踪控制

针对四旋翼无人机轨迹跟踪过程中存在的参数不确定与外界干扰问题,设计一种双闭环自适应控制策略.为了降低控制器设计复杂度,根据四旋翼无人机系统的欠驱动特性将系统分成姿态内环和位置外环.在扰动观测器的基础上,利用积分型反步控制算法完成无人机位置信息在外界干扰下的稳定跟踪控制.在扰动观测器的基础上,利用自适应滑模控制算法完成无人机姿态信息在参数不确定和外界干扰作用下的稳定跟踪控制.与传统PID控制和滑模控制进行仿真对比,验证所提出控制策略的优越性.     

饱和输入下四旋翼无人机滑模轨迹跟踪控制

为解决四旋翼无人机在饱和输入下的轨迹跟踪控制问题,同时兼顾系统存在的参数不确定性和外部风力扰动影响,设计了一种改进的抗干扰自适应鲁棒滑模控制方法;基于六自由度架构,设计四旋翼无人机简化的系统模型,进而降低控制器设计的复杂程度;引入带有误差信号的滑模函数,设计带有误差信号的饱和补偿自适应控制律,同时增加鲁棒控制项,降低由于饱和输入问题带来的抖振影响,并减小参数不确定和外部风力扰动对系统稳定性的影响;系统模型与抗干扰自适应控制律相结合,形成了改进的抗干扰自适应鲁棒滑模控制策略,实现四旋翼无人机的位置轨迹和姿态轨迹的稳定跟踪;最后通过数值仿真与传统PD控制算法进行仿真比较,验证控制方法的有效性和优越性。     

利用深度卷积特征的无人机视觉跟踪

由于无人机视觉跟踪视角范围广且环境复杂,常遇到无人机飞行震动、目标遮挡、相似目标等问题,导致无人机跟踪目标发生漂移.因此,对具有回归计算的全卷积孪生网络跟踪算法(SiamRPN)进行改进,提出一种加强深度特征相关性的无人机视觉跟踪算法(SiamDFT).首先,将全卷积神经网络后三层卷积的网络宽度提升一倍,充分利用目标的外观信息,完成对模板帧和检测帧的特征提取;其次,在检测帧和模板帧分别提出注意力信息融合模块和特征深度卷积模块,两个深度的特征相关性计算方法能够有效抑制背景信息,增强像素对之间的关联性,高效完成分类和回归任务;然后,采用深度互相关运算完成相似性计算,并引入距离交并比的计算方法完成对目标的定位.实验结果表明, SiamDFT在无人机短时跟踪场景下精确率和成功率分别达到79.8%和58.3%,在无人机长时跟踪场景下精确率和成功率分别达到73.4%和55.2%,实景测试结果充分验证了所提出算法的有效性.     

Real-time gaze control of an active head-eye system without calibration

This article describes real-time gaze control using position-based visual servoing. The main control objective of the system is to enable a gaze point to track the target so that the image feature of the target is located at each image center. The overall system consists of two parts: the vision process and the control system. The vision system extracts a predefined color feature from images. An adaptive look-up table method is proposed in order to get the 3-D position of the feature within the video frame rate under varying illumination. An uncalibrated camera raises the problem of the reconstructed 3-D positions not being correct. To solve the calibration problem in the position-based approach, we constructed an end-point closed-loop system using an active head-eye system. In the proposed control system, the reconstructed position error is used with a Jacobian matrix of the kinematic relation. The system stability is locally guaranteed, like image-based visual servoing, and the gaze position was shown to converge to the feature position. The proposed approach was successfully applied to a tracking task with a moving target in some simulations and some real experiments. The processing speed satisfies the property of real time. This work was presented in part at the Sixth International Symposium on Artificial Life and Robotics, Tokyo, January 15–17, 2001     

四旋翼无人机鲁棒自适应姿态控制

 四旋翼无人机的姿态控制是自主飞行控制的核心,针对四旋翼姿态易受外界环境干扰和内部参数摄动等不确定性影响的问题,设计了一种鲁棒自适应反步控制器,以提高四旋翼的鲁棒性。建立了四旋翼完整的姿态运动模型,并将其转化为含有广义不确定性的多输入多输出非线性系统。根据该系统满足严格反馈的结构特点,设计了反步控制器; 针对系统中存在的外部干扰和内部参数摄动等不确定性,引入了一类鲁棒自适应函数来抵消该不确定性对系统的影响; 采用非线性跟踪微分器估计虚拟控制量的微分信号,减小了反步控制器设计中普遍存在的“计算膨胀”问题; 通过构造Lyapunov 函数证明闭环系统是稳定且指数收敛的。仿真结果表明,所设计控制器具有良好的控制效果和鲁棒性。     

Adaptive fractional-order nonsingular fast terminal sliding mode formation control of multiple quadrotor UAVs-based distributed estimator

This paper mainly solves two major problems that are unavoidable in leader–follower formation process of quadrotor UAV group: the existence of external uncertainty disturbance and communication limited between quadrotor unmanned aerial vehicle (UAV) group. To solve the problem that only one of the followers in the leader–follower formation can obtain the leader's information, an improved distributed estimator is proposed in this paper, which can accurately estimate the leader's information for each follower. In addition, in order to eliminate the influence of uncertain external disturbance on the performance of quadrotor UAV, an adaptive estimation law is designed based only on velocity and position variables. For the attitude and position subsystem of the quadrotor UAV, a sliding surface with fractional-order term is designed. Which makes the quadrotor UAV tracking error system obtain good robustness at the stage of reaching the sliding surface and fast convergence and accurate tracking performance in the sliding stage. Based on Lyapunov stability theory, the convergence results are analyzed strictly. The results show that the algorithm can make the position distance between leader and followers converge to the desired offset. Simulation results verify the effectiveness and superiority of the control algorithm.     

基于图像雅可比矩阵的智能机器人视觉跟踪

根据智能机器人视觉伺服的要求,建立了固定眼结构的MOTOMAN-SV3XL型工业机器人无标定视觉伺服系统.研究了目前在机器人视觉伺服研究领域中使用最为广泛的一类方法,即基于图像雅可比矩阵的方法.针对图像雅可比矩阵的特点,设计了一种基于简化Sage-Husa自适应滤波的图像雅可比矩阵在线估计算法,并将其应用于机器人视觉反馈控制任务中,实现了对二维平面上运动目标的跟踪,实验结果表明了该算法的有效性.     

State transformation-based dynamic visual servoing for an unmanned aerial vehicle

In this paper, we propose a visual servoing control for a quadrotor unmanned aerial vehicle (UAV) which is based on a state transformation technique. The UAV is equipped with a single downwards facing camera, and the motion control objective is the regulation of relative displacement and yaw to a stationary visual target located on the ground. The state transformation is defined by a system of partial differential equations (PDEs) which eliminate roll and pitch rate dependence in the transformed image feature kinematics. A method for computing the general solutions of these PDEs is given, and we show a particular solution reduces to an established virtual camera approach. We treat point and line cases and introduce image moment features defined in the virtual camera image plane. Robustness of the control design is improved by accounting for attitude measurement bias, and uncertainty in thrust gain, mass, and image feature depth. The asymptotic stability of the closed-loop is proven. The method is based on a simple proportional-integral-derivative (PID) structure which can be readily implemented on-board. Experimental results show improved performance relative to previous work.     

基于RFID技术的四旋翼无人机轨迹跟踪控制系统设计

为促进四旋翼无人机的飞行自主性,增强无人监管情况下飞行器主机所具备的避障行进能力,设计基于RFID技术的四旋翼无人机轨迹跟踪控制系统;采用RFID标签识别技术,调制处理既定控制信号,利用标签识别协议,连接微型四旋翼轨迹控制器与内环姿态控制器,通过数据通信链路,提取轨迹跟踪控制所需的传输电子量,完成轨迹跟踪控制系统硬件设计;利用动力系统中的参数辨识策略,确定与轨迹姿态控制相关的物理规律标注,实现四旋翼无人机轨迹跟踪控制;实验结果表明,与机器视觉型控制系统相比,基于RFID技术的控制系统的SSI避障行进指标数值相对较高,全局最大值达到了 79％,四旋翼无人机滚转角平均值为85°,能够有效抑制四旋翼无人机滚转角的数值上升趋势,增强无人监管情况下飞行器主机避障行进能力.     

垂直起降无人机基于图像的目标跟踪控制

针对安装有惯性测量单元和摄像机的低成本四旋翼无人机,研究无位置、速度、航向测量情况下的机动目标基于图像的跟踪控制方法.首先,结合无人机的动力学方程在图像空间中推导了系统的误差方程.其次,为克服无航向测量的问题,设计了一种位置控制器,使用图像矩作为反馈输入并输出油门和姿态指令.最后,针对缺少图像速度测量问题,设计了一种super-twisting滑模观测器和控制器,生成的期望姿态和拉力指令无颤振,并通过李雅普诺夫理论证明了控制系统的稳定性.最终无人机通过调整倾斜姿态实现了跟踪飞行,且避免了响应慢的航向调整.跟踪机动目标的仿真结果验证了所提出方法的有效性.     

荷载不确定移动机器人视觉伺服系统鲁棒预测控制

考虑具有可见性约束和执行器约束的载荷不确定移动机器人视觉伺服系统,提出一种鲁棒视觉伺服预测控制策略.首先将该移动机器人视觉伺服系统建模为关于视觉伺服误差和驱动的不确定系统.其次,对约束的视觉伺服误差子系统,设计基于半正定规划的速度规划预测控制算法.该算法分为离线计算和在线调度两个部分,降低预测控制算法的在线计算量.而对...     

四旋翼无人机PDF控制系统设计和抗干扰分析

针对传统的PID控制方法在对四旋翼无人机进行控制时动态响应差,抗干扰能力低等局限性,不能够满足高精度要求的四旋翼无人机应用场合的问题。本文以四旋翼无人机的姿态控制为研究对象,通过采用基于伪微分反馈(PDF)控制策略来设计其飞行控制器,以提高动态响应性能和抗干扰能力。在对四旋翼无人机数学建模的基础上,将PDF控制策略引入到四旋翼姿态控制中,提出基于四旋翼无人机对象的PDF控制设计方法,并分别完成PID、PDF控制器的设计和动态仿真。通过对仿真结果比较、分析表明PDF控制与PID姿态控制器相比,系统超调量小,具有更好的鲁棒性和抗干扰能力。     

四旋翼飞行器增稳混合控制器

针对四旋翼飞行器在不同环境下的飞行稳定性问题,提出反步法和模糊自适应比例积分微分(PID)方法的混合控制方法。该方法根据无人机(UAV)飞行环境和大倾角、大倾角变化率选择当前合适的控制器。在系统未受扰动时,基于Backstepping的控制方法能够完成飞行器的轨迹跟踪;在受扰动时,基于模糊自适应PID能够极大地抑制扰动带来的影响,实现对四旋翼飞行器的精确控制。通过Matlab仿真分析及实际飞行器实验,验证了增稳混合控制器的稳定性。     

A fault tolerant tracking control for a quadrotor UAV subject to simultaneous actuator faults and exogenous disturbances

ABSTRACT

An observer-based robust adaptive Fault Tolerant Control approach is proposed in this paper to tackle the problem of trajectory tracking for a quadrotor unmanned aerial vehicle (UAV) suffering simultaneous actuator faults, exogenous disturbances and actuator saturation limits. An adaptive fuzzy state observer is proposed to estimate the immeasurable states by using fuzzy logic systems to approximate the unknown nonlinear functions of the uncertain system model. Based on the estimates of the fuzzy observer, an Integral Terminal Sliding Mode Controller that guarantees finite time convergence of the states to a small neighbourhood of zero, even under impaired conditions, is developed. Stability analysis was carried over using the Lyapunov method. The proposed approach was implemented to a quadrotor UAV and its performance was assessed under nominal conditions, and by subjecting the quadrotor to disturbances, simultaneously occurring actuator faults and input saturation limits. Excellent tracking performance and robustness even under worst-case scenarios are among the positive features of the proposed approach.     

Developing robust vision modules for microsystems applications

In this work, several robust vision modules are developed and implemented for fully automated micromanipulation. These are autofocusing, object and end-effector detection, real-time tracking and optical system calibration modules. An image based visual servoing architecture and a path planning algorithm are also proposed based on the developed vision modules. Experimental results are provided to assess the performance of the proposed visual servoing approach in positioning and trajectory tracking tasks. Proposed path planning algorithm in conjunction with visual servoing imply successful micromanipulation tasks.     

Improved eye-vergence visual servoing system in longitudinal direction with RM-GA

Visual servoing is a control method to manipulate the motion of the robot using visual information, which aims to realize “working while watching.” However, the visual servoing towards moving target with hand–eye cameras fixed at hand is inevitably affected by hand dynamical oscillation. To overcome this defect of the hand–eye fixed camera system, an eye-vergence system has been put forward, where the pose of the cameras could be rotated to observe the target object. The visual servoing controllers of hand and eye-vergence are installed independently, so that it can observe the target object at the center of camera images through eye-vergence function. In this research, genetic algorithm (GA) is used as a pose tracking method, which is called “Real-Time Multi-step GA(RM-GA),” solves on-line optimization problems for 3D visual servoing. The performances of real-time object tracking using eye-vergence system and “RM-GA” method have been examined, and also the pose tracking accuracy has been verified.