Dynamic path planning of mobile robots with improved genetic algorithm

In this study, a new mutation operator is proposed for the genetic algorithm (GA) and applied to the path planning problem of mobile robots in dynamic environments. Path planning for a mobile robot finds a feasible path from a starting node to a target node in an environment with obstacles. GA has been widely used to generate an optimal path by taking advantage of its strong optimization ability. While conventional random mutation operator in simple GA or some other improved mutation operators can cause infeasible paths, the proposed mutation operator does not and avoids premature convergence. In order to demonstrate the success of the proposed method, it is applied to two different dynamic environments and compared with previous improved GA studies in the literature. A GA with the proposed mutation operator finds the optimal path far too many times and converges more rapidly than the other methods do.     

基于改进的A*算法与动态窗口法的移动机器人路径规划

提出了一种改进的A^*算法与动态窗口法相结合的混合算法,以解决移动机器人在多目标复杂环境中的路径规划问题．首要,为了提升算法的运行效率,实现单次规划的路径可通过多个目标点,同时提升路径平滑处理的灵活性并满足移动机器人非完整约束条件,本文利用目标成本函数对所有目标进行优先级判定,进而利用改进的A^*算法规划一条经过多个目标点的最优路径,同时采用自适应圆弧优化算法与加权障碍物步长调节算法,有效地将路径长度缩短5%,转折角总度数降低26.62%．其次,为实现移动机器人在动态复杂环境中局部避障并追击动态目标点．提出将改进动态窗口算法与全局路径规划信息相结合的在线路径规划法,采用预瞄偏差角追踪法成功捕捉移动目标点,并提升了路径规划效率．最后,对所提方法进行仿真实验,结果表明该方法能够在复杂动态环境中更有效地实现路径规划．     

Dyna-Q-based vector direction for path planning problem of autonomous mobile robots in unknown environments

Reinforcement learning (RL) is a popular method for solving the path planning problem of autonomous mobile robots in unknown environments. However, the primary difficulty faced by learning robots using the RL method is that they learn too slowly in obstacle-dense environments. To more efficiently solve the path planning problem of autonomous mobile robots in such environments, this paper presents a novel approach in which the robot’s learning process is divided into two phases. The first one is to accelerate the learning process for obtaining an optimal policy by developing the well-known Dyna-Q algorithm that trains the robot in learning actions for avoiding obstacles when following the vector direction. In this phase, the robot’s position is represented as a uniform grid. At each time step, the robot performs an action to move to one of its eight adjacent cells, so the path obtained from the optimal policy may be longer than the true shortest path. The second one is to train the robot in learning a collision-free smooth path for decreasing the number of the heading changes of the robot. The simulation results show that the proposed approach is efficient for the path planning problem of autonomous mobile robots in unknown environments with dense obstacles.     

异构多目标差分-动态窗口算法 及其在移动机器人中的应用

为了实现在多移动机器人和多窄通道的复杂动态环境中机器人的节能运动规划,提出异构多目标差分-动态窗口法(heterogeneous multi-objective differential evolution-dynamic window algorithm,HMODE-DWA).首先,建立行驶时间、执行器作用力和平滑度的3目标优化模型,设计具有碰撞约束的异构多目标差分进化算法来获得3个目标函数的最优解,进而在已知的静态环境中获得帕累托前沿,利用平均隶属度函数获得起点与终点间最优的全局路径;其次,定义基于环境缓冲区域的模糊动态窗口法使机器人完成动态复杂环境中避障,利用所提出的HMODE-DWA算法动态避障的同时实现节能规划.仿真和实验结果表明,所提出的混合路径规划控制策略能够有效降低移动机器人动态避障过程中的能耗.     

一种基于改进冲突搜索的多机器人路径规划算法

针对智能仓储环境下多载位自主移动机器人集群拣选-配送路径规划问题,提出一种改进型基于冲突搜索的多智能体路径规划算法.在模型方面,采用多载位机器人替代KIVA机器人,建立以最小化拣选-配送时间以及无效路径比为目标的数学规划模型.在算法方面,首先,提出一种基于优先级规则的多智能体冲突消解加速策略;然后,设计基于动态规划的单机器人拣选序列优化算法;最后,设计考虑转向惩罚的增强A*算法搜索机器人最优路径.实验结果表明:所提出模型与KIVA系统相比有较大优越性;所提出算法能够有效缩短拣选-配送时间、减少无效路径时间.     

融合动态障碍物运动信息的路径规划算法

传统的路径规划算法只能在障碍物不发生位置变化的环境中计算最优路径。但是随着机器人在商场、医院、银行等动态环境下的普及,传统的路径规划算法容易与动态障碍物发生碰撞等危险。因此,关于随机动态障碍物条件下的机器人路径规划算法需要得到进一步改善。为了解决在动态环境下的机器人路径规划问题,提出了一种融合机器人与障碍物运动信息的改进动态窗口法来解决机器人在动态环境下的局部路径规划问题,并且与优化A*算法相结合来实现全局最优路径规划。主要内容体现为：在全局路径规划上,采用优化A*算法求解最优路径。在局部路径规划上,以动态障碍物的速度作为先验信息,通过对传统动态窗口法的评价函数进行扩展,实现机器人在动态环境下的自主智能避障。实验证明,该算法可以实现基于全局最优路径的实时动态避障,具体表现为可以在不干涉动态障碍物的条件下减少碰撞风险、做出智能避障且路径更加平滑、长度更短、行驶速度更快。     

Multiple targets enclosure by robotic swarm

Target enclosure by autonomous robots is useful for many practical applications, for example, surveillance of disaster sites. Scalability is important for autonomous robots because a larger group is more robust against breakdown, accidents, and failure. However, since the traditional models have discussed only the cases in which minimum number of robots enclose a single target, there has been no study on the utilization of the redundant number of robots. In this paper, to achieve a highly scalable target enclosure model about the number of target to enclose, we introduce swarm based task assignment capability to Takayama’s enclosure model. The original model discussed only single target environment but it is well suited for applying to the environments with multiple targets. We show the robots can enclose the targets without predefined position assignment by analytic discussion based on switched systems and a series of computer simulations. As a consequence of this property, the proposed robots can change their target according to the criterion about robot density while they enclose multiple targets.     

Conflict free coordinated path planning for multiple robots using a dynamic path modification sequence

In this paper, a practically viable approach for conflict free, coordinated motion planning of multiple robots is proposed. The presented approach is a two phase decoupled method that can provide the desired coordination among the participating robots in offline mode. In the first phase, the collision free path with respect to stationary obstacles for each robot is obtained by employing an A* algorithm. In the second phase, the coordination among multiple robots is achieved by resolving conflicts based on a path modification approach. The paths of conflicting robots are modified based on their position in a dynamically computed path modification sequence (PMS). To assess the effectiveness of the developed methodology, the coordination among robots is also achieved by different strategies such as fixed priority sequence allotment for motion of each robot, reduction in the velocities of joints of the robot, and introduction of delay in starting of each robot. The performance is assessed in terms of the length of path traversed by each robot, time taken by the robot to realize the task and computational time. The effectiveness of the proposed approach for multi-robot motion planning is demonstrated with two case studies that considered the tasks with three and four robots. The results obtained from realistic simulation of multi-robot environment demonstrate that the proposed approach assures rapid, concurrent and conflict free coordinated path planning for multiple robots.     

人工免疫算法在机器人路径规划中的应用

人工免疫算法是一种新兴的优化方法,在计算、控制等各方面都已得到应用.将免疫算法应用于移动机器人路径规划,提出一种任意多边形障碍物复杂布局环境下的机器人路径规划的人工免疫算法,仿真证明该算法可以准确地找到全局最优路径,而且能够适应各种复杂的环境.     

Real-Time Robot Path Planning Based on a Modified Pulse-Coupled Neural Network Model

This paper presents a modified pulse-coupled neural network (MPCNN) model for real-time collision-free path planning of mobile robots in nonstationary environments. The proposed neural network for robots is topologically organized with only local lateral connections among neurons. It works in dynamic environments and requires no prior knowledge of target or barrier movements. The target neuron fires first, and then the firing event spreads out, through the lateral connections among the neurons, like the propagation of a wave. Obstacles have no connections to their neighbors. Each neuron records its parent, that is, the neighbor that caused it to fire. The real-time optimal path is then the sequence of parents from the robot to the target. In a static case where the barriers and targets are stationary, this paper proves that the generated wave in the network spreads outward with travel times proportional to the linking strength among neurons. Thus, the generated path is always the global shortest path from the robot to the target. In addition, each neuron in the proposed model can propagate a firing event to its neighboring neuron without any comparing computations. The proposed model is applied to generate collision-free paths for a mobile robot to solve a maze-type problem, to circumvent concave U-shaped obstacles, and to track a moving target in an environment with varying obstacles. The effectiveness and efficiency of the proposed approach is demonstrated through simulation and comparison studies.      

基于ACS算法的移动机器人实时全局最优路径规划

以Ant Colony System（ACS）算法为基础提出了一种新的移动机器人实时全局最优路径规划方法.这种方法包括三个步骤：第一步是采用链接图理论建立移动机器人的自由空间模型,第二步是采用Dijkstra算法搜索出一条无碰撞次优路径,第三步是采用ACS算法对这条次优路径的位置进行优化,从而得到移动机器人的全局最优路径.计算机仿真实验的结果表明所提出的方法是有效的,可用于对移动机器人进行实时路径规划.仿真结果也证实了所提出的方法在收敛速度、解的波动性、动态收敛特征以及计算效率等方面都具有比采用精英保留遗传算法的移动机器人路径规划方法更好的性能.     

基于改进强化学习的模块化自重构机器人编队

针对传统强化学习算法在训练初期缺乏对周围环境的先验知识,模块化自重构机器人会随机选择动作,导致迭代次数浪费和算法收敛速度缓慢的问题,提出一种两阶段强化学习算法。在第一阶段,利用基于群体和知识共享的Q-learning训练机器人前往网格地图的中心点,以获得一个最优共享Q表。在这个阶段中,为了减少迭代次数,提高算法的收敛速...     

Decentralized behavior-based formation control of multiple robots considering obstacle avoidance

This paper proposes a decentralized behavior-based formation control algorithm for multiple robots considering obstacle avoidance. Using only the information of the relative position of a robot between neighboring robots and obstacles, the proposed algorithm achieves formation control based on a behavior-based algorithm. In addition, the robust formation is achieved by maintaining the distance and angle of each robot toward the leader robot without using information of the leader robot. To avoid the collisions with obstacles, the heading angles of all robots are determined by introducing the concept of an escape angle, which is related with three boundary layers between an obstacle and the robot. The layer on which the robot is located determines the start time of avoidance and escape angle; this, in turn, generates the escape path along which a robot can move toward the safe layer. In this way, the proposed method can significantly simplify the step of the information process. Finally, simulation results are provided to demonstrate the efficiency of the proposed algorithm.     

State-chain sequential feedback reinforcement learning for path planning of autonomous mobile robots

This paper deals with a new approach based on Q-learning for solving the problem of mobile robot path planning in complex unknown static environments.As a computational approach to learning through interaction with the environment,reinforcement learning algorithms have been widely used for intelligent robot control,especially in the field of autonomous mobile robots.However,the learning process is slow and cumbersome.For practical applications,rapid rates of convergence are required.Aiming at the problem of slow convergence and long learning time for Q-learning based mobile robot path planning,a state-chain sequential feedback Q-learning algorithm is proposed for quickly searching for the optimal path of mobile robots in complex unknown static environments.The state chain is built during the searching process.After one action is chosen and the reward is received,the Q-values of the state-action pairs on the previously built state chain are sequentially updated with one-step Q-learning.With the increasing number of Q-values updated after one action,the number of actual steps for convergence decreases and thus,the learning time decreases,where a step is a state transition.Extensive simulations validate the efficiency of the newly proposed approach for mobile robot path planning in complex environments.The results show that the new approach has a high convergence speed and that the robot can find the collision-free optimal path in complex unknown static environments with much shorter time,compared with the one-step Q-learning algorithm and the Q(λ)-learning algorithm.     

基于改进蚁群算法的全向移动机器人全遍历路径规划

受全遍历环境影响, 现有方法规划得出的路径长度过长, 为提高路径规划性能, 获取最优路径, 提出基于改进蚁群算法的全向移动机器人全遍历路径规划方法. 在拓扑建模示意图的基础上, 依据移动机器人在原坐标系下的位置信息, 利用角度转换建立新的环境模型. 考虑蚁群算法存在的问题, 将递减系数引入到启发函数中, 更新局部信息素...     

Applying a path planner based on RRT to cooperative multirobot box-pushing

Considering robot systems in the real world, a multirobot system where multiple robots work simultaneously without colliding with each other is more practical than a single-robot system where only one robot works. Therefore, solving the path-planning problem in a multirobot system is very important. In this study, we developed a path-planner based on the rapidly exploring random tree (RRT), which is a data structure and algorithm designed for efficiently searching for multirobot box-pushing, and made experiments in real environments. A path planner must construct a plan which avoids the robot colliding with obstacles or with other robots. Moreover, in some cases, a robot must collaborate with other robots to transport the box without colliding with any obstacles. Our proposed path planner constructs a box-transportation plan and the path plans of each robot bearing the above considerations in mind. Experimental results showed that our proposed planner can construct a multirobot box-pushing plan without colliding with obstacles, and that the robots can execute tasks according to the plan in real environments. We also checked that multiple robots can perform problem tasks when only one robot could not transport the box to the goal. This work was presented in part at the 13th International Symposium on Articifial Life and Robotics, Oita, Japan, January 31–February 2, 2008     

A neural network approach to complete coverage path planning.

Complete coverage path planning requires the robot path to cover every part of the workspace, which is an essential issue in cleaning robots and many other robotic applications such as vacuum robots, painter robots, land mine detectors, lawn mowers, automated harvesters, and window cleaners. In this paper, a novel neural network approach is proposed for complete coverage path planning with obstacle avoidance of cleaning robots in nonstationary environments. The dynamics of each neuron in the topologically organized neural network is characterized by a shunting equation derived from Hodgkin and Huxley's (1952) membrane equation. There are only local lateral connections among neurons. The robot path is autonomously generated from the dynamic activity landscape of the neural network and the previous robot location. The proposed model algorithm is computationally simple. Simulation results show that the proposed model is capable of planning collision-free complete coverage robot paths.     

蚁群算法在机器人路径规划中的应用研究

针对传统机器人路径规划方法无法保证寻找全局最优路径的问题,本文提出了一种基于蚁群算法求解机器人路径规划的方法.在此基础上构建了移动机器人路径规划模型,并通过Visual C 6.0进行仿真.结果表明该算法能够在动态和静态环境中迅速找到机器人的最优路径,与基于遗传算法的路径规划方法相比具有较大的优势.     

移动机器人的时间最优编队

针对移动机器人的最速编队问题,结合路径规划和任务分解,提出一种分派问题的新解法和时间最优的编队策略。该策略充分考虑了障碍物环境约束和各机器人运动时的相互影响,通过将系统整体路径规划的复杂问题分解为独立路径规划问题和冲突协调问题来分别求解,降低了计算的复杂性,并能了快编队。     

一种蚂蚁遗传融合的机器人路径规划新算法

针对栅格法建模的不足,本文研究一种全新的蚂蚁算法与遗传算法融合的机器人路径规划算法.该方法首先用栅格法建立机器人运动空间模型,在此基础上利用蚂蚁算法进行全局搜索得到全局导航路径,然后用遗传算法局部调节全局导航路径上的路径点,得到更优路径.计算机仿真实验表明,即使在复杂的环境下,利用本算法也可以规划出一条全局优化路径,且能安全避障.