Evolution of homing navigation in a real mobile robot

In this paper we describe the evolution of a discrete-time recurrent neural network to control a real mobile robot. In all our experiments the evolutionary procedure is carried out entirely on the physical robot without human intervention. We show that the autonomous development of a set of behaviors for locating a battery charger and periodically returning to it can be achieved by lifting constraints in the design of the robot/environment interactions that were employed in a preliminary experiment. The emergent homing behavior is based on the autonomous development of an internal neural topographic map (which is not pre-designed) that allows the robot to choose the appropriate trajectory as function of location and remaining energy.     

Learning to select distinctive landmarks for mobile robot navigation

In landmark-based navigation systems for mobile robots, sensory perceptions (e.g., laser or sonar scans) are used to identify the robot’s current location or to construct internal representations, maps, of the robot’s environment. Being based on an external frame of reference (which is not subject to incorrigible drift errors such as those occurring in odometry-based systems), landmark-based robot navigation systems are now widely used in mobile robot applications.The problem that has attracted most attention to date in landmark-based navigation research is the question of how to deal with perceptual aliasing, i.e., perceptual ambiguities. In contrast, what constitutes a good landmark, or how to select landmarks for mapping, is still an open research topic. The usual method of landmark selection is to map perceptions at regular intervals, which has the drawback of being inefficient and possibly missing ‘good’ landmarks that lie between sampling points.In this paper, we present an automatic landmark selection algorithm that allows a mobile robot to select conspicuous landmarks from a continuous stream of sensory perceptions, without any pre-installed knowledge or human intervention during the selection process. This algorithm can be used to make mapping mechanisms more efficient and reliable. Experimental results obtained with two different mobile robots in a range of environments are presented and analysed.     

Adaptive behavior navigation of a mobile robot

Describes a neural network model for the reactive behavioral navigation of a mobile robot. From the information received through the sensors the robot can elicit one of several behaviors (e.g., stop, avoid, stroll, wall following), through a competitive neural network. The robot is able to develop a control strategy depending on sensor information and learning operation. Reinforcement learning improves the navigation of the robot by adapting the eligibility of the behaviors and determining the linear and angular robot velocities     

Wheeled mobile robot navigation using proportional navigation

We present a method for wheeled mobile robot navigation based on the proportional navigation law. This method integrates the robot's kinematics equations and geometric rules. According to the control strategy, the robot's angular velocity is proportional to the rate of turn of the angle of the line of sight that joins the robot and the goal. We derive a relative kinematics system which models the navigation problem of the robot in polar coordinates. The kinematics model captures the robot path as a function of the control law parameters. It turns out that different paths are obtained for different control parameters. Since the control parameters are real, the number of possible paths is infinite. Results concerning the navigation using our control law are rigorously proven. An extensive simulation confirms our theoretical results.     

Empirical learning in mobile robot navigation

The purpose of this study is to improve the locomotion performance for autonomous mobile robots in outdoor environments. In this paper improvement of an environment model is called empirical locomotion performance leaming. A system avoids wasting time of observations and actions by analyzing data from the last run. We propose a method of empirical learning. The method is expressed by rewriting the rules on the trajectory data. Brief route information for navigating a robot is represented with motion directions at intersections and metric distances between intersections. The behavior of our robot is based on a locomotion strategy 'sign pattern-based stereotyped motion'. The behaviors are implemented on our mobile robot HARUNOBU-4 and tested at our university campus. Experimental results show a robustness of our proposed behaviors under dynamic environments with existing obstacles. Furthermore, they showed that our proposed rewriting rules improved the locomotion performance. In particular, searching time was shortened by 87% (from 453 to 61 s) and the travel distance was shortened by 10% (from 173.8 to 157.5 m).     

Direct-vision-based reinforcement learning in a real mobile robot

It was confirmed that a real mobile robot with a simple visual sensor could learn appropriate motions to reach a target object by direct-vision-based reinforcement learning (RL). In direct-vision-based RL, raw visual sensory signals are put directly into a layered neural network, and then the neural network is trained using back propagation, with the training signal being generated by reinforcement learning. Because of the time-delay in transmitting the visual sensory signals, the actor outputs are trained by the critic output at two time-steps ahead. It was shown that a robot with a simple monochrome visual sensor can learn to reach a target object from scratch without any advance knowledge of this task by direct-vision-based RL. This work was presented in part at the 7th International Symposium on Artificial Life and Robotics, Oita, Japan, January 16–18, 2002     

Positioning and navigation of mobile robot

Positioning tracking is not a new idea as we have been seen from the ability of the GPS (Global Positioning System) to track the position of the object, in general with acceptable accuracy but the cost of GPS installation is expensive. However, in the case of detecting the exact position in signal-blocked closed environment (e.g. inside building, forest, mines and others); the accuracy factor provide by GPS is low. Thus, this project presents a positioning tracking system that is able to track the movement of an object within a small area or inside buildings. A complete set of the positioning tracking system consists of a pair of computer mechanical mouse and a microcontroller. From the position displayed on the computer screen, the position of the object can be located. The pair of mouse detects each movement of the object and sends the movement data to microcontroller. Linear, angular displacement and positioning calculation are also being discussed. From the results, it’s shown that the positioning system is applicable. However, some small errors are also occurred but in acceptable range. This work was presented in part at the 13th International Symposium on Artificial Life and Robotics, Oita, Japan, January 31–February 2, 2008     

Vision for mobile robot navigation: a survey

Surveys the developments of the last 20 years in the area of vision for mobile robot navigation. Two major components of the paper deal with indoor navigation and outdoor navigation. For each component, we have further subdivided our treatment of the subject on the basis of structured and unstructured environments. For indoor robots in structured environments, we have dealt separately with the cases of geometrical and topological models of space. For unstructured environments, we have discussed the cases of navigation using optical flows, using methods from the appearance-based paradigm, and by recognition of specific objects in the environment     

移动机器人导航控制研究的重要进展—-评专著《未知环境中移动机器人导航控制理论与方法》

蔡自兴、贺汉根、陈虹等教授的新著《未知环境中移动机器人导航控制理论与方法》已在科学出版社问世,成为《21世纪先进制造技术丛书》的一枝新秀,作为该丛书的主编,我深感荣幸。专著是三位教授和研究组成员,在智能机器人领域多年来辛苦耕耘,取得丰硕成果的基础上,精心凝练写成的,高屋建瓴,叶茂根深。它的出版值得大家庆贺。     

Hybrid stabilizing control on a real mobile robot

To establish empirical verification of a stabilizing controller for nonholonomic systems, the authors implement a hybrid control concept on a 2-DOF mobile robot. Practical issues of velocity control are also addressed through a velocity controller which transforms the mobile robot to a new system with linear and angular velocity inputs. Experiments in the physical meaning of different controller components provide insights which result in significant improvements in controller performance     

Autonomous mobile robot navigation and learning

Research focused on the development and experimental validation of intelligent control techniques for autonomous mobile robots able to plan and perform a variety of assigned tasks in unstructured environments is presented. In particular, an autonomous mobile robot, HERMIES-IIB intelligence experiment series, is described. It is a self-powered, wheel-driven platform containing an onboard 16-node Ncube hypercube parallel processor interfaced to effectors and sensors through a VME-based system containing a Motorola 68020 processor, a phased sonar array, dual manipulator arms, and multiple cameras. Research on navigation and learning is examined     

Remote navigation of a mobile robot in an RFID-augmented environment

In the current article, we address the problem of constructing radiofrequency identification (RFID)-augmented environments for mobile robots and the issues related to creating user interfaces for efficient remote navigation with a mobile robot in such environments. First, we describe an RFID-based positioning and obstacle identification solution for remotely controlled mobile robots in indoor environments. In the robot system, an architecture specifically developed by the authors for remotely controlled robotic systems was tested in practice. Second, using the developed system, three techniques for displaying information about the position and movements of a remote robot to the user were compared. The experimental visualization techniques displayed the position of the robot on an indoor floor plan augmented with (1) a video view from a camera attached to the robot, (2) display of nearby obstacles (identified using RFID technology) on the floor plan, and (3) both features. In the experiment, test subjects controlled the mobile robot through predetermined routes as quickly as possible avoiding collisions. The results suggest that the developed RFID-based environment and the remote control system can be used for efficient control of mobile robots. The results from the comparison of the visualization techniques showed that the technique without a camera view (2) was the fastest, and the number of steering motions made was smallest using this technique, but it also had the highest need for physical human interventions. The technique with both additional features (3) was subjectively preferred by the users. The similarities and differences between the current results and those found in the literature are discussed.     

Sensing error for a mobile robot using line navigation

The use of a contrasting line for the visual navigation of autonomous mobile robots in a factory environment is developed. Minimum and maximum linewidths are determined analytically by considering sensor geometry, field of view, and error conditions present in the system. The effects of these error conditions on the width of the line, as seen in the image plane, determines the optimal linewidth. Numerical examples using typical sensor parameters are given.     

基于行为的轮式移动机器人导航控制

介绍了一种轮式移动机器人CASIA-I及其运动机构,针对该运动机构给出了机器人的运动方程和基于行为的导航控制算法,并根据该算法进行了软件仿真和实物实验．实验结果表明,该导航控制算法是一种有效的导航算法．     

Learning to avoid collisions: A reinforcement learning paradigm for mobile robot navigation

The paper describes a self-learning control system for a mobile robot. Based on sensor information the control system has to provide a steering signal in such a way that collisions are avoided. Since in our case no «examples« are available, the system learns on the basis of an external reinforcement signal which is negative in case of a collision and zero otherwise. We describe the adaptive algorithm which is used for a discrete coding of the state space, and the adaptive algorithm for learning the correct mapping from the input (state) vector to the output (steering) signal.     

Range measurements by a mobile robot using a navigation line

A continuous, straight-edged line is used for the visual navigation of an autonomous mobile robot in a factor environment. This line, which resides on the floor and contrasts with background, may also be used to determine range information. Two methods are developed for determining the range of an object in the sensor's field of view. The effects of various error conditions in the system geometry on each ranging method are determined. Equations are derived which yield the percent error in calculating ranges given estimates of these error conditions. Numerical examples using typical sensor parameters are given.     

Reinforcement based mobile robot navigation in dynamic environment

In this paper, a new approach is developed for solving the problem of mobile robot path planning in an unknown dynamic environment based on Q-learning. Q-learning algorithms have been used widely for solving real world problems, especially in robotics since it has been proved to give reliable and efficient solutions due to its simple and well developed theory. However, most of the researchers who tried to use Q-learning for solving the mobile robot navigation problem dealt with static environments; they avoided using it for dynamic environments because it is a more complex problem that has infinite number of states. This great number of states makes the training for the intelligent agent very difficult. In this paper, the Q-learning algorithm was applied for solving the mobile robot navigation in dynamic environment problem by limiting the number of states based on a new definition for the states space. This has the effect of reducing the size of the Q-table and hence, increasing the speed of the navigation algorithm. The conducted experimental simulation scenarios indicate the strength of the new proposed approach for mobile robot navigation in dynamic environment. The results show that the new approach has a high Hit rate and that the robot succeeded to reach its target in a collision free path in most cases which is the most desirable feature in any navigation algorithm.     

Differential GPS and odometry-based outdoor navigation of a mobile robot

This paper describes outdoor navigation for a mobile robot by using differential GPS (DGPS) and odometry in a campus walkway environment. The robot position is estimated by fusion of DGPS and odometry. The GPS receiver measures its position by radio waves from GPS satellites. The error of GPS measurement data increases near high buildings and trees because of multi-path and forward diffractions. Thus, it is necessary to pick up only accurate DGPS measurement data when the robot position is modified by fusing DGPS and odometry. In this paper, typical DGPS measurement data observed near high buildings and trees are reported. Then, the authors propose a novel position correction method by fusing GPS and odometry. Fusion of DGPS and odometry is realized using an extended Kalman filter framework. Moreover, outdoor navigation for a mobile robot is accomplished by using the proposed correction method.     

基于单目视觉的移动机器人导航算法研究进展

基于单目视觉的移动机器人导航的研究,涵盖了机器视觉、模式识别和多目标跟踪多个领域．其算法框架不仅成功应用于移动机器人导航,还为目标检测、识别与跟踪领域的研究提供了可供参考的模型．该综述将以算法发展历史为脉络,结合一些典型系统,通过对关键技术和算法结构的分析比较,总结算法本身的发展前景和由此发展起来的可供相关研究参考的算法框架．