SLAMMOT-SP: Simultaneous SLAMMOT and Scene Prediction

In recent years, SLAMMOT (simultaneous localization, mapping and moving object tracking) has attracted widespread attention in the mobile robot field. This paper proposes a new approach, SLAMMOT-SP, which combines SLAMMOT and scene prediction (SP). It extends the SLAMMOT problem to simultaneous map prediction and moving object trajectory prediction. The robot not only passively collects the data and executes SLAMMOT, but actively predicts the scene. The recursive Bayesian formulation of SLAMMOT-SP is derived for real-time operations. A generalized framework for tracking and predicting the moving objects is also proposed. Simulations and experiments show that the proposed SLAMMOT-SP is effective and can be performed in real-time.     

An evolutionary algorithm for simultaneous localization and mapping (SLAM) of mobile robots

This paper presents a novel algorithm for simultaneous localization and mapping (SLAM) of mobile robots. The algorithm, termed Evolutionary SLAM, is based on an island model genetic algorithm (IGA). The IGA searches for the most probable map(s) such that the underlying robot's pose(s) provide(s) a robot with the best localization information. The correspondence problem in SLAM is solved by exploiting the property of natural selection, to support only better-performing individuals to survive. The algorithm does not follow any explicit heuristics for loop closure, rather it maintains multiple hypotheses to solve the loop-closing problem. The algorithm processes sensor data incrementally and, therefore, has the capability to work online. Experimental results in different indoor environments validate the robustness of the proposed algorithm.     

Navigation Using an Environmental Magnetic Field for Outdoor Autonomous Mobile Robots

GPS and laser range finders are generally utilized in current robot navigation. However, information from the magnetic field and electronic compass is not, since it is dynamically changing at every position. In this paper, the relationship between the intensity of a magnetic field in the environment and its position is taken into account by utilizing a three-axis magnetic sensor to scan the magnetic field in the environment to build a database. The mobile robot navigates by performing trajectory tracking based on the database. The experimental results show that by applying the proposed method, the mobile robot is able to navigate in an outdoor environment with reliable accuracy.     

General Feature Extraction for Mapping and Localization of a Mobile Robot Using Sparsely Sampled Sonar Data

This study introduces a method of general feature extraction for building a map and localization of a mobile robot using only sparsely sampled sonar data. Sonar data are acquired by using a general fixed-type sensor ring that frequently provides false returns on the locations of objects. We first suggest a data association filter that can classify sets of sonar data that are associated with the same hypothesized feature into one group. A feature extraction method is then introduced to decide the exact geometric parameters of the hypothesized feature in the group. We also show the possibility of extracting a circle feature consistently as well as a line or a point feature by using the proposed filter. These features are then assembled to build a global map and applied to extended Kalman filter-based localization of the robot. We demonstrate the validity of the proposed filter with the results of mapping and localization produced by real experiments.     

Online Short-Term Multiple Sound Source Mapping for a Mobile Robot by Robust Motion Triangulation

The paper describes a two-dimensional (2-D) sound source mapping system for a mobile robot. The robot localizes the directions of sound sources while moving and estimates the positions of sound sources using triangulation from a short time period of directional localization results. Three key components are denoted. (i) Directional localization and separation method of different pressure sound sources by combining the Delay and Sum Beam Forming (DSBF) and the Frequency Band Selection (FBS) algorithms. (ii) The design of the microphone array by beam forming simulation to increase the resolution of the localization procedure and its robustness to ambient noise. (iii) Sound position estimation by using the RAndom SAmple Consensus (RANSAC) algorithm. Then we achieved 2-D multiple sound source mapping from time-limited data with high accuracy. Applying FBS as a binary filter after DSBF improves robustness for multiple sound source localization under robotic movement. In addition, a moving sound source separation method is shown by using segments of the DSBF enhanced signal derived from the localization process.     

Outdoor Localization Using Stereo Vision Under Various Illumination Conditions

We present a mobile robot localization method using only a stereo camera. Vision-based localization in outdoor environments is a challenging issue because of extreme changes in illumination. To cope with varying illumination conditions, we use two-dimensional occupancy grid maps generated from three-dimensional point clouds obtained by a stereo camera. Furthermore, we incorporate salient line segments extracted from the ground into the grid maps. The grid maps are not significantly affected by illumination conditions because occupancy information and salient line segments can be robustly obtained. On the grid maps, a robot's poses are estimated using a particle filter that combines visual odometry and map matching. We use edge-point-based stereo simultaneous localization and mapping to obtain simultaneously occupancy information and robot ego-motion estimation. We tested our method under various illumination and weather conditions, including sunny and rainy days. The experimental results showed the effectiveness and robustness of the proposed method. Our method enables localization under extremely poor illumination conditions, which are challenging for even existing state-of-the-art methods.     

Sensor fusion for human-robot skill transfer systems

This paper describes how to design a data fusion module in a skill transfer system. The data fusion paradigm is addressed. It consists of two independent modules for optimal fusion and filtering. A new interpretation of the Kalman filter equations is done, to achieve a 'model-free' equation capable of following arbitrary variables. An engineering approach is used to tune the parameters of interest for a certain task. The fusion algorithm presented here is global and can easily be extended to any arbitrary system. It was successfully tested in a human-robot skill transfer of the peg-in-hole task at the DLR.     

Human Tracking System Integrating Sound and Face Localization Using an Expectation-Maximization Algorithm in Real Environments

We have developed a human tracking system for use by robots that integrate sound and face localization. Conventional systems usually require many microphones and/or prior information to localize several sound sources. Moreover, they are incapable of coping with various types of background noise. Our system, the cross-power spectrum phase analysis of sound signals obtained with only two microphones, is used to localize the sound source without having to use prior information such as impulse response data. An expectation-maximization (EM) algorithm is used to help the system cope with several moving sound sources. The problem of distinguishing whether sounds are coming from the front or back is also solved with only two microphones by rotating the robot's head. A developed method that uses facial skin colors classified by another EM algorithm enables the system to detect faces in various poses. It can compensate for the error in the sound localization for a speaker and also identify noise signals entering from undesired directions by detecting a human face. A developed probability-based method is used to integrate the auditory and visual information in order to produce a reliable tracking path in real-time. Experiments using a robot showed that our system can localize two sounds at the same time and track a communication partner while dealing with various types of background noise.     

A Simultaneous Localization and Mapping Algorithm in Complex Environments: SLASEM

In this paper we present an algorithm for the application of simultaneous localization and mapping in complex environments. Instead of building a grid map or building a feature map with a small number of the obstacles' geometric parameters, the proposed algorithm builds a sampled environment map (SEM) to represent a complex environment with a set of environment samples. To overcome the lack of one-toone correspondence between environment samples and raw observations, the signed orthogonal distance function is proposed to be used as the observation model. A method considering geometric constraints is presented to remove redundant environment samples from the SEM. We also present a method to improve the SEM's topological consistency by using corner constraints. The proposed algorithm has been verified in a simulation and an indoor experiment. The results show that the algorithm can localize the robot and build a complex map effectively.     

Sensor Fault Tolerance Method by Using a Bayesian Network for Robot Behavior

This paper presents FTBN, a new framework that performs learning autonomous mobile robot behavior and fault tolerance simultaneously. For learning behavior in the presence of a robot sensor fault this framework uses a Bayesian network. In the proposed framework, sensor data are used to detect a faulty sensor. Fault isolation is accomplished by changing the Bayesian network structure using interpreted evidence from robot sensors. Experiments including both simulation and a real robot are performed for door-crossing behavior using prior knowledge and sensor data at several maps. This paper explains the learning behavior, optimal tracking, exprimental setup and structure of the proposed framework. The robot uses laser and sonar sensors for door-crossing behavior, such that each sensor can be corrupted during the behavior. Experimental results show FTBN leads to robust behavior in the presence of a sensor fault as well as performing better compared to the conventional Bayesian method.     

Sonar Map Construction for Autonomous Mobile Robots Using a Data Association Filter

This paper presents a method for building a probability grid map for autonomous mobile robots with ultrasonic sensors using a data association filter (DAF). The method is based on evaluating the possibility that the acquired sonar data are all reflected by the same object. The DAF is able to associate data points with each other. Data affected by specular reflection are not likely to be associated with the same object, so they are excluded from the data cluster by the DAF, thereby improving the reliability of the data used for the probability grid map. Since the corrupted data are not used to update the probability map, it is possible to build a good quality grid map even in a specular environment. The DAF was applied to the Bayesian and the Orientation probability models, which are typical models used to build grid maps, to verify its effectiveness. Experimental results were also obtained using a mobile robot in a real-world environment.     

Development of the assistive mobile robot system: AMOS—to aid in the daily life of the physically handicapped

It can be exhausting, both physically and emotionally, to assist physically handicapped persons. Therefore, an assistive mobile system called AMOS (Assistive MObile robot System) has been developed to help alleviate this burden. The purpose of AMOS is to pick up and transport daily use objects, placing them in a designated indoor location semi-autonomously. AMOS consists of a self-contained mobile robot body, a user interface with a touch-panel and a computer network (Ethernet LAN, Internet). The user interacts with the mobile robot through a Web browser connected to a computer network, allowing for communication anytime, from anywhere and by anyone. This mode provides a simple way for communicating with and determining the status of the robot. Experiments were performed to verify the successful operation of AMOS. Although the system performed as designed, it would prove useful to the extend service area of the robot through communication mechanisms and the user interface.     

Application of Localization Based on the DC Magnetic Field that Occurs in the Environment on Wheel-Type Mobile Agricultural Robots

A wheel-type mobile robot is simply able to localize with odometry. However, for mobile agricultural robots, it is necessary to consider that the environment is uneven terrain. Therefore, odometry is unreliable and it is necessary to augment the odometry by measuring the position of the robot relative to known objects in the environments. This paper describes the application of localization based on the DC magnetic field that occurs in the environment on mobile agricultural robots. In this research, a magnetic sensor is applied to scan the DC magnetic field to build a magnetic database. The robot localizes by matching magnetic sensor readings against the magnetic database. The experimental results indicate that the robot is able to localize accurately with the proposed method and the cumulative error can be eliminated by applying the localization results to compensate for the odometry.     

Intelligent unmanned ground vehicle navigation via information evaluation

Sensor-centric navigation of unmanned ground vehicles (UGVs) operating in rugged and expansive terrains requires the competency to evaluate the utility of sensor information such that it results in intelligent behavior of the vehicles. Highly imperfect, inconsistent information and incomplete a priori knowledge introduce uncertainty in such unmanned navigation systems. Understanding and quantifying uncertainty yields a measure of useful information that plays a critical role in several robotic navigation tasks such as sensor fusion, mapping, localization, path planning and control. In this article, within a probabilistic framework, the utility of estimation and information-theoretic concepts towards quantifying uncertainty using entropy and mutual information metrics in various contexts of UGV navigation via experimental results is demonstrated.     

New Entropy-Based Adaptive Particle Filter for Mobile Robot Localization

Over the last decade, particle filters have been applied with great success to a variety of state estimation problem. The standard particle filter suffers poor efficiency during the estimation process, especially in the global localization and kidnapped problem. In this paper, we proposed a novel information entropy-based adaptive approach to improve the efficiency of particle filters by adapting the number of particles. The information entropy-based adaptive particle filter approaches use the information entropy to present the uncertainty of a mobile robot to the environment. By continuously obtaining the sensor information, the robot gradually reduces the uncertainty to the environment and, therefore, reduces the particle number for the estimation process. We derived the mathematic equation relating the information entropy with particle number. Extensive localization experiments using a mobile robot showed that our approach yielded drastic improvements and efficiency performance over a standard particle filter with fixed particles and over other adaptive approaches.     

Experimental analysis of gas-sensitive Braitenberg vehicles

This article addresses the problem of localizing a static gas source in an indoor environment by a mobile robot. In contrast to previous works, the environment is not artificially ventilated to produce a strong unidirectional airflow. Here, the dominant transport mechanisms of gas molecules are turbulence and convection flow rather than diffusion, which results in a patchy, chaotically fluctuating gas distribution. Two Braitenberg-type strategies (positive and negative tropotaxis) based on the instantaneously measured spatial concentration gradient were investigated. Both strategies were shown to be of potential use for gas source localization. As a possible solution to the problem of gas source declaration (the task of determining with certainty that the gas source has been found), an indirect localization strategy based on exploration and concentration peak avoidance is suggested. Here, a gas source is located by exploiting the fact that local concentration maxima occur more frequently near the gas source compared to distant regions.     

A fast,accurate and robust method for self-localization in polygonal environments using laser range finders

Self-localization is important in almost all robotic tasks. For playing an aesthetic and effective game of robotic soccer, self-localization is a necessary prerequisite. When we designed our robotic soccer team for participating in robotic soccer competitions, it turned out that none of the existing approaches met our requirements of being fast, accurate and robust. For this reason, we developed a new method, which is presented and analyzed in this paper. This method is one of the key components and is probably one of the explanations for the success of our team in national and international competitions. We also present experimental evidence that our method outperforms other self-localization methods in the RoboCup environment.     

Hybrid three-dimensional camera pose estimation using particle filter sensor fusion

To properly align objects in the real and virtual worlds in an augmented reality (AR) space it is essential to keep tracking the camera's exact three-dimensional position and orientation (camera pose). State-of-the-art analysis shows that traditional vision-based or inertial sensor-based solutions are not adequate when used individually. Sensor fusion for hybrid tracking has become an active research direction during the past few years, although how to do it in a robust and principled way is still an open problem. In this paper, we develop a hybrid camera pose-tracking system that combines vision and inertial sensor technologies. We propose to use the particle filter framework for the sensor fusion system. Particle filters are sequential Monte-Carlo methods based upon a point mass (or 'particle') representation of probability densities, which can be applied to any state space model and which generalize the traditional Kalman filtering methods. We have tested our algorithm to evaluate its performance and have compared the results obtained by the particle filter with those given by a classical extended Kalman filter. Experimental results are presented     

Behavior coordination in structured environments

Behavior coordination is a notorious problem in mobile robotics. Behaviors are either in competition or collaborating to achieve the goals of a system, which leads to requirements for arbitration and/or fusion of control signals. In most systems the arbitration is specified in terms of 'events' that denote positions or sensory input. The detection of these events allows discrete switching between groups of behaviors. In contrast, the fusion of behaviors is often achieved using potential fields, fuzzy rules or superposition. In most cases, the underlying theoretical foundation is rather weak and the behavior switching results in discrete changes in the overall system dynamics. In this paper, we present a scheme for behavior coordination that is grounded in the dynamical systems approach. The methodology provides a solid theoretical basis for analysis and design of individual behaviors and their coordination. This coordination framework is demonstrated in the context of a domestic robot for fetch-and-carry-type tasks. It is shown here that behavior coordination can be analyzed as an integral part of the design to facilitate smooth transition and fusion between behaviors.     

Differential GPS and odometry-based outdoor navigation of a mobile robot

This paper describes outdoor navigation for a mobile robot by using differential GPS (DGPS) and odometry in a campus walkway environment. The robot position is estimated by fusion of DGPS and odometry. The GPS receiver measures its position by radio waves from GPS satellites. The error of GPS measurement data increases near high buildings and trees because of multi-path and forward diffractions. Thus, it is necessary to pick up only accurate DGPS measurement data when the robot position is modified by fusing DGPS and odometry. In this paper, typical DGPS measurement data observed near high buildings and trees are reported. Then, the authors propose a novel position correction method by fusing GPS and odometry. Fusion of DGPS and odometry is realized using an extended Kalman filter framework. Moreover, outdoor navigation for a mobile robot is accomplished by using the proposed correction method.