Mars microrover navigation: Performance evaluation and enhancement

In 1996, NASA will launch the Mars Pathfinder spacecraft, which will carry an 11 kg rover to explore the immediate vicinity of the lander. To assess the capabilities of the rover, as well as to set priorities for future rover research, it is essential to evaluate the performance of its autonomous navigation system as a function of terrain characteristics. Unfortunately, very little of this kind of evaluation has been done, for either planetary rovers or terrestrial applications. To fill this gap, we have constructed a new microrover testbed consisting of the Rocky 3.2 vehicle and an indoor test arena with overhead cameras for automatic, real-time tracking of the true rover position and heading. We create Mars analog terrains in this arena by randomly distributing rocks according to an exponential model of Mars rock size frequency created from Viking lander imagery. To date, we have recorded detailed logs from over 85 navigation trials in this testbed. In this paper, we outline current plans for Mars exploration over the next decade, summarize the design of the lander and rover for the 1996 Pathfinder mission, and introduce a decomposition of rover navigation into four major functions: goal designation, rover localization, hazard detection, and path selection. We then describe the Pathfinder approach to each function, present results to date of evaluating the performance of each function, and outline our approach to enhancing performance for future missions. The results show key limitations in the quality of rover localization, the speed of hazard detection, and the ability of behavior control algorithms for path selection to negotiate the rock frequencies likely to be encountered on Mars. We believe that the facilities, methodologies, and to some extent the specific performance results presented here will provide valuable examples for efforts to evaluate robotic vehicle performance in other applications.     

Visual terrain mapping for Mars exploration

One goal for future Mars missions is for a rover to be able to navigate autonomously to science targets not visible to the rover, but seen in orbital or descent images. This can be accomplished if accurate maps of the terrain are available for the rover to use in planning and localization. We describe techniques to generate such terrain maps using images with a variety of resolutions and scales, including surface images from the lander and rover, descent images captured by the lander as it approaches the planetary surface, and orbital images from current and future Mars orbiters. At the highest resolution, we process surface images captured by rovers and landers using bundle adjustment. At the next lower resolution (and larger scale), we use wide-baseline stereo vision to map terrain distant from a rover with surface images. Mapping the lander descent images using a structure-from-motion algorithm generates data at a hierarchy of resolutions. These provide a link between the high-resolution surface images and the low-resolution orbital images. Orbital images are mapped using similar techniques, although with the added complication that the images may be captured with a variety of sensors. Robust multi-modal matching techniques are applied to these images. The terrain maps are combined using a system for unifying multi-resolution models and integrating three-dimensional terrains. The result is a multi-resolution map that can be used to generate fixed-resolution maps at any desired scale.     

The perceptive workbench: Computer-vision-based gesture tracking,object tracking,and 3D reconstruction for augmented desks

Abstract. The Perceptive Workbench endeavors to create a spontaneous and unimpeded interface between the physical and virtual worlds. Its vision-based methods for interaction constitute an alternative to wired input devices and tethered tracking. Objects are recognized and tracked when placed on the display surface. By using multiple infrared light sources, the object's 3-D shape can be captured and inserted into the virtual interface. This ability permits spontaneity, since either preloaded objects or those objects selected at run-time by the user can become physical icons. Integrated into the same vision-based interface is the ability to identify 3-D hand position, pointing direction, and sweeping arm gestures. Such gestures can enhance selection, manipulation, and navigation tasks. The Perceptive Workbench has been used for a variety of applications, including augmented reality gaming and terrain navigation. This paper focuses on the techniques used in implementing the Perceptive Workbench and the system's performance.     

Mobile robot navigation and scene modeling using stereo fish-eye lens system

We present an autonomous mobile robot navigation system using stereo fish-eye lenses for navigation in an indoor structured environment and for generating a model of the imaged scene. The system estimates the three-dimensional (3D) position of significant features in the scene, and by estimating its relative position to the features, navigates through narrow passages and makes turns at corridor ends. Fish-eye lenses are used to provide a large field of view, which images objects close to the robot and helps in making smooth transitions in the direction of motion. Calibration is performed for the lens-camera setup and the distortion is corrected to obtain accurate quantitative measurements. A vision-based algorithm that uses the vanishing points of extracted segments from a scene in a few 3D orientations provides an accurate estimate of the robot orientation. This is used, in addition to 3D recovery via stereo correspondence, to maintain the robot motion in a purely translational path, as well as to remove the effects of any drifts from this path from each acquired image. Horizontal segments are used as a qualitative estimate of change in the motion direction and correspondence of vertical segment provides precise 3D information about objects close to the robot. Assuming detected linear edges in the scene as boundaries of planar surfaces, the 3D model of the scene is generated. The robot system is implemented and tested in a structured environment at our research center. Results from the robot navigation in real environments are presented and discussed. Received: 25 September 1996 / Accepted: 20 October 1996     

Improved Rover State Estimation in Challenging Terrain

Given ambitious mission objectives and long delay times between command-uplink/data-downlink sessions, increased autonomy is required for planetary rovers. Specifically, NASA's planned 2003 and 2005 Mars rover missions must incorporate increased autonomy if their desired mission goals are to be realized. Increased autonomy, including autonomous path planning and navigation to user designated goals, relies on good quality estimates of the rover's state, e.g., its position and orientation relative to some initial reference frame. The challenging terrain over which the rover will necessarily traverse tends to seriously degrade a dead-reckoned state estimate, given severe wheel slip and/or interaction with obstacles. In this paper, we present the implementation of a complete rover navigation system. First, the system is able to adaptively construct semi-sparse terrain maps based on the current ground texture and distances to possible nearby obstacles. Second, the rover is able to match successively constructed terrain maps to obtain a vision-based state estimate which can then be fused with wheel odometry to obtain a much improved state estimate. Finally the rover makes use of this state estimate to perform autonomous real-time path planning and navigation to user designated goals. Reactive obstacle avoidance is also implemented for roaming in an environment in the absence of a user designated goal. The system is demonstrated in soft soil and relatively dense rock fields, achieving state estimates that are significantly improved with respect to dead reckoning alone (e.g., 0.38 m mean absolute error vs. 1.34 m), and successfully navigating in multiple trials to user designated goals.     

Theory and experiments in SmartNav rover navigation

This paper describes theoretical and experimental results using the SmartNav rule-free fuzzy rover navigation system. SmartNav divides the terrain perceived by the rover into a number of circular sectors, and evaluates each sector using goal and safety preference factors to differentiate between preferred and unpreferred terrain sectors. The goal-preference factor is used to make sector evaluation based on the sector orientation relative to the designated goal position. The safety-preference factors are used to make sector evaluations on the basis of the sector local and regional terrain hazards. Three methods are developed to blend the three sector evaluations in order to find the effective preference factor for each sector. Two sector selection methods are then described in which the sector preference factors are used to find the heading command for the rover. The rover speed command is also computed based on the goal distance and safety-preference factor of the chosen sector. The above navigation steps are continuously repeated throughout the rover motion. Experimental results are presented to demonstrate the navigational capabilities of SmartNav using a commercial Pioneer 2AT rover traversing a simulated Martian terrain at the JPL Mini Mars Yard.

---

     

摇臂-转向架式行星探测车移动系统的准静态分析

行星探测车移动系统是探测车整体系统的关键部分之一，摇臂—转向架式移动系 统是一种对地形具有自适应能力、机动性较强的系统．本文在研究摇臂—转向架式移动系统 机械结构的基础上，对其进行了准静态分析，所得的结构参数可作为分析和优化探测车移动 系统概念设计的主要工具．     

An intelligent terrain-based navigation system for planetary rovers

A fuzzy logic framework for onboard terrain analysis and guidance towards traversable regions. An onboard terrain-based navigation system for mobile robots operating on natural terrain is presented. This system utilizes a fuzzy-logic framework for onboard analysis of the terrain and develops a set of fuzzy navigation rules that guide the rover toward the safest and the most traversable regions. The overall navigation strategy deals with uncertain knowledge about the environment and uses the onboard terrain analysis to enable the rover to select easy-to-traverse paths to the goal autonomously. The navigation system is tested and validated with a set of physical rover experiments and demonstrates the autonomous capability of the system     

A stereovision system for a planetary rover: calibration, correlation, registration, and fusion

This paper describes a complete stereovision system, which was originally developed for planetary applications, but can be used for other applications such as object modeling. A new effective on-site calibration technique has been developed, which can make use of the information from the surrounding environment as well as the information from the calibration apparatus. A correlation-based stereo algorithm is used, which can produce sufficient dense range maps with an algorithmic structure for fast implementations. A technique based on iterative closest-point matching has been developed for registration of successive depth maps and computation of the displacements between successive positions. A statistical method based on the distance distribution is integrated into this registration technique, which allows us to deal with such important problems as outliers, occlusion, appearance, and disappearance. Finally, the registered maps are expressed in the same coordinate system and are fused, erroneous data are eliminated through consistency checking, and a global digital elevation map is built incrementally.     

Seeker—Autonomous Long‐range Rover Navigation for Remote Exploration

Under the umbrella of the European Space Agency (ESA) StarTiger program, a rapid prototyping study called Seeker was initiated. A range of partners from space and nonspace sectors were brought together to develop a prototype Mars rover system capable of autonomously exploring several kilometers of highly representative Mars terrain over a three‐day period. This paper reports on our approach and the final field trials that took place in the Atacama Desert, Chile. Long‐range navigation and the associated remote rover field trials are a new departure for ESA, and this activity therefore represents a novel initiative in this area. The primary focus was to determine if current computer vision and artificial intelligence based software could enable such a capability on Mars, given the current limit of around 200 m per Martian day. The paper does not seek to introduce new theoretical techniques or compare various approaches, but it offers a unique perspective on their behavior in a highly representative environment. The final system autonomously navigated 5.05 km in highly representative terrain during one day. This work is part of a wider effort to achieve a step change in autonomous capability for future Mars/lunar exploration rover platforms.     

Rule–based reasoning and neural network perception for safe off–road robot mobility

Operational safety and health monitoring are critical matters for autonomous field mobile robots such as planetary rovers operating on challenging terrain. This paper describes relevant rover safety and health issues and presents an approach to maintaining vehicle safety in a mobility and navigation context. The proposed rover safety module is composed of two distinct components: safe attitude (pitch and roll) management and safe traction management. Fuzzy logic approaches to reasoning about safe attitude and traction management are presented, wherein inertial sensing of safety status and vision–based neural network perception of terrain quality are used to infer safe speeds of traversal. Results of initial field tests and laboratory experiments are also described. The approach provides an intrinsic safety cognizance and a capacity for reactive mitigation of robot mobility and navigation risks.     

Analog computation for phase-based disparity estimation: continuous and discrete models

The analog implementation of a phase-based technique for disparity estimation is discussed. This technique is based on the convolution of images with Gabor filters. The article shows that by replacing the Gaussian envelope with other envelopes, the convolution operation is equivalent to the solution of a system of differential equations, whose order is related to the smoothness of the kernel. A detailed comparison between the disparity estimates obtained using these kernels and those obtained using the standard filter is presented. The discretization of the model leads to lattice networks in which the number of connections per node required to perform convolution is limited to the first few nearest neighbors. The short connection length makes these filter suitable for analog VLSI implementation, for which the number of connection per node is a crucial factor. Experimental measures on a prototype CMOS 17-node chip validated the approach. Received: 27 October 1997 / Accepted: 18 June 1998     

Reconstructing a textured CAD model of an urban environment using vehicle-borne laser range scanners and line cameras

Abstract. In this paper, a novel method is presented for generating a textured CAD model of an outdoor urban environment using a vehicle-borne sensor system. In data measurement, three single-row laser range scanners and six line cameras are mounted on a measurement vehicle, which has been equipped with a GPS/INS/Odometer-based navigation system. Laser range and line images are measured as the vehicle moves forward. They are synchronized with the navigation system so they can be geo-referenced to a world coordinate system. Generation of the CAD model is conducted in two steps. A geometric model is first generated using the geo-referenced laser range data, where urban features, such as buildings, ground surfaces, and trees are extracted in a hierarchical way. Different urban features are represented using different geometric primitives, such as a planar face, a triangulated irregular network (TIN), and a triangle. The texture of the urban features is generated by projecting and resampling line images onto the geometric model. An outdoor experiment is conducted, and a textured CAD model of a real urban environment is reconstructed in a full automatic mode.     

SmartNav: A rule‐free fuzzy approach to rover navigation

This paper introduces the basic concepts of the SmartNav rule‐free fuzzy approach to safe rover navigation through hazardous natural terrain. This novel “rule‐free” approach reduces the complexity in rover navigation where many alternative paths must be evaluated and compared. The SmartNav rover navigation architecture integrates goal attainment with both local and regional hazard avoidance. Goal and safety preference factors differentiate between preferred and unpreferred terrain sectors. The goal‐preference factor is used to make sector evaluation based on the sector orientation relative to the designated goal position. The safety‐preference factors are used to make sector evaluations on the basis of the sector local and regional hazards. These sector evaluations are blended to find the effective preference factor for each sector. The preference factors of all sectors are then compared to choose the heading command for the rover. The rover speed command is also computed based on the goal distance and safety‐preference factor of the chosen sector. The above navigation steps are continuously repeated throughout the rover motion. Numerical examples are presented to illustrate the basic concepts introduced in this paper, and tests on a commercial rover are planned. © 2005 Wiley Periodicals, Inc.     

A memory-based approach to sensory-motor coordination

In this work a visual-based autonomous system capable of memorizing and recalling sensory-motor associations is presented. The robot's behaviors are based on learned associations between its sensory inputs and its motor actions. Perception is divided into two stages. The first one is functional: algorithmic procedures extract in real time visual features such as disparity and local orientation from the input images. The second stage is mnemonic: the features produced by the different functional areas are integrated with motor information and memorized or recalled. An efficient memory organization and fast information retrieval enables the robot to learn to navigate and to avoid obstacles without need of an internal metric reconstruction of the external environment. Received: 22 November 1996 / Accepted: 18 November 1997     

Learned Stochastic Mobility Prediction for Planning with Control Uncertainty on Unstructured Terrain

Motion planning for planetary rovers must consider control uncertainty in order to maintain the safety of the platform during navigation. Modeling such control uncertainty is difficult due to the complex interaction between the platform and its environment. In this paper, we propose a motion‐planning approach whereby the outcome of control actions is learned from experience and represented statistically using a Gaussian process regression model. This mobility prediction model is trained using sample executions of motion primitives on representative terrain, and it predicts the future outcome of control actions on similar terrain. Using Gaussian process regression allows us to exploit its inherent measure of prediction uncertainty in planning. We integrate mobility prediction into a Markov decision process framework and use dynamic programming to construct a control policy for navigation to a goal region in a terrain map built using an onboard depth sensor. We consider both rigid terrain, consisting of uneven ground, small rocks, and nontraversable rocks, and also deformable terrain. We introduce two methods for training the mobility prediction model from either proprioceptive or exteroceptive observations, and we report results from nearly 300 experimental trials using a planetary rover platform in a Mars‐analogue environment. Our results validate the approach and demonstrate the value of planning under uncertainty for safe and reliable navigation.     

Stereo perception and dead reckoning for a prototype lunar rover

This paper describes practical, effective approaches to stereo perception and dead reckoning, and presents results from systems implemented for a prototype lunar rover operating in natural, outdoor environments.The stereo perception hardware includes a binocular head mounted on a motion-averaging mast. This head provides images to a normalized correlation matcher, that intelligently selects what part of the image to process (saving time), and subsamples the images (again saving time) without subsampling disparities (which would reduce accuracy). The implementation has operated successfully during long-duration field exercises, processing streams of thousands of images.The dead reckoning approach employs encoders, inclinometers, a compass, and a turn-rate sensor to maintain the position and orientation of the rover as it traverses. The approach integrates classical odometry with inertial guidance. The implementation succeeds in the face of significant sensor noise by virtue of sensor modelling, plus extensive filtering.The stereo and dead reckoning components are used by an obstacle avoidance planner that projects a finite number of arcs through the terrain map, and evaluates the traversability of each arc to choose a travel direction that is safe and effective. With these components integrated into a complete navigation system, a prototype rover has traversed over 1 km in lunar-like environments.     

轮式移动机器人与地形交互运动仿真研究

分析了轮式移动机器人（WMR）在不平坦的三维地形上运动的运动学模型,利用速度投影法,得到了一种WMR运动模型的新的形式。基于虚拟现实技术,利用VC + +OpenGL实现了WMR虚拟漫游系统。该系统具有较强的交互性和实时性,为星球探测机器人虚拟导航、遥操作提供了验证平台。     

Utilization of stereo disparity and optical flow information for the computer analysis of human interactions

We propose a system that simultaneously utilizes the stereo disparity and optical flow information of real-time stereo grayscale multiresolution images for the recognition of objects and gestures in human interactions. For real-time calculation of the disparity and optical flow information of a stereo image, the system first creates pyramid images using a Gaussian filter. The system then determines the disparity and optical flow of a low-density image and extracts attention regions in a high-density image. The three foremost regions are recognized using higher-order local autocorrelation features and linear discriminant analysis. As the recognition method is view based, the system can process the face and hand recognitions simultaneously in real time. The recognition features are independent of parallel translations, so the system can use unstable extractions from stereo depth information. We demonstrate that the system can discriminate the users, monitor the basic movements of the user, smoothly learn an object presented by users, and can communicate with users by hand signs learned in advance. Received: 31 January 2000 / Accepted: 1 May 2001 Correspondence to: I. Yoda (e-mail: yoda@ieee.org, Tel.: +81-298-615941, Fax: +81-298-613313)     

Autonomous over-the-horizon navigation using LIDAR data

In this paper we present the approach for autonomous planetary exploration developed at the Canadian Space Agency. The goal of this work is to enable autonomous navigation to remote locations, well beyond the sensing horizon of the rover, with minimal interaction with a human operator. We employ LIDAR range sensors due to their accuracy, long range and robustness in the harsh lighting conditions of space. Irregular Triangular Meshes (ITMs) are used for representing the environment, providing an accurate, yet compact, spatial representation. In this paper a novel path-planning technique through the ITM is introduced, which guides the rover through flat terrain and safely away from obstacles. Experiments performed in CSA’s Mars emulation terrain, validating our approach, are also presented.