双足机器人实时障碍检测视觉系统

提出一种双足步行机器人的实时障碍检测视觉系统．基于图像平面与机器人行走地面之间的映射变换矩阵的唯一性准则，判别图像中的像点是否位于地面上，高于或低于地面的点被认为是障碍点，为减少实际行走过程中系统外部和内部参数变化对映射变换矩阵的影响，系统加入了在线校正映射变换矩阵模块．在提取出障碍物体边缘后，通过对其三维信息的简单恢复，建立了机器人行走空间的障碍投影图．该系统计算量小，可靠性强，能基本满足双足步行机器人实时避障的要求。     

面向复杂背景中彩色立体图像的障碍物检测

目标识别技术作为图像理解领域的核心研究内容之一,一直以来是文献中讨论的热门话题.随着计算机科学的发展以及彩色成像设备的普及,越来越多的彩色立体图像在实际生产、生活中得到应用,面向彩色立体图像的目标识别技术逐渐成为吸引学者注意力的新方向.本文基于立体视觉信息,对安装在行进车辆上的两个摄像机在一段时间内获取的立体视频信息进行分析,提取车辆前方可能对行车安全造成威胁的障碍物.在V视差理论的基础上引入两个改进算法首先对原始立体图像进行数据净化和前景/背景分割,使后续算法不受复杂、多变背景的干扰,同时减少数据处理的冗余.然后使用绝对值差(SAD)[9]法直接计算彩色立体图像的浓密视差图,而无需彩色到灰度图像的转换.实验证明,本文提出的改进算法针对实际立体图像可以准确、快速地提取障碍物信息.     

基于射影不变量的三维重构

文中提出了利用射影不变量来求解基于图像对三维深度恢复问题。方法的基本思想是对于立体图像,利用密度段元素,引入了两个射影不变量来恢复密度段的深度信息。从这两个不变量,能推导立体图像中匹配的密度段对所满足的关系。利用这个关系,实现了密度段之间的匹配运算。这个方法能直接地从输入图像中得到密集和准确的深度,对变形的图像具有鲁棒性。     

一种无需基础矩阵的鲁棒性极线校正算法

立体视觉校正也称为极线校正,它的目的是使得立体图像的对应极线平行于水平方向,消除垂直方向上的视差,从而使得在立体匹配过程中可以更为快速准确地寻找对应点.在传统的投影校正算法的基础上提出了一种鲁棒性校正算法,直接通过原始匹配点计算投影变换矩阵,利用遗传算法良好的全局搜索能力和Levenberg-Marquardt算法稳定快速的局部搜索功能进行分步优化计算,同时本算法采用了随机抽样一致算法（RANSAC）鲁棒估计思想,避免了由于对应点噪声引起的误差.此外,还针对两个平行放置的摄像机之间具有较小运动的情况,提出了一种鲁棒的优化函数.实验结果说明,该算法是一种有效的极线校正方法.     

基于边缘最优映射的红外和可见光图像自动配准算法

针对同一场景的红外和可见光图像间一致特征难以提取和匹配的难题, 提出了一种在多尺度空间中基于边缘最优映射的自动配准算法. 在由粗至细的尺度空间中, 算法分别采用仿射模型和投影模型作为参考图像和待配准图像间的空间变换模型. 在每个尺度层上, 首先基于相位一致性方法提取两幅图像的边缘结构, 并在相应的空间变换模型下将在待配准图像中提取的二值边缘映射到参考图像的边缘强度图上; 接着采用并行遗传算法寻找一组全局最优的模型参数, 使两幅图像间的结构相似度最大. 在各层的寻优结束之后, 使用Powell算法对全局寻优后的模型参数进行局部精化. 实验结果表明, 该算法能够充分利用图像间的视觉相似结构, 有效地实现红外和可见光图像的自动配准.     

Automatic feature matching in uncalibrated stereo vision through the use of color

One difficult problem in stereo vision is how to establish correspondence between features extracted from a pair of images. The difficulty is due to ambiguities or inconsistencies of available information on images. In this paper, we invetigate stereo correspondence problem in the framework of color stereo vision. We propose the use of a matching consistence (MC) constraint in RGB color space and the generalized epipolar geometry to develop an automatic feature matching algorithm.     

Theory and Practice of Projective Rectification

This paper gives a new method for image rectification, the process of resampling pairs of stereo images taken from widely differing viewpoints in order to produce a pair of matched epipolar projections. These are projections in which the epipolar lines run parallel with the x-axis and consequently, disparities between the images are in the x-direction only. The method is based on an examination of the fundamental matrix of Longuet-Higgins which describes the epipolar geometry of the image pair. The approach taken is consistent with that advocated by Faugeras (1992) of avoiding camera calibration. The paper uses methods of projective geometry to determine a pair of 2D projective transformations to be applied to the two images in order to match the epipolar lines. The advantages include the simplicity of the 2D projective transformation which allows very fast resampling as well as subsequent simplification in the identification of matched points and scene reconstruction.     

Stereo rectification of pushbroom satellite images by robustly estimating the fundamental matrix

ABSTRACT

Stereo rectification is one of the most important steps for stereo matching and subsequently for digital surface model generation from satellite stereo images. This study proposes a new framework to rectify two pushbroom images along the epipolar geometry in order to omit the vertical parallax between two images. Here, we assume the interior and relative parameters between the two pushbroom images are not known and the images can be taken at different dates. Traditional stereo rectification methods of pushbroom images require metadata such as rational polynomial coefficients (RPCs), parameters of physical sensor model or ground control points (GCPs). In this study, we develop an image-based framework for stereo rectification, which works without the need for such data. In the proposed framework, the correspondences are densely extracted by a tilling strategy, and then the fundamental matrix is robustly estimated by two geometric constraints. Both affine and projective fundamental matrices could be used for stereo rectification from pushbroom stereo images. The results on IRS P5, World view III, GeoEye and IKONOS stereo pairs as well as on multi-date stereo images demonstrate that the pushbroom images are rectified with sub-pixel accuracy.     

一种基于双目立体视觉的图像校正算法设计

立体校正作为立体匹配的先决条件,能消除图像对对应像素的垂直视差,有效地提高立体匹配的精确度.针对校正带来的图像失真问题,研究了一种新的非标定相机的立体校正方法.该方法首先利用SIFT算法提取匹配点,再结合极线校正准则和雅可比行列式来构建能量函数,通过最小化能量函数求得基础矩阵和校正投影变换矩阵,并在像素级上优化了投影变换矩阵.研究结果表明:所设计的校正方法有效地减小了校正误差,更好地保持了原图像的重采样,降低了图像的失真度.     

结合SURF算子和极线约束的柑橘立体图像对匹配

提出一种结合SURF算子和极线约束的立体匹配方法。对采集的双目视觉柑橘图像进行R-B分量的计算,在该分量上,采用快速hessian检测子进行特征点检测,并使用SURF描述子对检测到的特征点进行64维的特征描述。采用欧式距离和极线约束进行特征点匹配。实验表明,该方法对一幅图像对的平均处理时间为293ms,在果实被遮挡或光线变化的情况下均能较好地进行特征点提取和匹配。该方法为后续的深度信息计算提供了基础。     

Robust multiscale stereo matching from fundus images with radiometric differences

A robust multiscale stereo matching algorithm is proposed to find reliable correspondences between low contrast and weakly textured retinal image pairs with radiometric differences. Existing algorithms designed to deal with piecewise planar surfaces with distinct features and Lambertian reflectance do not apply in applications such as 3D reconstruction of medical images including stereo retinal images. In this paper, robust pixel feature vectors are formulated to extract discriminative features in the presence of noise in scale space, through which the response of low-frequency mechanisms alter and interact with the response of high-frequency mechanisms. The deep structures of the scene are represented with the evolution of disparity estimates in scale space, which distributes the matching ambiguity along the scale dimension to obtain globally coherent reconstructions. The performance is verified both qualitatively by face validity and quantitatively on our collection of stereo fundus image sets with ground truth, which have been made publicly available as an extension of standard test images for performance evaluation.     

架空输电线路巡线机器人的视觉导航

巡线机器人沿相线行走时必须探测识别和定位各种障碍物,并根据障碍类型规划越障行为。针对220 kV架空输电线路的结构特点,利用视觉传感器,设计了基于结构约束的障碍识别算法,完成了障碍识别和分类。根据障碍物的结构特点,设计了一种自适应多窗口区域立体匹配算法,实现了障碍物的双目视觉定位。模拟线路实验结果表明,算法能可靠地从复杂背景中识别并定位出防振锤、悬垂线夹和耐张线夹等障碍物,满足了巡线机器人导航要求。     

Target Detection Based on 3D Multi-Component Model and Inverse Projection Transformation

Target detection based on image/video, being involved to deal with the geometry and scale deformation, as well as the change in the form of movement caused by camera imaging, algorithms are always designed complexly. Though, object shelter and adhesion still cannot be well resolved. Considering of that, a new method for target detection on true 3D space based on the inverse projection transformation and a mixing component model is proposed. Firstly, the inverse projective arrays parallel to target local surface are established on 3D space. Then, the 2D image is inversely projected to these planes through 3D point cloud re-projection, and a lot of inverse projective images with target local apparent characteristics are gained. After that, component HOG feature dictionaries are trained using the inverse projective images as samples, and on account of it, sparse decomposition approach is adopted to detect target local components. Finally, 3D centroid clustering for all the components is further used to identify the target. Experiment results indicate that the target detection method on true 3D space based on multi-components model and inverse projection transformation can not only deal with the object occlusion and adhesion perfectly, but also adapt to the multi-angle target detection well, and the accuracy and speed is far beyond that of the algorithm on 2D image.     

Vision-Based Obstacle Detection and Avoidance: Application to Robust Indoor Navigation of Mobile Robots

We propose a more practical and efficient method for obstacle detection and avoidance. In this paper, a robot detects obstacles based on the projective invariants of stereo cameras, fuses this information with two-dimensional scanning sensor data, and finally builds up a more informative and conservative occupancy map. Although this approach is not supposed to recognize the exact shape of the obstacles, this shortcoming is overcome in the actual application by its fast calculation time and robustness against the illumination conditions. To avoid detected obstacles, a new reactive obstacle avoidance strategy is also presented. To evaluate the proposed method, we applied it to the mobile robot iMARO-III. In this test, iMARO-III has succeeded in long-term operation for 7 days continuously without any intervention of engineers and any collision in the real office environment.     

VisionBug: A Hexapod Robot Controlled by Stereo Cameras

A six-legged robot system demonstrating reactive behaviors of simple organisms—walking between two walls, steering around obstacles, making turns at corners, and making U-turns at pathway dead-ends—is described. The system, named VisionBug, uses no active range sensor but only a stereo pair of cameras for sensing the surroundings. The system assumes the surroundings to be consisting of mostly a ground surface, although the surface could have a varying geometric relationship with the robot due to the jiggling nature of legged motion. By the use of the image-to-image mapping induced to the stereo images by the ground surface, the system is able to avoid explicit 3D reconstruction and the use of optical flow altogether in locating through-ways. Specifically, it regards image features not respecting the ground-induced mapping as obstacles, and express the obstacles in terms of a 2D distribution on the ground. Based on the distribution information, which is further time-delay compensated, a simple fuzzy control mechanism is used to command the legged motion. Experiments show that the system is effective for demonstrating the above-mentioned behaviors in textured environment, at a speed fast enough for many applications.     

A New Method of Image Mosaicking and Its Application to Cultural Heritage Representation

This paper presents an original two-step procedure for estimating projective transformations between pairs of images: first, the transformation between the images is approximated as an affine transformation; second, this estimate is refined into that of a projective transformation. This strategy for matching projective views is computationally very efficient. The proposed method can be applied both to mosaicking of high resolution images of planar textured objects (e.g., frescoes and paintings), with subpixel accuracy, and to construction of panoramic images. Practical examples of mosaicking of cultural heritage imagery obtained by using the presented procedure are discussed in the paper.     

基于SIFT特征描述子的立体匹配算法

目前,立体匹配是计算机视觉领域最活跃的研究课题之一。为了克服传统的局部特征匹配算法对噪声和图像灰度的非线性变换敏感的缺点,本文提出了一种新的基于SIFT(Scale Invariant Feature Transform)特征描述子的立体匹配算法。该算法利用图像梯度信息,构造基于三维梯度方向直方图的SIFT特征描述子作为区域特征描述符,通过立体视觉理论中的极线约束将匹配特征的搜索空间从二维降到一维,最后以基于特征描述子欧氏距离的最近邻匹配得到匹配结果。实验结果表明,该方法匹配精度高,对图像灰度的非线性变换比较鲁棒,可以应用于对匹配算法鲁棒性要求比较高的立体视觉系统中。     

立体视觉中的三目匹配方法研究

本文提出了利用金字塔图传播匹配的三目基元立体视觉方法．该方法中匹配起始三 元组的选择建立在透视投影的可靠基础之上,而进行传播匹配可以加速计算,并避免了可能 的误匹配．传播匹配利用立体图像组在二值边界图像金字塔图中的结构相似性,而整个匹配 结果的考察与认定是通过传播率的比较实现的．该方法能够有效地克服双目立体视觉方法的 某些本质局限性,确保匹配结果精确可靠．     

An Evolutionary-Based Stereo Matching Method with a Multilevel Searching Strategy

Stereo matching is one of the fundamental problems in computer vision. It consists in identifying features in two or more stereo images that are generated by the same physical feature in the three-dimensional space. This paper presents an evolutionary approach with a multilevel searching strategy for matching edges extracted from two stereo images. The matching problem is turned into an optimization task, which is performed by means of a genetic algorithm with a new encoding scheme. For an effective exploitation of the genetic stereo matching algorithm for real-time obstacle detection, a multilevel searching strategy is proposed to match the edges at different levels by considering their gradient magnitudes. Experimental results and comparative analysis are presented to demonstrate the effectiveness of the proposed method for real-time obstacle detection in front of a moving vehicle using linear stereo vision.     

基于特征匹配的关联投影纹理映射

在虚拟现实场景中,动态现实的重建过程尤为复杂,一般需要大量包含现实信息的图像进行整合。这些图像大部分都与其中一张或多张图像存在着公共区域,本文提出基于特征匹配的关联投影映射方法,根据这些公共区域,通过SIFT特征匹配提取图像之间的关联特性,利用此关联构造视图变换矩阵进行新的投影纹理映射。实验结果表明,这种方法稳定有效,并在重建动态现实中具有良好的应用效果。 