双目立体视觉栅格地图构建方法

本文基于立体视觉定位技术,提出了基于双目立体视觉的栅格地图构建方法,用以解决目前视觉SLAM技术构建的稀疏特征地图难以直接用于自主导航的问题。本文提出的方法仅以视觉信息作为输入实时完成移动机器人自定位与外界环境栅格地图的构建。首先采用双目立体视觉定位获取机器人运动参数,利用稠密匹配估算空间点云分布,在考虑机器人实际高度的情况下将三维点云投影成二维数据,最后通过二值贝叶斯滤波器在线构建栅格地图。本文所构建的栅格地图包含环境几何信息,可直接应用于机器人路径规划与导航。实验结果验证了本文所以出的定位与地图构建方法的可行性。     

移动机器人基于激光测距和单目视觉的室内同时定位和地图构建

该文研究了部分结构化室内环境中自主移动机器人同时定位和地图构建问题.基于激光和视觉传感器模型的不同,加权最小二乘拟合方法和非局部最大抑制算法被分别用于提取二维水平环境特征和垂直物体边缘.为完成移动机器人在缺少先验地图支持的室内环境中的自主导航任务,该文提出了同时进行扩展卡尔曼滤波定位和构建具有不确定性描述的二维几何地图的具体方法.通过对于SmartROB-2移动机器人平台所获得的实验结果和数据的分析讨论,论证了所提出方法的有效性和实用性.     

基于激光测距与双目视觉信息融合的移动机器人SLAM研究

未知复杂环境中不规则的障碍物使传感数据具有不确定性,单依靠激光测距仪进行移动机器人的定位与自主导航可靠性不足;针对此问题,提出了一种基于激光测距仪和双目视觉传感器信息融合的精确定位方法,利用加权最小二乘拟合方法和尺度不变特征变换(SIFT)算法分别从对激光信息与视觉信息中提取直线和点特征,进行特征级的信息融合。通过对实验结果和数据分析,多传感器信息融合可以有效提高移动机器人SLAM(即时定位与地图构建)的精度和鲁棒性。     

使用NDT激光扫描匹配的移动机器人定位方法

提出一种将基于扫描匹配的蒙特卡洛定位方法,作为移动机器人完成自主任务的鲁棒性定位方法． 采用一种新的正态分布转换(NDT)激光扫描匹配算法,将从单个激光扫描重构的2D离散数据点集转换成2维平面内分段连续可微的概率分布,并使用Hessian矩阵法与另外的扫描相匹配,可以避免点与点之间对应的复杂问题．实验结果表明,该定位算法可以利用自然环境特征有效地完成室内环境下的自主定位．     

基于聚类匹配的移动机器人地图实时创建算法

提出了一种基于模式识别聚类思想的数据点集匹配算法.该匹配算法具有传统迭代匹配算法和非迭代匹配算法的优点,匹配速度快,精度高.结合上述匹配算法,给出了一种基于激光测距仪的移动机器人环境地图实时创建方法.该方法使用从环境数据中提取出的特征点来完成两组激光数据点集的匹配,进而完成环境地图的创建.利用本实验室自主研发的救援机器人平台对该算法进行了验证,实验结果表明,该算法能够完成室内环境下移动机器人实时准确有效的环境地图创建.     

基于双目视觉的掘锚机器人行驶位移检测方法

针对掘锚机器人在行驶过程中存在行驶位移检测精度低的问题,以已支护锚杆为定位基准,通过分析掘锚机器人与已支护锚杆之间的距离关系,建立“掘锚机器人-已支护锚杆”定位模型,提出一种基于双目视觉的掘锚机器人行驶位移检测方法。煤矿井下环境复杂,采用传统的Census变换算法得到的视差图具有局限性,通过分析双目视觉测距原理,提出一种改进Census变换算法获取锚杆的视差图,得到锚杆图像的深度信息;提出一种锚杆特征的识别与定位方法,利用边缘检测算法对视差图中的锚杆进行轮廓提取,采用最小外接矩形与最大外接矩形算法对锚杆轮廓进行框选,提取锚杆特征点的像素坐标,通过分析坐标转换关系将特征点像素坐标转换为世界坐标,采用最小二乘法将特征点空间坐标拟合成一条直线,经过该直线建立平行于巷道截面的平面,解算双目相机与该平面之间的距离,进而得到掘锚机器人与该平面之间的距离。搭建移动机器人平台进行掘锚机器人行驶位移检测实验,结果表明：改进后的Census变换算法使误匹配率从19.85%降低到11.52%,较传统Census变换算法的误匹配率降低了41.96%;锚杆特征点识别与定位方法能够有效提取锚杆特征点的空间坐标,经...     

基于激光雷达与双目视觉的移动机器人SLAM研究

为解决移动机器人在环境未知条件下,利用单一传感器自主导航时不能及时定位、构建地图不精确的问题,提出采用一种改进RBPF算法,在计算提议分布时将移动机器人的观测数据(视觉信息与激光雷达信息)和里程计信息融合;针对一般视觉图像特征点提取算法较慢的问题,采用基于ORB算法对视觉图像进行处理以加快视觉图像处理速度的方法;最后通过在安装有开源机器人操作系统(ROS)的履带式移动机器人进行实验,验证了采用该方法可构建可靠性更高、更精确的2D栅格图,提高了移动机器人SLAM的鲁棒性.     

基于主动环形闭合约束的移动机器人分层同时定位和地图创建

基于Rao-Blackwellized粒子滤波器提出了一种基于主动闭环策略的移动机器人分层同时定位和地图创建(simultaneous localization and mapping,SLAM)方法,基于信息熵的主动闭环策略同时考虑机器人位姿和地图的不确定性;局部几何特征地图之间的相对关系通过一致性算法估计,并通过环形闭合约束的最小化过程回溯修正.在仅有单目视觉和里程计的基础上,建立了鲁棒的感知模型;通过有效的尺度不变特征变换(scale invariant feature transform,SIFT)方法提取环境特征,基于KD-Tree的最近邻搜索算法实现特征匹配.实际实验表明该方法为实现SLAM提供了一种有效可靠的途径.     

一种低功耗程控滤波器的设计

针对目前移动机器人同时定位与地图创建(SLAM)研究中多采用激光雷达或超声环作为测距传感器导致系统复杂、成本高的问题,提出了一种利用舵机带动单超声传感器扫描的低成本设计方案。在高斯超声模型基础上,利用贝叶斯公式对栅格地图进行概率更新,并结合Sobel边缘检测算法提取特征点,实现了由不确定的移动机器人坐标系向固定的以环境特征点为原点的全局环境坐标系的转换及全局定位,为在相同环境下通过重复实验进行多地图融合研究奠定了基础。该低成本移动机器人设计的有效性通过实验得以验证。     

激光测距在移动机器人自主导航中的应用

移动机器人在运动范围内需要有足够的传感器信息可供利用来进行自主导航,在完全未知的环境中,由机器人依靠其自身携带的传感器所提供的信息建立环境模型是机器人进行自主定位和导航的前提之一。介绍了激光测距在移动机器人自主导航中的应用研究;通过二维测距传感器对其周围环境进行扫描,提出了自主导航中地图创建、定位如何用二维扫描获得三维数据流的算法描述,并实验验证该算法的运用使机器人获得一个很好的三维视觉结构图。     

Enhanced Geometric Map: a 2D&3D Hybrid City Model of Large Scale Urban Environment for Robot Navigation

To facilitate scene understanding and robot navigation in large scale urban environment, a two-layer enhanced geometric map(EGMap) is designed using videos from a monocular onboard camera. The 2D layer of EGMap consists of a 2D building boundary map from top-down view and a 2D road map, which can support localization and advanced map-matching when compared with standard polyline-based maps. The 3D layer includes features such as 3D road model,and building facades with coplanar 3D vertical and horizontal line segments, which can provide the 3D metric features to localize the vehicles and flying-robots in 3D space. Starting from the 2D building boundary and road map, EGMap is initially constructed using feature fusion with geometric constraints under a line feature-based simultaneous localization and mapping(SLAM) framework iteratively and progressively. Then, a local bundle adjustment algorithm is proposed to jointly refine the camera localizations and EGMap features. Furthermore, the issues of uncertainty, memory use, time efficiency and obstacle effect in EGMap construction are discussed and analyzed. Physical experiments show that EGMap can be successfully constructed in large scale urban environment and the construction method is demonstrated to be very accurate and robust.     

Accurate sensing of scene geo-context via mobile visual localization

Image geo-tagging has drawn a great deal of attention in recent years. The geographic information associated with images can be used to promote potential applications such as location recognition or virtual navigation. In this paper, we propose a novel approach for accurate mobile image geo-tagging in urban areas. The approach is able to provide a comprehensive set of geo-context information based on the current image, including the real location of the camera and the viewing angle, as well as the location of the captured scene. Moreover, the parsed building facades and their geometric structures can also be estimated. First, for the image to be geo-tagged, we perform partial duplicate image retrieval to filter crowd-sourced images capturing the same scene. We then employ the structure-from-motion technique to reconstruct a sparse 3D point cloud of the scene. Meanwhile, the geometric structure of the query image is analyzed to extract building facades. Finally, by combining the reconstructed 3D scene model and the extracted structure information, we can register the camera location and viewing direction to a real-world map. The captured building location and facade orientation are also aligned. The effectiveness of the proposed system is demonstrated by experiment results.     

基于道路结构特征的智能车单目视觉定位

高精度定位是实现自动驾驶的关键.在城市密集区域,全球定位系统（Global positioning system,GPS）等卫星定位系统受到遮挡、干扰、多路径反射等影响,无法保障自动驾驶所需的定位精度.视觉定位技术通过图像特征匹配进行位置估计,被广泛研究.然而传统基于特征点的方法容易受到移动目标的干扰,在高动态交通场景中的应用面临挑战.在结构化道路场景中,车道等线特征普遍存在,为人类驾驶员的视觉理解与决策提供重要线索.受该思路的启发,本文利用场景中的三垂线和点特征构建道路结构特征（Road structural feature,RSF）,并在此基础上提出一个基于道路结构特征的单目视觉定位算法.本文利用在北京市区的典型路口、路段、街道等场所采集的车载视频数据进行实验验证,以同步采集的高精度GPS惯性导航组合定位系统数据为参照,与传统视觉定位算法进行比较.结果表明,本文算法在朝向估计上明显优于传统算法,对环境中的动态干扰有更高的鲁棒性.在卫星信号易受干扰的区域,可以有效地弥补GPS等定位系统的不足,为满足自动驾驶所需的车道级定位要求提供重要的技术手段.     

双目视觉的新颖实时局部2维地图构建方法

根据轮式机器人移动的特点,提出一种采用双目视觉的新颖实时局部2维栅格地图构建算法。首先,提出虚拟高度线投影成像原理,将场景均匀栅格化,在栅格中引入虚拟高度线,并将其投影到立体视觉系统的立体图对中产生投影线,将求解场景点高度值的问题转化为在投影线上和水平视差搜索范围内寻找具有最大相似测度的对应点问题;然后,提出一种新颖的局部2维地图构建方法,该方法以机器人所能越过的最大高度为阈值,对高于阈值部分的虚拟高度投影线上的场景点由其在图像对中的相似测度确定其是否为障碍物区域。实验结果表明,该方法满足机器人导航所要求的有效性和实时性,并可应用到构建3维地图。     

Line matching of wide baseline images in an affine projection space

ABSTRACT

Line matching plays an important role in vision localization and three-dimensional reconstruction of building structures. The conventional method of line matching is not effective for processing stereo images with wide baselines and large viewing angles. This paper proposes a line matching method in an affine projection space, aiming to solve the problem of change of viewing angles in aerial oblique images. Firstly, monocular image orientation can be performed through geometric structures of buildings. Secondly, according to the pose information of the camera, the affine projection matrix is obtained. The original image can be rectified as a conformal image based on this projection matrix, thereby reducing the difference in the viewing angle between images. Then, line matching is performed on the rectified images to get the matched line pairs. Finally, the inverse affine projection matrix is used to back-project the matched line pairs to the original images. The experimental results of five groups of aerial oblique images show that the matched line segments obtained by the proposed method are basically superior to those of the methods which are directly processed on the original image in terms of quantity, correctness, and efficiency.     

Slice-based building facade reconstruction from 3D point clouds

ABSTRACT

We propose a comprehensive strategy to reconstruct urban building geometry from three-dimensional (3D) point clouds. First, the point clouds are segmented using a rough-detail segmentation algorithm, and refinements guided by topological relationships are performed to rectify the segmentation mistakes. Then, the semantic features (such as facades and windows) that belong to the buildings are recognized and extracted. Next, each facade is cut into a sequence of slices. The initial models are recovered by sequentially detecting and connecting the anchor points. Finally, due to the regular arrangements of windows, a template-matching method relying on the similarity and repetitiveness of the windows is proposed to recover the details on building facades. The experimental results demonstrate that our method can automatically reconstruct the building geometry and detailed window structures are better depicted.     

室内环境下基于平面与线段特征的RGB-D视觉里程计

针对室内环境的结构特点,提出一种使用平面与线段特征的RGB-D视觉里程计算法．首先根据RGB-D扫描点的法向量对3D点云进行聚类,并使用随机抽样一致（RANSAC）算法对每簇3D点集进行平面拟合,抽取出环境中的平面特征;随后利用边缘点检测算法分割出环境中的边缘点集,并提取出环境中的线段特征;然后提出一种基于平面与线段几何约束的特征匹配算法,完成特征之间的匹配．在平面与线段特征匹配结果能提供充足的位姿约束的条件下,利用特征之间的匹配关系直接求解RGB-D相机的位姿;若不能,则利用匹配线段的端点以及线段点集来实现RGB-D相机位姿的估计．在TUM公开数据集中的实验证明了选择平面与线段作为环境特征可以提升视觉里程计估计和环境建图的精度．特别是在fr3/cabinet数据集中,本文算法的旋转、平移的均方根误差分别为2.046°/s、0.034m/s,要显著优于其他经典的视觉里程计算法．最终将本文系统应用到实际的移动机器人室内建图中,系统可以建立准确的环境地图,且系统运行速度可以达到3帧/s,满足实时处理的要求．     

Building facade detection,segmentation, and parameter estimation for mobile robot stereo vision

Building facade detection is an important problem in computer vision, with applications in mobile robotics and semantic scene understanding. In particular, mobile platform localization and guidance in urban environments can be enabled with accurate models of the various building facades in a scene. Toward that end, we present a system for detection, segmentation, and parameter estimation of building facades in stereo imagery. The proposed method incorporates multilevel appearance and disparity features in a binary discriminative model, and generates a set of candidate planes by sampling and clustering points from the image with Random Sample Consensus (RANSAC), using local normal estimates derived from Principal Component Analysis (PCA) to inform the planar models. These two models are incorporated into a two-layer Markov Random Field (MRF): an appearance- and disparity-based discriminative classifier at the mid-level, and a geometric model to segment the building pixels into facades at the high-level. By using object-specific stereo features, our discriminative classifier is able to achieve substantially higher accuracy than standard boosting or modeling with only appearance-based features. Furthermore, the results of our MRF classification indicate a strong improvement in accuracy for the binary building detection problem and the labeled planar surface models provide a good approximation to the ground truth planes.     

基于ORB-SLAM的室内机器人定位和三维稠密地图构建

针对在室内机器人定位和三维稠密地图构建系统中,现有方法无法同时满足高精度定位、大范围和快速性要求的问题,应用具有跟踪、地图构建和重定位三平行线程的ORB-SLAM算法估计机器人三维位姿;然后拼接深度摄像头KINECT获得的三维稠密点云,提出空间域上的关键帧提取方法剔除冗余的视频帧;接着提出子地图法进一步减少地图构建的时间,最终提高算法的整体速度。实验结果表明,所提系统能够在大范围环境中准确定位机器人位置,在运动轨迹为50 m的大范围中,机器人的均方根误差为1.04 m,即误差为2%,同时整体速度为11帧/秒,其中定位速度达到17帧/秒,可以满足室内机器人定位和三维稠密地图构建的精度、大范围和快速性的要求。