基于稀疏图像序列的雕塑点自动云三维重构方法

为了提高对雕塑点稀疏图像的点云三维重建的分析能力,提出一种基于稀疏图像序列的雕塑点自动云三维重构方法,基于稀疏散乱点三维重建和锐化模板特征匹配方法进行图像三维重建。采用三维角点检测和边缘轮廓特征提取方法,进行雕塑点稀疏图像三维点云特征检测,对检测的雕塑点稀疏图像点云数据进行信息融合处理,采用梯度运算方法进行特征分解,实现对雕塑点稀疏图像的信息增强和融合滤波。结合局部均值降噪方法进行图像的提纯处理,提高雕塑点稀疏图像轮廓重建能力,采用锐化模板特征匹配和块分割技术,实现雕塑点自动云三维重构。仿真结果表明,采用该方法进行雕塑点自动云三维重构的准确性较高,图像匹配能力较好,且重构输出信噪比较高。     

基于自适应免疫遗传算法的图像分割

为了有效地对灰度图像进行自动分割,本文基于代价函数最小化方法,提出一种自适应免疫遗传算法用于图像分割.文中图像分割问题被表示为组合优化问题,而自适应免疫遗传算法作为一种优化算法用来寻找(准)最优的分割图像.在该算法中,交叉、变异及免疫算子采用了自适应变化的概率,同时利用问题的先验知识和进化个体的历史信息自适应地提取疫苗,使算法的整体性能得到提高,产生了较令人满意的分割结果,并对噪声有较好的抑制作用.     

基于多尺度结构张量的多类无监督彩色纹理图像分割方法

由于自然图像中包含丰富的颜色信息与多尺度的纹理信息,伴随多个同质目标区域的出现,依靠半监督手动交互标记的图像分割方法难以实现自动分割,因此提出一种多类无监督彩色纹理图像分割方法.首先,提取了颜色特征(向量结构)与多尺度纹理特征(矩阵集合),并对两者分别进行能量描述;对于2种具有不同特征结构的能量函数,通过多类融合策略计算两者的融合因子,并自适应地融合;再将融合后能量函数的全局最优化问题转化为其对应的多层Graph Cut图割模型,利用最大流?最小割理论计算得到全局近似最优解.为了自适应地控制分割过程,提出了自适应迭代分割收敛准则,并最终在自然图像及合成的彩色纹理图像上进行了质量评估与量化分析.实验结果表明,该方法具有较好的目标区域完整性与一致性,并具有较高的准确率.     

基于多尺度2D Gabor小波的视网膜血管自动分割

眼底视网膜血管分割对临床视网膜疾病诊断具有重要意义. 由于视网膜血管结构微小, 血管轮廓边界模糊, 加上图像采集时噪声的影响, 视网膜血管分割非常困难. 本文提出一种视网膜血管自动分割新方法. 首先, 应用对比度受限的自适应直方图均衡法增强视网膜图像;然后, 采用不同尺度的2D Gabor小波对视网膜图像进行变换, 并分别应用形态学重构 (Morphological reconstruction, MR)和区域生长法 (Region growing, RG)对变换后的图像进行分割; 最后, 对以上两种方法分割的视网膜血管和背景像素点重新标记识别, 得到视网膜血管最终分割结果. 通过对DRIVE和STARE数据库视网膜图像的分割实验, 证明了该算法的有效性.     

利用云模型和数据场的图像分割方法

针对图像自动分割中的最优阈值选择问题,提出一种基于云模型和数据场的图像分割方法。 该方法引入数据场实现图像灰度值特征空间到数据场势值空间的非线性映射,设定两个不同的质量函数分别形成相对数据场和绝对数据场。利用两类数据场的特点,结合全局和局部统计特征获得自适应势阈值对图像像素进行划分,产生图像潜在的背景或目标像素集合。进一步由逆向云发生器算法产生图像背景和目标的云模型表示,根据图像像素隶属于背景、目标云模型的程度,采用极大判定法则得到最终的分割结果。 实验结果表明,该方法的分割效果较好、性能稳定,具有合理性和有效性。     

基于三维激光雷达的道路边界提取和障碍物检测算法

为了快速有效地提取智能车辆在不同环境下的道路环境信息,提出基于三维激光雷达的道路边界提取和障碍物检测算法.首先,对三维激光雷达点云数据进行栅格化滤波处理,利用单束激光点云空间邻域联合分割的方法进行空间分析,得到点云平滑度特征图像.然后,采用自适应方向搜索算法获取道路边界候选点,并进行聚类分析和曲线拟合.最后,对道路边界约束下可通行区域内点云进行聚类分割,获得道路内障碍物方位和距离信息.实验表明,文中算法能够实时准确地提取道路边界和障碍物位置信息,满足智能车环境建模和路径规划的需求.     

人体表面点云数据的拓扑特征检测与自动分割

对标准站立测量姿态下的人体表面点云数据的拓扑特征检测与自动分割进行了研究,提出基于全景深度图像表示的人体点云表面拓扑特征检测和自动分割新方法。首先把人体表面的点云数据转换为圆柱极坐标形式,获得人体扫描表面的全景深度图像表示,根据全景深度图像中的层次信息自动检测人体表面的拓扑特征,并根据拓扑特征把人体分割成5个功能结构。实验证明这种方法改进了人体表面点云数据的拓扑特征检测和自动分割的效率和精度。     

基于云模型的图像区域分割方法

基于区域的图像分割方法由于其高效、稳健的特点成为自动或半自动图像分割方法的研究热点之一。针对区域分割方法中存在的不确定性问题,提出了一种基于云模型的区域分割方法。首先以云变换为基础确定了区域生长过程中的生长准则,然后以逆向云算法实现分割区域由定量的像素集合到定性的云概念的转换过程,最后以云综合算法为基础将相邻区域进行合并,实现了基于区域的不确定性图像分割。两组图像分割实验表明该方法可以准确地分割出目标,并优于传统的图像分割算法。     

粘连棒材图像自动分割计数技术

针对棒材图像自动计数存在的问题,提出了一种粘连棒材图像自动分割计数技术。首先采用粒度测量术估计棒材图像尺寸半径分布,自适应地选取处理参数。然后提出了一种新颖的棒材中心区域标记方法避免了初始过分割标记,在此基础上又提出了强、弱粘连概念。根据强弱粘连的特点,提出两步标记策略。分类粘连图像、获取图像的初始标记。对强粘连形成的欠分割标记区域采用逐次腐蚀算法,结合棒材形状面积等知识进行识别,获得正确的图像标记。最后融合两步图像中心区域标记结果,采用基于标记的分水岭分割算法进行图像分割。实验证明,这种方法能准确分割粘连棒材图像,实现可靠的棒材计数。     

基于脑图谱和模糊聚类的磁共振图像分割标注

利用TT Atlas中丰富的结构信息,文章提出了一种自动分割脑MRI(magnetic resonance image)图像的方法.这种方法可分为两步.首先,将MRI图像和TT Atlas配准,通过图像和医学图谱的匹配,利用图谱中结构信息的先验知识,就可以对图像作初步的分割标注.然后,利用这个预分割的模板对MRI图像进行模糊聚类分割,从而提高分割的精度.为了自动地将预模板中的结构信息用于分割,文章还提出了一种引入形状因子的FCM聚类算法.除了在匹配时需要手工定出一些点之外,该方法基本上是自动的.     

Accurate sensing of scene geo-context via mobile visual localization

Image geo-tagging has drawn a great deal of attention in recent years. The geographic information associated with images can be used to promote potential applications such as location recognition or virtual navigation. In this paper, we propose a novel approach for accurate mobile image geo-tagging in urban areas. The approach is able to provide a comprehensive set of geo-context information based on the current image, including the real location of the camera and the viewing angle, as well as the location of the captured scene. Moreover, the parsed building facades and their geometric structures can also be estimated. First, for the image to be geo-tagged, we perform partial duplicate image retrieval to filter crowd-sourced images capturing the same scene. We then employ the structure-from-motion technique to reconstruct a sparse 3D point cloud of the scene. Meanwhile, the geometric structure of the query image is analyzed to extract building facades. Finally, by combining the reconstructed 3D scene model and the extracted structure information, we can register the camera location and viewing direction to a real-world map. The captured building location and facade orientation are also aligned. The effectiveness of the proposed system is demonstrated by experiment results.     

Slice-based building facade reconstruction from 3D point clouds

ABSTRACT

We propose a comprehensive strategy to reconstruct urban building geometry from three-dimensional (3D) point clouds. First, the point clouds are segmented using a rough-detail segmentation algorithm, and refinements guided by topological relationships are performed to rectify the segmentation mistakes. Then, the semantic features (such as facades and windows) that belong to the buildings are recognized and extracted. Next, each facade is cut into a sequence of slices. The initial models are recovered by sequentially detecting and connecting the anchor points. Finally, due to the regular arrangements of windows, a template-matching method relying on the similarity and repetitiveness of the windows is proposed to recover the details on building facades. The experimental results demonstrate that our method can automatically reconstruct the building geometry and detailed window structures are better depicted.     

Building facade detection,segmentation, and parameter estimation for mobile robot stereo vision

Building facade detection is an important problem in computer vision, with applications in mobile robotics and semantic scene understanding. In particular, mobile platform localization and guidance in urban environments can be enabled with accurate models of the various building facades in a scene. Toward that end, we present a system for detection, segmentation, and parameter estimation of building facades in stereo imagery. The proposed method incorporates multilevel appearance and disparity features in a binary discriminative model, and generates a set of candidate planes by sampling and clustering points from the image with Random Sample Consensus (RANSAC), using local normal estimates derived from Principal Component Analysis (PCA) to inform the planar models. These two models are incorporated into a two-layer Markov Random Field (MRF): an appearance- and disparity-based discriminative classifier at the mid-level, and a geometric model to segment the building pixels into facades at the high-level. By using object-specific stereo features, our discriminative classifier is able to achieve substantially higher accuracy than standard boosting or modeling with only appearance-based features. Furthermore, the results of our MRF classification indicate a strong improvement in accuracy for the binary building detection problem and the labeled planar surface models provide a good approximation to the ground truth planes.     

Inference of segmented color and texture description by tensor voting

A robust synthesis method is proposed to automatically infer missing color and texture information from a damaged 2D image by (N)D tensor voting (N > 3). The same approach is generalized to range and 3D data in the presence of occlusion, missing data and noise. Our method translates texture information into an adaptive (N)D tensor, followed by a voting process that infers noniteratively the optimal color values in the (N)D texture space. A two-step method is proposed. First, we perform segmentation based on insufficient geometry, color, and texture information in the input, and extrapolate partitioning boundaries by either 2D or 3D tensor voting to generate a complete segmentation for the input. Missing colors are synthesized using (N)D tensor voting in each segment. Different feature scales in the input are automatically adapted by our tensor scale analysis. Results on a variety of difficult inputs demonstrate the effectiveness of our tensor voting approach.     

Automatic Modeling of Urban Facades from Raw LiDAR Point Data

Modeling of urban facades from raw LiDAR point data remains active due to its challenging nature. In this paper, we propose an automatic yet robust 3D modeling approach for urban facades with raw LiDAR point clouds. The key observation is that building facades often exhibit repetitions and regularities. We hereby formulate repetition detection as an energy optimization problem with a global energy function balancing geometric errors, regularity and complexity of facade structures. As a result, repetitive structures are extracted robustly even in the presence of noise and missing data. By registering repetitive structures, missing regions are completed and thus the associated point data of structures are well consolidated. Subsequently, we detect the potential design intents (i.e., geometric constraints) within structures and perform constrained fitting to obtain the precise structure models. Furthermore, we apply structure alignment optimization to enforce position regularities and employ repetitions to infer missing structures. We demonstrate how the quality of raw LiDAR data can be improved by exploiting data redundancy, and discovering high level structural information (regularity and symmetry). We evaluate our modeling method on a variety of raw LiDAR scans to verify its robustness and effectiveness.     

Exploiting Repetitions for Image‐Based Rendering of Facades

Street‐level imagery is now abundant but does not have sufficient capture density to be usable for Image‐Based Rendering (IBR) of facades. We present a method that exploits repetitive elements in facades ‐ such as windows ‐ to perform data augmentation, in turn improving camera calibration, reconstructed geometry and overall rendering quality for IBR. The main intuition behind our approach is that a few views of several instances of an element provide similar information to many views of a single instance of that element. We first select similar instances of an element from 3–4 views of a facade and transform them into a common coordinate system, creating a “platonic” element. We use this common space to refine the camera calibration of each view of each instance and to reconstruct a 3D mesh of the element with multi‐view stereo, that we regularize to obtain a piecewise‐planar mesh aligned with dominant image contours. Observing the same element under multiple views also allows us to identify reflective areas ‐ such as glass panels ‐ which we use at rendering time to generate plausible reflections using an environment map. Our detailed 3D mesh, augmented set of views, and reflection mask enable image‐based rendering of much higher quality than results obtained using the input images directly.     

Template Assembly for Detailed Urban Reconstruction

We propose a new framework to reconstruct building details by automatically assembling 3D templates on coarse textured building models. In a preprocessing step, we generate an initial coarse model to approximate a point cloud computed using Structure from Motion and Multi View Stereo, and we model a set of 3D templates of facade details. Next, we optimize the initial coarse model to enforce consistency between geometry and appearance (texture images). Then, building details are reconstructed by assembling templates on the textured faces of the coarse model. The 3D templates are automatically chosen and located by our optimization‐based template assembly algorithm that balances image matching and structural regularity. In the results, we demonstrate how our framework can enrich the details of coarse models using various data sets.     

Urban 3D segmentation and modelling from street view images and LiDAR point clouds

3D urban maps with semantic labels and metric information are not only essential for the next generation robots such autonomous vehicles and city drones, but also help to visualize and augment local environment in mobile user applications. The machine vision challenge is to generate accurate urban maps from existing data with minimal manual annotation. In this work, we propose a novel methodology that takes GPS registered LiDAR (Light Detection And Ranging) point clouds and street view images as inputs and creates semantic labels for the 3D points clouds using a hybrid of rule-based parsing and learning-based labelling that combine point cloud and photometric features. The rule-based parsing boosts segmentation of simple and large structures such as street surfaces and building facades that span almost 75% of the point cloud data. For more complex structures, such as cars, trees and pedestrians, we adopt boosted decision trees that exploit both structure (LiDAR) and photometric (street view) features. We provide qualitative examples of our methodology in 3D visualization where we construct parametric graphical models from labelled data and in 2D image segmentation where 3D labels are back projected to the street view images. In quantitative evaluation we report classification accuracy and computing times and compare results to competing methods with three popular databases: NAVTEQ True, Paris-Rue-Madame and TLS (terrestrial laser scanned) Velodyne.