基于双目视觉的人脸三维重建

基于双目立体匹配算法PatchMatch算法,提出了一种获取人脸三维点云的算法。该算法对局部立体匹配算法PatchMatch进行了优化。该方法既不需要昂贵的设备,也不需要通用的人脸三维模型,而是结合了人脸的拓扑结构信息以及立体视觉局部优化算法。此方法采用非接触式的双目视觉采集技术获取左右视角的人脸图像,利用回归树集合(ensemble of regression trees,ERT)算法对人脸图像进行关键点定位,恢复人脸稀疏的视差估计,运用线性插值方法初步估计脸部的稠密视差值,并结合局部立体匹配算法对得到的视差结果进行平滑处理,重建人脸的三维点云信息。实验结果表明,这种算法能够还原出光滑的稠密人脸三维点云信息,在人脸Bosphorus数据库上取得了更加准确的人脸重建结果。     

基于稀疏图像序列的雕塑点自动云三维重构方法

为了提高对雕塑点稀疏图像的点云三维重建的分析能力,提出一种基于稀疏图像序列的雕塑点自动云三维重构方法,基于稀疏散乱点三维重建和锐化模板特征匹配方法进行图像三维重建。采用三维角点检测和边缘轮廓特征提取方法,进行雕塑点稀疏图像三维点云特征检测,对检测的雕塑点稀疏图像点云数据进行信息融合处理,采用梯度运算方法进行特征分解,实现对雕塑点稀疏图像的信息增强和融合滤波。结合局部均值降噪方法进行图像的提纯处理,提高雕塑点稀疏图像轮廓重建能力,采用锐化模板特征匹配和块分割技术,实现雕塑点自动云三维重构。仿真结果表明,采用该方法进行雕塑点自动云三维重构的准确性较高,图像匹配能力较好,且重构输出信噪比较高。     

融合稀疏点云补全的3D目标检测算法

基于雷达点云的3D目标检测方法有效地解决了RGB图像的2D目标检测易受光照、天气等因素影响的问题.但由于雷达的分辨率以及扫描距离等问题,激光雷达采集到的点云往往是稀疏的,这将会影响3D目标检测精度.针对这个问题,提出一种融合稀疏点云补全的目标检测算法,采用编码、解码机制构建点云补全网络,由输入的部分稀疏点云生成完整的密...     

基于特征点动态选择的三维人脸点云模型重建

针对典型的点云配准方法中伪特征点过多导致配准效率低和配准结果不精确的问题,提出一种基于特征点动态选择的三维人脸点云模型重建方法。该方法在粗配准阶段,采用动态特征矩阵求解法获取粗匹配特征变换矩阵以避免伪特征点的干扰。在精配准过程中,采用二次加权法向量垂直距离法在人脸流形表面选择更有效的特征点以减少伪特征点的数量,并采用基于特征融合与局部特征一致性的迭代最近点方法进行精配准。经过对比实验验证了算法的可行性,实验结果表明,提出算法能够实现高精度且快速的三维人脸点云模型重建,且均方根误差达到1.816 5 mm,相较于其他算法,在模型重建精度和效率方面都有所提升,具有良好的应用前景。     

双目立体视觉的三维人脸重建方法

创建逼真的三维人脸模型始终是一个极具挑战性的课题.随着三维人脸模型在虚拟现实、视频监控、三维动画、人脸识别等领域的广泛应用,三维人脸重建成为计算机图像学和计算机视觉领域的一个研究热点.针对这一问题,提出一种基于双目立体视觉的三维人脸重建方法,重建过程中无需三维激光扫描仪和通用人脸模型.首先利用标定的2台摄像机获取人脸正面图像对,通过图像校正使图像对的极线对齐并且补偿摄像机镜头的畸变;在立体匹配方面,选择具有准确可靠视差的人脸边缘特征点作为种子像素,以种子像素的视差作为区域生长的视差,在外极线约束、单调性约束以及对应匹配的边缘特征点的约束下,进行水平扫描线上的区域生长,从而得到整个人脸区域的视差图,提高了对应点匹配的速度和准确度;最后,根据摄像机标定结果和立体匹配生成的视差图计算人脸空间散乱点的三维坐标,对人脸的三维点云进行三角剖分、网格细分和光顺处理.实验结果表明,该方法能够生成光滑、逼真的三维人脸模型,证明了该算法的有效性.     

Robust dense reconstruction by range merging based on confidence estimation

Although the stereo matching problem has been extensively studied during the past decades, automatically computing a dense 3D reconstruction from several multiple views is still a difficult task owing to the problems of textureless regions, outliers, detail loss, and various other factors. In this paper, these difficult problems are handled effectively by a robust model that outputs an accurate and dense reconstruction as the final result from an input of multiple images captured by a normal camera. First, the positions of the camera and sparse 3D points are estimated by a structure-from-motion algorithm and we compute the range map with a confidence estimation for each image in our approach. Then all the range maps are integrated into a fine point cloud data set. In the final step we use a Poisson reconstruction algorithm to finish the reconstruction. The major contributions of the work lie in the following points: effective range-computation and confidence-estimation methods are proposed to handle the problems of textureless regions, outliers and detail loss. Then, the range maps are merged into the point cloud data in terms of a confidence-estimation. Finally, Poisson reconstruction algorithm completes the dense mesh. In addition, texture mapping is also implemented as a post-processing work for obtaining good visual effects. Experimental results are presented to demonstrate the effectiveness of the proposed approach.     

结合径向线的局部遮挡下的3维人脸识别

目的 3维人脸点云的局部遮挡是影响3维人脸识别精度的一个重要因素。为克服局部遮挡对3维人脸识别的影响,提出一种基于径向线和局部特征的3维人脸识别方法。方法 首先为了充分利用径向线的邻域信息,提出用一组局部特征来表示径向线;其次对于点云稀疏引起的采样点不均匀,提出将部分相邻局部区域合并以减小采样不均匀的影响;然后,利用径向线的邻域信息构造代价函数,进而构造相应径向线间的相似向量。最后,利用相似向量来进行径向线匹配,从而完成3维人脸识别。结果 在FRGC v2.0数据库上进行不同局部特征识别率的测试实验,选取的局部特征Rank-1识别率达到了95.2%,高于其他局部特征的识别率;在Bosphorus数据库上进行不同算法局部遮挡下的人脸识别实验,Rank-1识别率达到了最高的92.0%;进一步在Bosphorus数据库上进行不同算法的时间复杂度对比实验,耗费时间最短,为8.17 s。该算法在准确率和耗时方面均取得了最好的效果。结论 基于径向线和局部特征的3维人脸方法能有效提取径向线周围的局部信息;局部特征的代价函数生成的相似向量有效减小了局部遮挡带来的影响。实验结果表明本文算法具有较高的精度和较短的耗时,同时对人脸的局部遮挡具有一定的鲁棒性。该算法适用于局部遮挡下的3维人脸识别,但是对于鼻尖部分被遮挡的人脸,无法进行识别。     

基于点云配准的人脸三维尺寸测量

接触式人脸三维尺寸测量易损坏表面特征,依赖于特征点标定,常含冗余信息.针对该问题,提出一种基于结构光与多视图图像点云配准的非接触式人脸三维尺寸测量方法.首先利用改进的迭代最近点算法建立转换函数,求出尺度因子、旋转矩阵和平移向量;然后基于模糊C均值算法对人脸面部进行聚类分割以获得候选区域;针对人脸表面离散点云不平整问题,...     

关键点匹配三维人脸识别方法*

提出了一种新颖的三维人脸识别算法,其基本思路是,把代表人脸的三维点云沿X、Y或Z轴旋转,反复多次把3D人脸关键点投影到2.5D图像上,然后提取2.5D图像的关键点并进行标记,而用这些比原来小得多的关键点代替原来的面扫描。面对未知的待测人脸首先通过执行相同的多视角特征点提取技术提取关键点,然后应用一个新的加权特征点匹配算法进行识别。通过用GavabDB三维面部识别数据集进行试验评估,这个方法对中性表情人脸可获得高达94％的识别精度,对人脸表情辨识（如微笑）的准确率也超过了88％。实验结果表明,此方法在识别精     

基于实拍图像的人脸真实感重建

给出了基于实拍人脸图像的三维逼真人脸模型的重建算法,该算法首先在两幅人脸图像上交互标识特征点对和输入摄像机的广角参数来实现摄像机定标,进而匹配出两幅人脸图像上的其它对应点,实现模型的三维重建,作者用半自动垭达到匹配目的。用手工编辑建立的二维对应网格,得到初始人脸外开和鲁棒的最大拟然立体虎法自动匹配出稠密的对应点,重建出表示人脸的散乱三维数据点团;最后利用这些稠密的三维数据点去迭代矫正和自适应细分手     

Automatic detection of building roofs from point clouds produced by the dense image matching technique

Three-dimensional (3D) spatial information of object points is a vital requirement for many disciplines. Laser scanning technology and techniques based on image matching have been used extensively to produce 3D dense point clouds. These data are used frequently in various applications, such as the generation of digital surface model (DSM)/digital terrain model (DTM), extracting objects (e.g., buildings, trees, and roads), 3D modelling, and detecting changes. The aim of this study was to extract the building roof points automatically from the 3D point cloud data created via the image matching techniques with optical aerial images (with red, green, and blue band (RGB) and infrared (IR)). In the first stage of the study, as an alternative to laser scanning technology, which is more expensive than optical imaging systems, the 3D point clouds were produced by matching high-resolution images using a Semi Global Matching algorithm. The normalized difference vegetation index (NDVI) values for each point were calculated using the spectral information (RGB + IR) in the 3D point cloud data, and the points that represented the vegetation cover were determined using these values. In the second stage, existing ground and non-ground points that were free of vegetation cover were determined within the point cloud. Subsequently, only the points on the roof of the building were detected automatically using the proposed algorithm. Thus, points of the roofs of buildings located in areas with different topographic characteristics were detected automatically detected using only images. It was determined that the average values of correctness (Corr), completeness (Comp), and quality (Q) of the pixel-based accuracy analysis metrics were 95%, 98%, and 93%, respectively, in the selected test areas. According to the results of the accuracy analysis, it is clear that the proposed algorithm is very successful in automatic extraction of building roof points.     

3D face reconstruction using images from cameras with varying parameters

In this paper, we present a new technique of 3D face reconstruction from a sequence of images taken with cameras having varying parameters without the need to grid. This method is based on the estimation of the projection matrices of the cameras from a symmetry property which characterizes the face, these projections matrices are used with points matching in each pair of images to determine the 3D points cloud, subsequently, 3D mesh of the face is constructed with 3D Crust algorithm. Lastly, the 2D image is projected on the 3D model to generate the texture mapping. The strong point of the proposed approach is to minimize the constraints of the calibration system: we calibrated the cameras from a symmetry property which characterizes the face, this property gives us the opportunity to know some points of 3D face in a specific well-chosen global reference, to formulate a system of linear and nonlinear equations according to these 3D points, their projection in the image plan and the elements of the projections matrix. Then to solve these equations, we use a genetic algorithm which consists of finding the global optimum without the need of the initial estimation and allows to avoid the local minima of the formulated cost function. Our study is conducted on real data to demonstrate the validity and the performance of the proposed approach in terms of robustness, simplicity, stability and convergence.     

一种基于全部和局部平滑光流的分步人脸重建算法

提出一种基于全部和局部（combined local-global approach, CLG）平滑光流的分步人脸重构算法。首先利用原始CLG得到图像初始匹配值; 再以反投影残差、光流梯度、人脸光流范围进行约束, 找出初始匹配中不可信匹配区域; 最后对不可信图像区域提取纹理并再次计算光流值。实验表明, 该人脸重建算法的重建精度与鲁棒性比原始CLG算法高, 能够得到光顺的人脸三维数据。     

Automatic 3d free form shape matching using the graduated assignment algorithm

Three-dimensional free form shape matching is a fundamental problem in both the machine vision and pattern recognition literatures. However, the automatic approach to 3D free form shape matching still remains open. In this paper, we propose using k closest points in the second view for the automatic 3D free form shape matching. For the sake of computational efficiency, the optimised k-D tree is employed for the search of the k closest points. Since occlusion and appearance and disappearance of points almost always occur, slack variables have to be employed, explicitly modelling outliers in the process of matching. Then the relative quality of each possible point match is estimated using the graduated assignment algorithm, leading the camera motion parameters to be estimated by the quaternion method in the weighted least-squares sense. The experimental results based on both synthetic data and real images without any pre-processing show the effectiveness and efficiency of the proposed algorithm for the automatic matching of overlapping 3D free form shapes with either sparse or dense points.     

基于像素插值的改进PMVS稠密重建方法

针对纹理稀疏区域重建效果差的问题,本文提出一种基于像素插值的改进稠密重建算法.基于面片的多视图稠密重建方法（PMVS）能够自动忽略外部点和障碍点,相比较于其他三维稠密重建算法该算法更准确,简单,高效.但是在纹理稀疏的区域会出现孔洞残缺等问题,且现有的匹配候选点选取策略会使得局部细节失真边缘残缺.本文针对这些问题提出了一种基于像素插值的特征点选取方法,增加纹理稀疏区域的特征点,使特征点分布均匀,提出一种更合理的候选点选取策略,减少错误匹配.实验表明本文提出的方法不仅能保证纹理稀疏区域的重建效果,还能有效剔除误匹配点,提高重建精度.     

An interpolation algorithm fitted for dynamic 3D face reconstruction

In order to solve the problem of low recognition accuracy in later period which is caused by the too few extracted parameters in the 3D face recognition, and the incapable formation of completed point cloud structure. An automatic iterative interpolation algorithm is proposed. The new and more accurate 3D face data points are obtained by automatic iteration. This algorithm can be used to restore the data point cloud information of 3D facial feature in 2D images by means of facial three-legged structure formed by 3D face and automatic interpolation. Thus, it can realize to shape the 3D facial dynamic model which can be recognized and has high saturability. Experimental results show that the interpolation algorithm can achieve the complete the construction of facial feature based on the facial feature after 3D dynamic reconstruction, and the validity is higher.     

双目视觉下基于区域生长的三维人脸重建算法

为解决传统立体匹配算法匹配低纹理人脸图像时极易产生误匹配的问题,提出一种基于区域生长的人脸立体匹配算法。该算法利用级联回归树算法提取的人脸特征点将人脸划分为不同区域以分别限制各区域的视差搜索范围,从而避免在全局范围上查找匹配点;同时利用人脸的局部形状特性,采用局部曲面拟合的方式筛除误匹配种子点并生成大量可靠种子点用于区域生长;最后,分别在实验室环境采集的人脸图像和FRGC v2.0人脸数据库上进行定性和定量实验。实验结果表明,与传统算法相比,所提算法能够重建出更加准确的三维人脸模型。经点云配准后与人脸点云真实值的均方根误差在2 mm以内,且不同光照、姿态、表情下人脸图像的重建表明所改进的立体匹配算法具有较好的鲁棒性。     

一种配网带电作业机器人的目标线路识别与定位算法研究

配网带电作业机器人需要处理复杂的配电网目标线路感知与识别问题。提出一种基于色彩信息和匹配算子的配电网线路识别方法和中心视差计算方法,实现对线路的曲线特征识别和三维定位。基于色彩信息和匹配算子的检测方法能够有效地匹配复杂环境中的线路,解决线路的表面纹理弱、形态弯曲多样的问题,有效提升了线路的识别效果。中心视差计算方法通过利用线路的几何特性,分析计算线路中心线的曲线视差距离,得到配电网线路的三维位置信息。最后将该算法应用到配网带电作业机器人中,测试结果表明该算法能够准确识别和定位出配电网线路。     

基于特征分块的三维人脸重建和识别

针对传统三维人脸重建算法效率低且难以满足实际应用的缺陷,提出一种基于特征分块的三维人脸重建算法,并将此算法应用到三维人脸识别中,实现了基于特征分块的加权三维人脸识别。首先,利用基于平面模板的非均匀重采样法对原始数据进行归一化;其次,采用主动形状模型(ASM)算法对三维人脸和二维人脸图像进行特征定位和特征分块;然后,利用基于分块主元分析(PCA)的稀疏形变模型算法实现每个人脸分块的三维重建;最后,实现了此算法在三维人脸识别中的应用。实验表明,此重建算法具有较高的精度和重建效率,还可以达到全局最优,并且可以提高三维人脸的识别率。     

3D-CDRNet: Retrieval-based dense point cloud reconstruction from a single image under complex background

3D reconstruction technique based on deep learning is gaining increasing attention from researchers. The majority of current 3D reconstruction techniques require a simple background, which limit their applications on complex background image. Extracting point cloud features comprehensively is also extremely difficult. This paper design a novel 3D reconstruction network to overcome these limitations. Firstly, we get the image and the retrieved point cloud that is the most similar to the input image. Secondly, to learn the features of the retrieved point cloud, the network encodes and decodes the single image and the retrieved point cloud to generate sparse point cloud. Finally, the proposed dense module densifies the sparse point cloud into the dense point cloud. We use single image of complex background and public dataset to evaluate our network. The reconstruction results indicate that the network surpasses previous reconstruction networks.