Kinect v2的三维物体重建系统设计

三维物体重建一直是计算机图形学领域研究的热点。设计并实现一套基于Kinect v2的三维物体重建系统。使用Kinect v2获取包含物体所在场景的点云,去除离群点,并用三维包围盒将特定的物体点云从场景中分离出来;利用SAC-IA算法对相邻两片点云进行粗配准,将两两配准的ICP算法扩展到多片点云,提出一种从两边向中间逼近的策略,减少累积误差,提高物体点云还原度;实现一套低成本,精确的针对单个物体的三维重建系统。实验结果表明,与传统的只使用ICP算法配准相比,该算法配准的精度更高,重建还原度更好。     

基于深度图像的三维场景重建系统

针对计算机图形学和视觉领域研究热点--三维场景重建,首先分析了 Kinect v2 (Kinect for Windows v2 sensor)获取深度图像的原理,说明深度图像噪声的来源。然后根据获取 深度图像的原理设计一种算法对点云采样范围进行裁剪。其次对点云离群点进行去除,填补点 云孔洞,以提高重建质量。常见的三维场景重建大都采用了 KinectFusion 的一个全局立方体方 案,但只能对小范围内的场景进行重建。对此设计了一种对大场景进行点云匹配的 ICP 算法。 最后对点云进行曲面重建,实现一套低成本、精确的针对大场景的三维重建系统。     

基于Kinect-v2的多视角三维重建实现

设计并实现了一种基于Kinect v2的简单快速、低成本实现三维重建的系统,适合离线操作且不受硬件设备限制,使用Kinect v2传感器获取不同视角的多片点云,分别将目标模型点云与周围场景点云分离并去除离群点云,利用RANSAC算法对相邻两片点云进行粗配准,将两两配准的ICP算法扩展到多片点云,设定角度阈值从两边向中间逼近的策略,减少累积误差,提高物体点云还原度,实现单个静态物体的三维重建。实验结果表明,本文在目标物较小重叠且结构特征不突出的情况下,仍能得到较好的三维点云模型,具有一定的实际应用价值。     

基于Kinect的轴类零件三维重建研究

使用Kinect采集的深度数据,进行了轴类零件三维重建算法的研究。首先借助Kinect获取深度和彩色数据,通过坐标转换将深度信息转换成三维点云数据;其次提取出感兴趣目标的点云数据,根据点云数据的噪声特点,并对其进行滤波降噪处理;然后进行点云分割获得点云集,最后对各点云集进行结构参数化分析。实验结果表明,本文算法能够精确、高效地实现轴类零件的重建。     

基于Kinect深度图像的三维重建

随着机器视觉理论的发展和硬件技术的进步,三维重建在生产、生活中的应用越来越广泛,基于Kinect传感器的三维重建得到广泛的应用。针对于现有的Kinect传感器获得的深度图像深度信息丢失的问题,提出了一种新的基于均值滤波的方法对深度图像进行去噪,并对深度图像进行预处理,获取三维点云,用迭代最近点(Iterative Closest Point,ICP)算法完成点云的精确配准,从而得到配准后物体表面三维点云,并完成物体的三维重建。     

基于差分算法和Kinect的数媒交互系统设计

为了有效实现数媒交互,提升三维模型重建速度、精度及数媒交互效果,设计了一种基于差分算法和Kinect的数媒交互系统。首先读取、转换与存储不同格式的图像数据,利用视觉表达灵敏度差分算法预处理图像数据,利用面绘制技术重建三维模型,再使用Kinect采集视野内物体深度值,选取与Kinect距离最近的用户当作第一操作用户,通过骨骼追踪数据捕捉用户姿势,定义骨骼数据,编辑动作指令,依据键盘映射完成Unity3D和Kinect的数据通讯,实现数媒交互。实验证明：设计系统的三维模型重建速度快、重建精度高,数媒交互展示效果更好。     

点云模型的噪声分类去噪算法

针对三维点云模型数据在去噪平滑过程中存在的不同尺度噪声和算法计算耗时问题,提出了点云模型的噪声分类去噪算法。该算法根据噪声点分布特性,将其分为大尺度和小尺度噪声,先利用统计滤波结合半径滤波去除大尺度噪声;然后使用快速双边滤波对小尺度噪声进行平滑,实现点云模型的去噪和平滑。与传统的双边滤波相比,利用快速双边滤波对点云模型数据进行平滑,有效地提高了计算效率。实验结果表明,该算法对点云噪声进行快速平滑去除的同时又能有效地保持被扫描物体的几何特征。     

基于Kinect v2三维重建的研究与实现

随着计算机视觉技术的蓬勃发展,三维模型重建成为研究热点。选用第二代Kinect作为三维模型重建的数据采集外设,获取具有深度信息的点云数据;然后用KinectFusion SDK对物体进行重建,并利用Matlab和Visual C++对点云数据进行降低噪声处理,并对三维点云数据进行Delaunay三角剖分,建立物体表面的拓扑关系,实现了三维物体的重建。     

基于纹理特征的三维点云数据配准算法研究

使用Kinect可以方便地获取物体的纹理图像和三维点云数据。研究一种通过获取纹理图像的特征点进行快速三维点云数据配准的算法．并最终应用到室内环境的三维场芾重建中。实验表明,此算法具有直观、实现简单、运算量小等优点。     

几何特征保持的文物点云去噪算法

三维激光扫描是一种快速获取高精度点云的新技术,但由于受物体本身的构造、粗糙程度、纹理以及测量环境等因素的影响,获取的点云数据大多存在孤立的噪声点。针对文物点云数据模型中复杂噪声难以去除的问题,提出一种几何特征保持的点云去噪算法。首先通过栅格划分删除点云中的大尺度噪声;然后定义点云中数据点的曲率因子和密度因子,并通过对其加权构造模糊C均值聚类（Fuzzy C-means clustering, FCM）的目标函数;最后采用该特征加权FCM算法删除小尺度噪声,从而实现点云的去噪处理。实验结果表明,该几何特征保持的去噪算法对文物点云数据具有良好的去噪效果,是一种有效的点云去噪算法。     

Reconstructing 3D human models with a Kinect

Three‐dimensional human model reconstruction has wide applications due to the rapid development of computer vision. The appearance of cheap depth camera, such as Kinect, opens up new horizons for home‐oriented 3D human reconstructions. However, the resolution of Kinect is relatively low, making it difficult to build accurate human models. In this paper, we improve the accuracy of human model reconstruction from two aspects. First, we improve the depth data quality by registering the depth images captured from multi‐views with a single Kinect. The part‐wise registration method and implicit‐surface‐based de‐noising method are proposed. Second, we utilize a statistical human model to iteratively augment and complete the human body information by fitting the statistical human model to the registered depth image. Experimental results and several applications demonstrate the applicability and quality of our system, which can be potentially used in virtual try‐on systems. Copyright © 2015 John Wiley & Sons, Ltd.     

3D Reconstruction of Indoor Scenes via Image Registration

With the development of computer vision technologies, 3D reconstruction has become a hotspot. At present, 3D reconstruction relies heavily on expensive equipment and has poor real-time performance. In this paper, we aim at solving the problem of 3D reconstruction of an indoor scene with large vertical span. In this paper, we propose a novel approach for 3D reconstruction of indoor scenes with only a Kinect. Firstly, this method uses a Kinect sensor to get color images and depth images of an indoor scene. Secondly, the combination of scale-invariant feature transform and random sample consensus algorithm is used to determine the transformation matrix of adjacent frames, which can be seen as the initial value of iterative closest point (ICP). Thirdly, we establish the relative coordinate relation between pair-wise frames which are the initial point cloud data by using ICP. Finally, we achieve the 3D visual reconstruction model of indoor scene by the top-down image registration of point cloud data. This approach not only mitigates the sensor perspective restriction and achieves the indoor scene reconstruction of large vertical span, but also develops the fast algorithm of indoor scene reconstruction with large amount of cloud data. The experimental results show that the proposed algorithm has better accuracy, better reconstruction effect, and less running time for point cloud registration. In addition, the proposed method has great potential applied to 3D simultaneous location and mapping.     

基于Kinect的人体三维重建方法

通过Kinect体感仪,实现人体三维重建.使用Kinect体感仪,扫描获取人体三维数据,利用深度数据转换算法实现二维顶点的三维化,再通过红外相机姿态跟踪算法进行顶点集配准,求解出相机每次的相对位移与转动角度,实现相机姿态跟踪,并将每次拍摄到的点集转换到同一全局坐标系下,使用晶格化显示集成算法将点云集成到提前划分好精度及尺寸的体素晶格中,最后利用投影映射算法获得可视化的人体三维立体模型.使用Kinect体感仪及三脚架等辅助设备方便快捷地获取人体三维重建结果,并通过3D打印技术对模型进行输出.该研究实现了人体三维重建中人体扫描、处理、重建、输出全流程.     

基于Kinect的旋转刚体三维重建方法

针对在非匀速非定轴旋转条件下利用Kinect进行刚体三维重建问题,提出一种改进的基于Kinect传感器的旋转刚体三维重建方法。首先利用Kinect采集深度图像,然后用改进的加权ICP(Iterative Closest Point)算法在非匀速非定轴旋转条件下进行配准,再将各点云变换到同一坐标系下,最后根据所得点云生成三维模型表面,通过GPU(Graphic Processing Unit)编程技术来提高计算速度以满足实际需求。实验结果表明:该方法具有重建效果良好的特点。     

Real-time 3D face tracking based on active appearance model constrained by depth data

Active Appearance Model (AAM) is an algorithm for fitting a generative model of object shape and appearance to an input image. AAM allows accurate, real-time tracking of human faces in 2D and can be extended to track faces in 3D by constraining its fitting with a linear 3D morphable model. Unfortunately, this AAM-based 3D tracking does not provide adequate accuracy and robustness, as we show in this paper. We introduce a new constraint into AAM fitting that uses depth data from a commodity RGBD camera (Kinect). This addition significantly reduces 3D tracking errors. We also describe how to initialize the 3D morphable face model used in our tracking algorithm by computing its face shape parameters of the user from a batch of tracked frames. The described face tracking algorithm is used in Microsoft's Kinect system.     

3D Reconstruction by Kinect Sensor:A Brief Review

While Kinect was originally designed as a motion sensing input device of the gaming console Microsoft Xbox 360 for gaming purposes, it＇s easy-to-use, low-cost, reliability, speed of the depth measurement and relatively high quality of depth measurement make it can be used for 3D reconstruction. It could make 3D scanning technology more accessible to everyday users and turn 3D reconstruction models into much widely used asset for many applications. In this paper, we focus on Kinect 3D reconstruction.     

基于深度信息的移动机器人室内环境三维地图创建

针对使用扩展卡尔曼滤波(EKF）进行环境地图的创建对线性系统效果较好而对非线性系统的线性化受误差影响较大的问题,提出一种基于对Kinect采集到的环境数据和迭代扩展卡尔曼滤波(IEKF）算法的室内环境三维地图创建。该方法使用成本较低的Kinect传感器获取深度数据然后结合IEKF实现摄像头轨迹预测,最后利用最近点迭代(ICP）算法对深度图像进行配准得到室内环境三维点云图。实验结果表明,IEKF算法与传统的EKF算法相比,得到的轨迹更平滑、误差更小,同时所得到的三维点云图更加光滑。该方法实现了三维地图构建,较为实用,效果较好。     

3D scanning of cultural heritage with consumer depth cameras

Three dimensional reconstruction of cultural heritage objects is an expensive and time-consuming process. Recent consumer real-time depth acquisition devices, like Microsoft Kinect, allow very fast and simple acquisition of 3D views. However 3D scanning with such devices is a challenging task due to the limited accuracy and reliability of the acquired data. This paper introduces a 3D reconstruction pipeline suited to use consumer depth cameras as hand-held scanners for cultural heritage objects. Several new contributions have been made to achieve this result. They include an ad-hoc filtering scheme that exploits the model of the error on the acquired data and a novel algorithm for the extraction of salient points exploiting both depth and color data. Then the salient points are used within a modified version of the ICP algorithm that exploits both geometry and color distances to precisely align the views even when geometry information is not sufficient to constrain the registration. The proposed method, although applicable to generic scenes, has been tuned to the acquisition of sculptures and in this connection its performance is rather interesting as the experimental results indicate.     

A novel hardware plane fitting implementation and applications for bionic vision

This paper presents a high-speed real-time plane fitting implementation on a field-programmable gate array (FPGA) platform. A novel hardware-based least squares algorithm fits planes to patches of points within a depth image captured using a Microsoft Kinect v2 sensor. The validity of a plane fit and the plane parameters are reported for each patch of 11 by 11 depth pixels. The high level of parallelism of operations in the algorithm has allowed for a fast, low-latency hardware implementation on an FPGA that is capable of processing depth data at a rate of 480 frames per second. A hybrid hardware–software end-to-end system integrates the hardware solution with the Kinect v2 sensor via a computer and PCI express communication link to a Terasic TR4 FPGA development board. We have also implemented two proof-of-concept object detection applications as future candidates for bionic vision systems. We show that our complete end-to-end system is capable of running at 60 frames per second. An analysis and characterisation of the Kinect v2 sensor errors has been performed in order to specify logic precision requirements, statistical testing of the validity of a plane fit, and achievable plane fitting angle resolution.