3DComplete: Efficient completeness inspection using a 2.5D color scanner

In this paper, we present a low-cost and highly configurable quality inspection system capable of capturing 2.5D color data, created using off-the-shelf machine vision components, open-source software libraries, and a combination of standard and novel algorithms for 2.5D data processing. The system uses laser triangulation to capture 3D depth, in parallel with a color camera and a line light projector to capture color texture, which are then combined into a color 2.5D model in real-time.     

三维散乱点云快速曲面重建算法

提出了一种基于Delaunay三角剖分的三维散乱点云快速曲面重建算法。算法首先计算点云的Delaunay三角剖分, 从Delaunay四面体提取初始三角网格, 根据Voronoi体元的特征构造优先队列并生成种子三角网格, 然后通过区域生长的方式进行流形提取。实验结果表明, 该算法可以高效、稳定地重构具有复杂拓扑结构、非封闭曲面甚至是非均匀采样的点云数据。与传统的基于Delaunay的方法比较, 该算法仅需要进行一次Delaunay三角剖分, 无须极点的计算, 因此算法的重构速度快。     

一种三维表面重构中的轮廓集拼合新方法

针对切片级三维表面重构中的难点,提出了一种拼合轮廓集的新方法：通过对待拼合的轮廓集首尾轮廓进行平面三角剖分方向的判别,将空间轮廓集拼合的三维问题转化为平面多连通域三角剖分的二维问题,并改进了现有的平面多连通域三角剖分算法,巧妙地解决了切片级重构中的轮廓分支对应问题。实验表明,谊方法能准确完成复杂轮廓集的表面拼合,具有良好的适应性。     

High quality 3D reconstruction based on fusion of polarization imaging and binocular stereo vision

Polarization imaging can retrieve inaccurate objects’ 3D shapes with fine textures, whereas coarse but accurate depths can be provided by binocular stereo vision. To take full advantage of these two complementary techniques, we investigate a novel 3D reconstruction method based on the fusion of polarization imaging and binocular stereo vision for high quality 3D reconstruction. We first generate the polarization surface by correcting the azimuth angle errors on the basis of registered binocular depth, to solve the azimuthal ambiguity in the polarization imaging. Then we propose a joint 3D reconstruction model for depth fusion, including a data fitting term and a robust low-rank matrix factorization constraint. The former is to transfer textures from the polarization surface to the fused depth by assuming their relationship linear, whereas the latter is to utilize the low-frequency part of binocular depth to improve the accuracy of the fused depth considering the influences of missing-entries and outliers. To solve the optimization problem in the proposed model, we adopt an efficient solution based on the alternating direction method of multipliers. Extensive experiments have been conducted to demonstrate the efficiency of the proposed method in comparison with state-of-the-art methods and to exhibit its wide application prospects in 3D reconstruction.     

Film and television industry cloud exhibition design based on 3D imaging and virtual reality

The three-dimensional virtual scene can provide users with a visual three-dimensional virtual environment, with various multimedia channels such as sound, video, force feedback equipment, etc., to bring users a completely immersive interactive experience. This paper introduces 3D imaging and virtual reality technology in the film and television industry cloud exhibition, and develops a virtual display platform. First of all, this paper divides the registration into two processes: camera calibration and joint calibration of the camera and laser scanner based on the calibration results. Camera calibration can determine the plane model of the calibration board in the camera coordinate system, and the joint calibration uses the RANSAC algorithm to extract the point cloud of the plane model of the calibration board, and then optimizes the distance between the points in the plane model point cloud and the corresponding plane in the camera coordinate system Find the optimal transformation between the two sets of data, and then calculate the registration relationship between the point cloud and the image. Secondly, this article conducts a demand analysis of the film and television industry cloud exhibition platform based on virtual reality technology, including the business goals set by the platform, platform system analysis, overall design, and system operating environment and configuration requirements. This model provides a feasible solution for the visual interaction of the cloud exhibition design of the film and television industry.     

三维虚拟物体表面重建的研究

在激光扫描共焦显微三维成像，CT成像，MRI成像，以及在图象处理和识别中，三维物体的显示是必不可少的，目前，最流行的显示方式是虚拟物体的三维重建，通常虚拟物体三维重中以采用体素级重建，可也以采用切片极重建，由于切片级重建仍需要解决物体轮廓对应，分叉曲面，轮廓拼接等关键性问题，为此，提出了一些新的方法，在这些方法中，轮廓的对应采用OR运算和AND运算来确定，如果两个轮廓的OR和ND运算结果满足预先设置的准则，则这两个轮廓相对应；分叉曲面采用数字形态学方法来分解，其由形态学方法生成的边界就是分叉曲面的分割线，轮廓拼拦则是将对应轮廓经多边形简化后，由三角形接拼法来构成表面，且三角形是根据最小轮廓跨接边准则来构建的，通过对这些方法进行的实验结果表明，理论与实际完全相符，这些方法的优点是编程简单，运算速度快。     

三维图像中边界曲面的抽取与半透明可视化

已有算法在重构及可视化梯度值从高到低变化且包含弱边界的边界曲面时无法分辨弱边界与噪声碎片。针对上述问题,提出边界曲面半透明显示方法。采用半透明显示技术显示边界曲面及附着在其上的小碎片,利用人的智能及知识在观察可视化结果时对小碎片及弱边界进行有效的区分。结果证明,该方法有助于正确理解及完整显示三维图像中梯度值从高到低变化的边界曲面,为进一步的交互式操作去除小碎片提供依据。     

相移法光栅投影3维物体表面重建中一种消除交叠的算法

光栅投影成像是3维物体重建和测量的重要技术。它将广泛应用于科学研究、生产、文化艺术、医学等各个领域。目前,这项技术的自动化程度较低,速度较慢。因此,对其研究具有重要的理论意义和实用价值。首先介绍了光栅投影成像和3维物体重建的基本原理,然后提出了利用光栅投影条纹编码、解码、相移技术和莫尔法相位解缠确定3维物体深度信息的方法。光栅投影条纹采用逐步二分的二进制7位码编码,相移采用间隔π48步相移的正弦相移技术。此外,还提出了一种算法以消除因光栅条纹图像发生交叠而造成条纹解码产生的错码。这种算法利用各幅条纹编码图像中条纹位置的相关性,通过对条纹边界线灰度值的迭代,实现交叠条纹的区分。该算法加快了条纹解码和相位解缠速度,减少了存储量,提高了自动化程度和测量精度。     

基于VTK的三维医学图像虚拟切片提取

目前大多数医学影像设备,如CT、MRI、超声等所产生的图像序列往往必须沿着某一固定方向,但这通常不能满足临床上多方位、任意角度诊查的需要。针对该问题,提出了一种三维医学图像的任意角度虚拟切片提取方法。在Visual C++平台下,结合可视化工具包VTK,对DICOM格式的CT图像序列进行三维重建,通过设置虚拟切面的法向量和内点来对重建后的三维物体进行切割并获得虚拟切片信息,在切割的同时可以同步显示出虚拟切片图像。通过简单的鼠标操作可以生成任意角度、任意部位的虚拟切片图像,并能对切割平面及虚拟切片图像进行移     

基于面结构光的机械工件三维扫描系统设计

针对工业机器人对自动化装配过程生产效率的提高以及工件拾取对三维扫描技术的应用需求,设计了能够准确提取机械工件表面点云的视觉系统。扫描系统主要由计算机、投影仪和工业相机构成。基于光学测量和机器视觉的原理,主要研究设计了扫描系统工业相机和投影仪的标定策略、结构光栅编码解码的检测策略以及点云重构的几何策略。对于机械工件三维扫描重构的多余背景平面点云,研究设计了通过随机选取点云并反复迭代构造背景平面实现分割的有效方法。实验结果表明采用面结构光技术,由投影仪投影不同频率的结构光栅在机械工件上,工业相机同步采集被机械工件调制的结构光栅图像,对图像中的光栅条纹进行提取并计算,并利用三角检测算法提取机械工件表面点云的方案具有高准确性,能够有效重构机械工件表面点云。     

A novel method for 3D reconstruction: Division and merging of overlapping B-spline surfaces

B-spline surfaces, extracted from scanned sensor data, are usually required to represent objects in inspection, surveying technology, metrology and reverse engineering tasks. In order to express a large object with a satisfactory accuracy, multiple scans, which generally lead to overlapping patches, are always needed due to, inter-alia, practical limitations and accuracy of measurements, uncertainties in measurement devices, calibration problems as well as skills of the experimenter. In this paper, we propose an action sequence consisting of division and merging. While the former divides a B-spline surface into many patches with corresponding scanned data, the latter merges the scanned data and its overlapping B-spline surface patch. Firstly, all possible overlapping cases of two B-spline surfaces are enumerated and analyzed from a view of the locations of the projection points of four corners of one surface in the interior of its overlapping surface. Next, the general division and merging methods are developed to deal with all overlapping cases, and a simulated example is used to illustrate aforementioned detailed procedures. In the sequel, two scans obtained from a three-dimensional laser scanner are simulated to express a large house with B-spline surfaces. The simulation results show the efficiency and efficacy of the proposed method. In this whole process, storage space of data points is not increased with new obtained overlapping scans, and none of the overlapping points are discarded which increases the representation accuracy. We believe the proposed method has a number of potential applications in the representation and expression of large objects with three-dimensional laser scanner data.     

ArchiDNA: An interactive system for creating 2D and 3D conceptual drawings in architectural design

We present an interactive system called ArchiDNA for creating 2D and 3D conceptual drawings in architectural design. We developed a novel principle of shape generation called match-and-attach by analyzing drawing styles of a contemporary architect, Peter Eisenman. The process consists of user interaction techniques and a set of rules that decide how one or more shapes attach to another shape. One key ingredient of our process is a unique concept for the interactive semi-automatic shape generation that uses the combination of algorithmic rules of a computer and designers’ manual inputs. These techniques enable designers to use CAD software in the early stages of architectural designs to explore conceptual building forms. ArchiDNA dynamically responds to drawing inputs, configures 2D shapes, and converts them to 3D shapes in a similar style. We intend to complement existing CAD software and computational drawing pipelines for intuitive 2D and 3D conceptual drawing creation.     

3D imaging application in the studies of micro air vehicles

3D techniques are increasingly used in aerospace industry to improve quality and performance of aircrafts. This paper presents a 3D imaging technique for studying the aerodynamic shape and flight performance of micro air vehicles. 3D stereoscopic vision, based upon stroboscopic imaging, was utilized to obtain the 3D information of the aircraft's flexible aerodynamic surface. The aircraft models with deformable aerodynamic shape were designed and tested in a purpose-built wind tunnel experimental environment. After calculation of SIFT feature points and subdivision of triangular meshes, deformable surface of the aircraft's aerodynamic shape was represented. The aircraft's 3D visualization was used for analyzing unsteady deformation in the aerodynamic shape under external airflow disturbances. The results, together with aerodynamic forces measured in the experiment, will be useful to improve the flight performance and disturbance resistance ability of micro air vehicles.     

改进的基于特征点软组织厚度的颅面复原方法

现有三维颅面复原技术大多依据颅骨特征点的软组织厚度统计值。针对现有统计值指标涵盖的年龄、胖瘦等属性段较宽泛导致复原面貌缺乏个性的缺点,提出了一种改进方法。首先通过CT扫描仪获得颅面样本数据,并通过图像重构获得三维颅骨和人脸模型;然后采用一种半自动特征点标定方法对三维颅骨样本进行特征点标定,并求解特征点软组织厚度;之后采用支持向量回归方法构建特征点软组织厚度与属性之间的函数关系;最后根据待复原颅骨的属性以及回归函数计算特征点软组织厚度,在此基础上采用薄板样条函数对参考人脸模型进行变形获得复原面貌。实验结果表明,相比于已有方法,该方法能获得更准确的软组织厚度,提高颅面复原的准确度。     

An intelligent adaptive system for the optimal variable selections of R&D and quality supply chains

The cost of research & development (R&D) and quality management are always regarded as two major parts of total cost. The variable performance of R&D and quality design is an important index that will reflect the effectiveness of the cost reduction. This research has attempted to simultaneously vary all of the variables to achieve the global optimum for the optimal variable selections of R&D and quality design. Genetic algorithm (GA) can treat all of the variables for the global search. In this study, fuzzy refinement with orthogonal arrays was effective in improving the performance of the GA, and also showed the benefits of a good chromosome structure on the behavior of GA. It is also proposed the postponement design with temporal concept, to select the effective variables for the cost reduction of R&D and quality management design. The experimental results showed that tempo-postponement design will increase the flexibility and quick response for supply chain management. Hence, this approach can act as a useful guideline for researchers working on the optimization of the key variable selections for R&D and quality model design.     

特征点维度的静态场景三维重建运动目标剔除

基于语义分割的图像掩膜方法常用来解决静态场景三维重建任务中运动物体的干扰问题,然而利用掩膜成功剔除运动物体的同时会产生少量无效特征点.针对此问题,提出一种在特征点维度的运动目标剔除方法,利用卷积神经网络获取运动目标信息,并构建特征点过滤模块,使用运动目标信息过滤更新特征点列表,实现运动目标的完全剔除.通过采用地面图像和航拍图像两种数据集以及DeepLabV3、YOLOv4两种图像处理算法对所提方法进行验证,结果表明特征点维度的三维重建运动目标剔除方法可以完全剔除运动目标,不产生额外的无效特征点,且相较于图像掩膜方法平均缩短13.36%的点云生成时间,减小9.93%的重投影误差.     

Guidelines for an improved quality of experience in 3‐D TV and 3‐D mobile displays

Stereoscopic (3‐D) movies have become widely popular all over the world. In addition, 3‐D TVs and mobile devices have already been introduced to the consumer market. However, while some manufacturers are introducing 3‐D cameras and movie studios are using proprietary solutions, there are no guidelines for consistently capturing high‐quality stereoscopic content. In this paper, a comprehensive stereoscopic image and video database with content captured at various distances from the camera lenses and under different lighting conditions will be presented. Subjective tests to assess the perceived 3‐D quality of these videos and images, which were shown on displays of different sizes, have been conducted. In addition, the horizontal parallax of the content was adjusted to verify via subjective tests whether this change could increase the viewer's quality of experience. Finally, guidelines of acquisition distances between the cameras and the real scene will be published.     

一种基于边收缩的3维表面模型数据压缩算法

随着数据采集尤其是3维激光扫描技术的发展,对地物目标建立的表面模型越来越精细,由于其不仅导致数据存储量急剧增大,也降低了图形实时交互显示的速度,因此必须对表面模型数据进行压缩处理。为了对原始扫描构模表面模型进行合理、有效的压缩处理,在Garland提出的表面模型压缩算法的基础上,提出了一种新的基于边收缩的表面模型数据压缩算法。该算法首先依据二次误差度量准则计算边收缩的代价,同时确定各边收缩的顺序,然后利用半空间测试方法判断边收缩的合法性,以实现表面模型的边界区域与内部区域的同步压缩。实践表明,该算法不仅在高压缩比的情况下仍能保留原始模型的几何特征,而且能有效地保证压缩模型的质量。     

Applying fuzzy theory in selecting the image quality factors of 3D televisions

With the promotion of technology, state-of-the-art TVs already possess the functions of 3D. This study applied fuzzy theory to construct a hierarchy of 3D TV image quality factors and got the weights for each of them. Several 3D TV image quality factors were selected based on a review of the literature. A fuzzy c-means algorithm was then used to classify these factors into the criteria, and the hierarchy of the fuzzy analytic network process (ANP) was established. Thirty participants were recruited to conduct the questionnaire survey and the rating of the overall ergonomics. Using the calculation of fuzzy ANP, the weights for 3D TV image quality factors and different brands of 3D TVs were obtained. The results indicated that binocular disparity, crosstalk, and resolution were the three most important factors affecting 3D TV image quality. Therefore, 3D TV manufacturers could consider these important factors in future 3D TV product designs in order to promote customers’ purchase intention.Relevance to industryBased on the results obtained from fuzzy ANP, this study found that the three most important factors affecting 3D TV image quality are binocular disparity, crosstalk, and resolution. The results of this study could serve as a reference for 3D TV manufacturers in designing future products.     

Circular camera array system for 3‐D displays based on the reconstruction of parallax rays

Abstract— A circular camera system employing an image‐based rendering technique that captures light‐ray data needed for reconstructing three‐dimensional (3‐D) images by using reconstruction of parallax rays from multiple images captured from multiple viewpoints around a real object in order to display a 3‐D image of a real object that can be observed from multiple surrounding viewing points on a 3‐D display is proposed. An interpolation algorithm that is effective in reducing the number of component cameras in the system is also proposed. The interpolation and experimental results which were performed on our previously proposed 3‐D display system based on the reconstruction of parallax rays will be described. When the radius of the proposed circular camera array was 1100 mm, the central angle of the camera array was 40°, and the radius of a real 3‐D object was between 60 and 100 mm, the proposed camera system, consisting of 14 cameras, could obtain sufficient 3‐D light‐ray data to reconstruct 3‐D images on the 3‐D display.