2D/3D image registration using regression learning

In computer vision and image analysis, image registration between 2D projections and a 3D image that achieves high accuracy and near real-time computation is challenging. In this paper, we propose a novel method that can rapidly detect an object’s 3D rigid motion or deformation from a 2D projection image or a small set thereof. The method is called CLARET (Correction via Limited-Angle Residues in External Beam Therapy) and consists of two stages: registration preceded by shape space and regression learning. In the registration stage, linear operators are used to iteratively estimate the motion/deformation parameters based on the current intensity residue between the target projection(s) and the digitally reconstructed radiograph(s) (DRRs) of the estimated 3D image. The method determines the linear operators via a two-step learning process. First, it builds a low-order parametric model of the image region’s motion/deformation shape space from its prior 3D images. Second, using learning-time samples produced from the 3D images, it formulates the relationships between the model parameters and the co-varying 2D projection intensity residues by multi-scale linear regressions. The calculated multi-scale regression matrices yield the coarse-to-fine linear operators used in estimating the model parameters from the 2D projection intensity residues in the registration. The method’s application to Image-guided Radiation Therapy (IGRT) requires only a few seconds and yields good results in localizing a tumor under rigid motion in the head and neck and under respiratory deformation in the lung, using one treatment-time imaging 2D projection or a small set thereof.     

Productive high-complexity 3D city modeling with point clouds collected from terrestrial LiDAR

To satisfy the needs of photo-realistic and ground-based representation of three-dimensional (3D) city models for a variety of applications, significant efforts have been made to automatically reconstruct detailed 3D building façades from terrestrial LiDAR data. Nonetheless, in real-world applications for high-quality 3D city modeling, three major problems are typically encountered: (1) very low productivity due to fully manual operation, (2) low geometric accuracy of 3D modeling resulting from the process of reducing original LiDAR data, and (3) system failure when importing huge LiDAR data to 3D drawing software. To overcome these limitations, the present study proposes a semi-automatic method entailing a plane component detection based on RANSAC segmentation, boundary tracing of the planar components, and manual drawing of details using the remaining, significantly reduced points. The proposed method was applied to point clouds of various buildings in a high-density area in Korea. In comparison with manual operation, the proposed method was proved to improve modeling productivity in the time-consumption aspect and to facilitate operators’ accurate object drawing. However, for additional automation and completeness of 3D modeling, further study is necessary. The proposed method requires a segmentation algorithm to heuristically determine parameters for the most desirable results as well as to detect curvilinear surfaces in modeling complex and curved façades.     

利用共轭梯度法重建三维物体表面算法的研究

通过立体视觉方法能得到一些分散点处表面信息,根据这些分散点处三维表面信息,可对三维表面进行重建,文中主要讨论利用共轭梯度法重建三维物体表面的算法。     

Curved OLED display to effectively enhance natural3D

We studied the stereoscopic effect obtained from a two‐dimensional image without using binocular parallax, which we call “natural3D” (n3D). Unlike a parallax‐based three‐dimensional (3D) display system, n3D causes less tiredness and is free from a decrease of the resolution by half because of image division and viewing position dependence. To make the display with these effects comfortable to use, we conducted statistical tests with sensory evaluation experiments and a quantitative evaluation based on physiological responses. These examinations revealed that the n3D effect can be effectively obtained by using, for example, the characteristics of an organic light‐emitting diode display, such as high contrast and easy bendability. This study discusses optimal display curvatures for displays of different sizes that enhance n3D and reduce tiredness, which are revealed through statistical tests. In addition, we performed an experiment with a frame called an n3D window (n3Dw) that is placed before the display such that a subject views the display through the opening of the frame. We found that the combination of a curve and the n3Dw causes n3D more effectively.     

基于实时梯度计算的快速纹理映射体绘制

本文分析讨论了一种基于实时梯度计算的纹理映射体绘制算法。在绘制过程中实时计算每个体素上的梯度,有效地减少了在传统基于纹理映射的体绘制中,对梯度预先计算的耗时操作,也降低了内存的消耗,加快了整个绘制过程。同时,采用三维Sobel算子对梯度进行计算,并进行归一化处理,有效地提高了绘制图像的质量。在实现中充分利用了目前PC图形硬件成熟的可编程特性,特别是fragment program,来完成梯度的实时计算。最后对医学体数据进行绘制,得到了理想的结果。     

三维曲面的特征描述和特征匹配

本文提出了一种新的三维曲面特征描述算法,将二维图像上的特征描述思想推广到三维网格。算法将三维网格表示成从顶点到高斯曲率的映射函数,从而获得可类比于二维图像的相似性。借助于法线和梯度建立局部球坐标系,通过二维统计直方图对特征点邻域的几何信息进行描述,使得特征描述具有平移、旋转和缩放不变性,最终生成128维的特征向量(特征描述符)。基于特征向量,我们实现了多分辨率和异拓扑网格下的特征匹配,展示并分析了实验结果。本文的研究动机来源于三维扫描建模以及多视点三维重建技术中对特征描述和特征匹配的需求,主要的应用方向包括:扫描配准、模型注册、动画跟踪、对称检测和模型检索。     

基于微机的三维真实感浓淡绘制方法研究

三维真实感浓绘制方法是三维可视化技术中一项重要的研究课题，本文针对其中具有重要实用价值的距离梯度浓淡绘制方法进行了深入研究，提出了自适应曲面拟合浓淡绘制方法，使浓淡绘制效果最显著提高，为医学图像三维可视化技术在微机领域的应用提供了理论和算法基础。     

三维成像声纳图像后处理与可视化

针对基于线阵合成孔径技术的三维成像声纳缺乏有效后处理与可视化方法的问题,提出一个适用于三维成像声纳图像后处理与可视化方案。鉴于水体和地层2种介质具有不同的声学特性,使用组合算法分离水体和地层数据,利用基于边缘梯度均值约束的三维自适应区域生长算法分别对水底和地层目标进行检测,融合水体和地层数据,采用光线投射法进行三维实验数据的可视化。湖试和近海海试结果表明,该方案能够适应声成像中水体与地层的不同特点,有效检测目标,提高声纳图像的表现能力。     

Consistent gradient operators

We propose optimal gradient operators based on a newly derived consistency criterion. This criterion is based on an orthogonal decomposition of the difference between a continuous gradient and discrete gradients into the intrinsic smoothing effect and the self-inconsistency involved in the operator. We show that consistency assures the exactness of gradient direction of a locally 1D pattern in spite of its orientation, spectral composition, and sub-pixel translation. Stressing that inconsistency reduction is of primary importance, we derive an iterative algorithm which leads to accurate gradient operators of arbitrary size. We compute the optimum 3×3, 4×4, and 5×5 operators, compare them with conventional operators and examine the performance for one synthetic and several real images. The results indicate that the proposed operators are superior with respect to accuracy, bandwidth and isotropy     

Study of 2D/3D Associative Parametric Product Modeling Techniques Adaptive to Piping System

１ＩｎｔｒｏｄｕｃｔｉｏｎＭｅｃｈａｎｉｃａｌＣＡＤｓｙｓｔｅｍｓｕｓｅ３Ｄｇｅｏｍｅｔｒｉｃｒｅｐｒｅｓｅｎｔａｔｉｏｎｔｏｆｏｒｍｔｈｅｇｌｏｂａｌｐｒｏｄｕｃｔｉｎｆｏｒｍａｔｉｏｎｍｏｄｅｌｆｏｒｓａｔｉｓｆｙｉｎｇｔｈｅｗｈｏｌｅｌｉｆｅ...     

基于FPGA的高性能三维电阻抗成像系统

构建以FPGA为核心控制器的两层32电极的高性能三维电阻抗成像系统,详细描述了系统的软硬件设计、系统性能测试及成像试验,图像重建采用共轭梯度算法。测试结果表明,系统测量精度达0.082%,系统空间分辨率达0.51%,信噪比达60.3 dB。在盛有盐水的实验盐水槽进行成像试验,结果表明该系统能够准确识别待测区域目标物的个数、位置、大小等信息。系统的构建为深入研究三维电阻抗成像等关键技术提供可靠的硬件平台。     

基于OpenGL的船舶电力系统三维可视化监控平台开发

船舶电力系统的监控对船舶的安全运行至关重要。为了更直观更真实的展示船舶电力系统的运行状态,设计开发了一种基于OpenGL的三维可视化监控平台。通过调用OpenGLAPI构造三维空间环境;根据船舶电力系统各种设备及其保护装置的物理特性建立三维模型,给定监控状态和仿真参数,实现了对设备模块的动态管理和对设备部件进行组态,构造了一个虚拟的船舶电力系统。通过采集设备状态数据,实现了对系统的组网监控和继电保护算法的实时仿真,配合各种颜色和动画展现出系统的状态,运行结果表明该系统具有直观、真实、交互感等特点,能够对设备的各种状态进行监控且具有保护功能。复杂的船舶电力系统结构和运行状态通过三维可视化的方式形象地表现出来,有助于操作人员更好地理解掌握系统运行过程,提高对船舶电力系统的操控能力。     

Advancing fan-front: 3D triangle mesh compression using fan based traversal

Connectivity compression techniques for very large 3D triangle meshes are based on clever traversals of the graph representing the mesh, so as to avoid the repeated references to vertices. In this paper we present a new algorithm for compressing large 3D triangle meshes through the successive conquest of triangle fans. The connectivity of vertices in a fan is implied. As each fan is traversed, the current mesh boundary is advanced by the fan-front. The process is recursively continued till the entire mesh is traversed. The mesh is then compactly encoded as a sequence of fan configuration codes. The fan configuration code comprehensively encodes the connectivity of the fan with the rest of the mesh. There is no need for any further special operators like split codes and additional vertex offsets. The number of fans is typically one-fourth of the total number of triangles. Only a few of the fan configurations occur with high frequency, enabling excellent connectivity information compression using range encoding. A simple implementation shows significant improvements, on the average, in bit-rate per vertex, compared to earlier reported techniques.     

三维GIS的基本问题与研究进展

经过多年的研究和探索,三维GIS取得了很大成果,成为GIS领域的重要研究内容之一。该文首先分析了三维GIS应实现的功能,然后从三维数据获取、三维空间数据模型、三维空间关系的描述和表达、三维可视化和三维空间分析等几个方面评述了三维GIS的研究进展。     

Web 3D技术的应用比较

Web 3D技术有多种,都有适用的场合,介绍了有代表性的几种Web 3D技术;Vrml、Cortona、Wire Fusion、EON、Virtools、Quest3D、Flash 3D和Unity 3D,比较了它们各自的特点和应用。     

支持GPU的Flash3D技术

3D图形技术的应用早已十分广泛．随着互联网的发展,越来越多的应用被推广到互联网上,但涉及3D的应用却不多,近年来,多种新技术的发展给基于Web的3D图形技术注入了新的活力．本文主要研究了基于AdobeFlash平台的Web3D技术．首先介绍了Flash3D的工作原理,然后介绍了相关的一些3D引擎,最后基于其中的一个3D引擎研究了创建3D场景的一系列关键技术,并实现了一个演示范例．     

3D建模与编程技术

3D建模与编程技术是3D应用软件实现中非常技巧和关键性的技术，目前应用比较广泛的有OpenGL，Direet3D，Java3D和VRML等。OpenGL主要用于底层软件和复杂场景建模软件的开发，Direet3D和Java3D主要应用于较高层次3D软件的快速开发，而VRML实质是一种描述性的3D建模语言，在Plug-in的支持下，可以增强Web的三维功能。对这四种技术的运行机理、实现机制和程序结构等作了较为详尽的阐述。     

Risk assessments of work-related musculoskeletal disorders among the TFT-LCD manufacturing operators

The thin film transistor liquid crystal display (TFT-LCD) industry is one of the major industries in Taiwan, yet few studies addressed its work-related musculoskeletal disorders (WMSDs). Thus, this study aims to evaluate the risk of WMSDs among the operators of a TFT-LCD manufacturing company in Taiwan by using the subjective questionnaire and ergonomic assessment tools. First, the NMQ survey was conducted among 393 operators, accounting for 94% of all operators in the TFT-LCD plant. The results showed that the prevalence of WMSDs was 31.8%. Among the various body parts, the highest prevalence of WMSDs was found in neck and shoulders (20.4%), while upper limbs were with the lowest prevalence (9.2%). Besides, the prevalence of WMSDs tends to be affected by both work factors and operator factors. Those who were more experienced, working in day shift and involved in the Array process tend to have a higher prevalence of WMSDs. Further, female and domestic operators reported a higher prevalence of WMSDs than male and foreign operators. Moreover, the jobs of 50 employees were analyzed using ergonomic assessment tools including OSHA MSDs, BRIEF, OWAS, 3D SSPP, and NIOSH lifting equation. The findings indicated that inadequate working height, restricted working space, awkward postures, overweight load, and high repetition were the major risk factors of WMSDs. Thus, countermeasures such as redesigning the workstations and material handling carts, proactive training of manual material handling, and providing safety clearance are recommended to enhance the occupational health and safety of the TFT-LCD operators.