医学三维影像体数据闭值分割方法

建立医学三维体数据阈值分割描述模型,把OSTU图像分割算法和梯度算子图像分割算法的思想应用于三维体数据,提出并实现了两种医学三维体数据阈值分割算法,并通过实验证明这两种算法获得了较好的分割效果。为进一步对体数据阈值分割算法的性能进行量化评价,定义了两个量化指标:分割准确度和分割平衡度,并通过实验给出了上述两种体数据阈值分割算法的性能评价指标。在给定体数据和标准分割的前提下,OSTU算法比梯度算子算法能取得更好的阈值分割效果。     

A novel 3D mesh compression using mesh segmentation with multiple principal plane analysis

This paper proposes a novel scheme for 3D model compression based on mesh segmentation using multiple principal plane analysis. This algorithm first performs a mesh segmentation scheme, based on fusion of the well-known k-means clustering and the proposed principal plane analysis to separate the input 3D mesh into a set of disjointed polygonal regions. The boundary indexing scheme for the whole object is created by assembling local regions. Finally, the current work proposes a triangle traversal scheme to encode the connectivity and geometry information simultaneously for every patch under the guidance of the boundary indexing scheme. Simulation results demonstrate that the proposed algorithm obtains good performance in terms of compression rate and reconstruction quality.     

Automatic model-based 3D object recognition by combining feature matching with tracking

We propose a vision-based robust automatic 3D object recognition, which provides object identification and 3D pose information by combining feature matching with tracking. For object identification, we propose a robust visual feature and a probabilistic voting scheme. An initial object pose is estimated using correlations between the model image and the 3D CAD model, which are predefined, and the homography, byproduct of the identification. In tracking, a Lie group formalism is used for robust and fast motion computation. Experimental results show that object recognition by the proposed method improves the recognition range considerably. Sungho Kim received the B.S. degree in Electrical Engineering from Korea University, Korea in 2000 and the M.S. degree in Electrical Engineering and Computer Science from Korea Advanced Institute of Science and Technology, Korea in 2002. He is currently pursuing his Ph.D. at the latter institution, concentrating on 3D object recognition and tracking. In So Kweon received the Ph.D. degree in robotics from Carnegie Mellon University, Pittsburgh, PA, in 1990. Since 1992, he has been a Professor of Electrical Engineering at KAIST. His current research interests include human visual perception, object recognition, real-time tracking, vision-based mobile robot localization, volumetric 3D reconstruction, and camera calibration. He is a member of the IEEE, and Korea Robotics Society (KRS).     

Exploration trees on highly complex scenes: A new approach for 3D segmentation

A new strategy for automatic object extraction in highly complex scenes is presented in this paper. The method proposed gives a solution for 3D segmentation avoiding most restrictions imposed in other techniques. Thus, our technique is applicable on unstructured 3D information (i.e. cloud of points), with a single view of the scene, scenes consisting of several objects where contact, occlusion and shadows are allowed, objects with uniform intensity/texture and without restrictions of shape, pose or location. In order to have a fast segmentation stopping criteria, the number of objects in the scene is taken as input. The method is based on a new distributed segmentation technique that explores the 3D data by establishing a set of suitable observation directions. For each exploration viewpoint, a strategy [3D data]-[2D projected data]-[2D segmentation]-[3D segmented data] is accomplished. It can be said that this strategy is different from current 3D segmentation strategies. This method has been successfully tested in our lab on a set of real complex scenes. The results of these experiments, conclusions and future improvements are also shown in the paper.     

结合语义分割与模型匹配的室内场景重建方法

目的 由于室内点云场景中物体的密集性、复杂性以及多遮挡等带来的数据不完整和多噪声问题,极大地限制了室内点云场景的重建工作,无法保证场景重建的准确度。为了更好地从无序点云中恢复出完整的场景,提出了一种基于语义分割的室内场景重建方法。方法 通过体素滤波对原始数据进行下采样,计算场景三维尺度不变特征变换（3D scale-invariant feature transform,3D SIFT）特征点,融合下采样结果与场景特征点从而获得优化的场景下采样结果;利用随机抽样一致算法（random sample consensus,RANSAC）对融合采样后的场景提取平面特征,将该特征输入PointNet网络中进行训练,确保共面的点具有相同的局部特征,从而得到每个点在数据集中各个类别的置信度,在此基础上,提出了一种基于投影的区域生长优化方法,聚合语义分割结果中同一物体的点,获得更精细的分割结果;将场景物体的分割结果划分为内环境元素或外环境元素,分别采用模型匹配的方法、平面拟合的方法从而实现场景的重建。结果 在S3DIS （Stanford large-scale 3D indoor space dataset）数据集上进行实验,本文融合采样算法对后续方法的效率和效果有着不同程度的提高,采样后平面提取算法的运行时间仅为采样前的15%;而语义分割方法在全局准确率（overall accuracy,OA）和平均交并比（mean intersection over union,mIoU）两个方面比PointNet网络分别提高了2.3%和4.2%。结论 本文方法能够在保留关键点的同时提高计算效率,在分割准确率方面也有着明显提升,同时可以得到高质量的重建结果。     

Reconstruction of 3D contour with an active laser‐vision robotic system

This paper presents a 3D contour reconstruction approach employing a wheeled mobile robot equipped with an active laser‐vision system. With observation from an onboard CCD camera, a laser line projector fixed‐mounted below the camera is used for detecting the bottom shape of an object while an actively‐controlled upper laser line projector is utilized for 3D contour reconstruction. The mobile robot is driven to move around the object by a visual servoing and localization technique while the 3D contour of the object is being reconstructed based on the 2D image of the projected laser line. Asymptotical convergence of the closed‐loop system has been established. The proposed algorithm also has been used experimentally with a Dr Robot X80sv mobile robot upgraded with the low‐cost active laser‐vision system, thereby demonstrating effective real‐time performance. This seemingly novel laser‐vision robotic system can be applied further in unknown environments for obstacle avoidance and guidance control tasks. Copyright © 2011 John Wiley and Sons Asia Pte Ltd and Chinese Automatic Control Society     

层次结构导向下的动画角色模型分割与标记

对三维角色模型进行语义化检索与重组的前提是进行准确的分割和标记。本文针对游戏与影视中应用广泛的三维角色模型,提出了一种基于结构先验知识的角色部件分割和标记方法。总结了动画角色模型的一般性结构规则,并形式化为可以指导分割的层次化知识表达;采用区域生长法逐层剥离模型部件,在此规则下进行末端检测与边界判断,同时对部件进行语义标记。在两足与四足角色模型上进行测试,与其它可标记的角色模型分割方法相比,本方法具有更好的部件化结果,以及对动画角色有良好的扩展性。     

自监督深度残差函数映射网络的3维模型对应关系计算

目的 针对传统非刚性3维模型的对应关系计算方法需要模型间真实对应关系监督的缺点,提出一种自监督深度残差函数映射网络（self-supervised deep residual functional maps network,SSDRFMN）。方法 首先将局部坐标系与直方图结合以计算3维模型的特征描述符,即方向直方图签名（signature of histograms of orientations,SHOT）描述符;其次将源模型与目标模型的SHOT描述符输入SSDRFMN,利用深度函数映射（deep functional maps,DFM）层计算两个模型间的函数映射矩阵,并通过模糊对应层将函数映射关系转换为点到点的对应关系;最后利用自监督损失函数计算模型间的测地距离误差,对计算出的对应关系进行评估。结果 实验结果表明,在MPI-FAUST数据集上,本文算法相比于有监督的深度函数映射（supervised deep functional maps,SDFM）算法,人体模型对应关系的测地误差减小了1.45;相比于频谱上采样（spectral upsampling,SU）算法减小了1.67。在TOSCA数据集上,本文算法相比于SDFM算法,狗、猫和狼等模型的对应关系的测地误差分别减小了3.13、0.98和1.89;相比于SU算法分别减小了2.81、2.22和1.11,并有效克服了已有深度函数映射方法需要模型间的真实对应关系来监督的缺点,使得该方法可以适用于不同的数据集,可扩展性大幅增强。结论 本文通过自监督深度残差函数映射网络训练模型的方向直方图签名描述符,提升了模型对应关系的准确率。本文方法可以适应于不同的数据集,相比传统方法,普适性较好。     

基于多分辨率马尔可夫随机场运动目标分割

提出一种基于三维时空小波变换和马尔可夫随机场(MarkovRandomField)模型的多分辨率运动目标分割算法。该算法利用三维时空小波变换对图像序列进行分解得到多分辨率的图像序列,并在此基础上建立多分辨率的马尔可夫随机场模型,构造相应的能量函数。通过条件迭代模型优化算法(IteratedConditionalModes)求解能量函数的最优解,得出标记场,提取出运动目标。实验结果证明,该算法能够很好地消除了单一分辨率的MRF运动检测结果中"空洞"现象,对运动目标分割具有很好的分割效果。     

三维激光扫描表面数据区域分割

针对现有三维激光扫描数据区域分割算法受原始碎片表面粗糙度影响较大且只适用于形状较规则、表面较平坦及断裂面较少的物体这一问题,提出了区域膨胀策略的三维扫描表面数据区域分割算法,该算法将三维激光扫描表面数据分割成若干个具有相同法矢方向的区域。首先将三维扫描表面数据转化为三维网格模型;然后利用同一区域中相邻网格具有相似法线方向这一性质,使用区域膨胀策略生成若干获选表面区域;最后通过去除候选区域中的噪声区域得到最终表面区域分割结果。通过实物表面扫描数据对上述算法进行仿真验证,结果表明该算法可对三维表面扫描数据进行有效的区域分割。     

3DIVE: An Immersive Environment for Interactive Volume Data Exploration

This paper describes an immersive system,called 3DIVE,for interactive volume data visualization and exploration inside the CAVE virtual environment.Combining interactive volume rendering and virtual reality provides a netural immersive environment for volumetric data visualization.More advanced data exploration operations,such as object level data manipulation,simulation and analysis ,are supported in 3DIVE by several new techniques,In particular,volume primitives and texture regions ae used for the rendering,manipulation,and collision detection of volumetric objects;and the region-based rendering pipeline is integrated with 3D image filters to provide an image-based mechanism for interactive transfer function design.The system has been recently released as public domain software for CAVE/ImmersaDesk users,and is currently being actively used by various scientific and biomedical visualization projects.     

基于OpenGL的三维建模在水利行业中的应用

三维建模技术可以真实地再现人们身边的物体,研究三维建模技术对于三维立体图像技术的进一步发展具有十分重大的意义。在水利领域,三维仿真越来越被重视,OpenGL是优秀且功能强大的图形库,文中利用OpenGL,采用基于三角剖分的方法对库区的地形进行建模,从而实现库区地形的实时仿真,对于更加复杂的三维实体可以采用先用3DMAX等专业的建模软件进行建模,再导入OpenGL以便简化建模过程,提高效率。实验结果表明采用这种基于三角剖分的方法来建模是可行的,文中给出了实例。     

Efficient surface reconstruction method for distributed CAD

This paper describes a new fast Reverse Engineering (RE) method for creating a 3D computerized model from an unorganized cloud of points. The proposed method is derived directly from the problems and difficulties currently associated with remote design over the Internet, such as accuracy, transmission time and representation at different levels of abstraction. With the proposed method, 3D models suitable for distributed design systems can be reconstructed in real time. The mesh reconstruction approach is based on aggregating very large scale 3D scanned data into a Hierarchical Space Decomposition Model (HSDM), realized by the Octree data structure. Then, a Connectivity Graph (CG) is extracted and filled with facets. The HSDM can represent both the boundary surface and the interior volume of an object. Based on the proposed volumetric model, the surface reconstruction process becomes robust and stable with respect to sampling noise. Moreover, the data received from different surface/volume sampling devices can be handled naturally. The hierarchical structure of the proposed volumetric model enables data reduction, while preserving significant geometrical features and object topology. As a result, reconstruction and transmission over the network are efficient. Furthermore, the hierarchical representation provides a capability for extracting models at desired levels of detail, thus enabling designers to collaborate at any product development stage: draft or detailed design.     

一种融合二维和三维卷积网络的两阶段冠状动脉分 割方法

心血管疾病是一种严重危害公众健康的重大疾病。与其他心血管疾病相比,冠心病是导致死亡的最主要原因,精确的冠状动脉分割对冠心病的治疗有重要意义。目前,深度学习已经广泛应用于医学影像领域,然而,像冠状动脉这样的小物体的分割仍然是一大挑战。针对冠状动脉精确分割的需求,该研究提出了一种融合二维和三维卷积网络的方案,利用骨架作为桥梁,结合二维和三维卷积网络,扩大了卷积网络的信息接受域。与其他深度学习方法相比,该方法在敏感度、Dice 系数、ROC 曲线下方的面积、豪斯多夫距离上均有一定程度的提升,且可以检测其他方法无法识别的冠状动脉,一定程度上解决了血管断连和血管缺失等问题。     

An efficient and robust algorithm for 3D mesh segmentation

This paper presents an efficient and robust algorithm for 3D mesh segmentation. Segmentation is one of the main areas of 3D object modeling. Most segmentation methods decompose 3D objects into parts based on curvature analysis. Most of the existing curvature estimation algorithms are computationally costly. The proposed algorithm extracts features using Gaussian curvature and concaveness estimation to partition a 3D model into meaningful parts. More importantly, this algorithm can process highly detailed objects using an eXtended Multi-Ring (XMR) neighborhood based feature extraction. After feature extraction, we also developed a fast marching watershed-based segmentation algorithm followed by an efficient region merging scheme. Experimental results show that this segmentation algorithm is efficient and robust.     

A variational approach to vesicle membrane reconstruction from fluorescence imaging

Biological applications like vesicle membrane analysis involve the precise segmentation of 3D structures in noisy volumetric data, obtained by techniques like magnetic resonance imaging (MRI) or laser scanning microscopy (LSM). Dealing with such data is a challenging task and requires robust and accurate segmentation methods. In this article, we propose a novel energy model for 3D segmentation fusing various cues like regional intensity subdivision, edge alignment and orientation information. The uniqueness of the approach consists in the definition of a new anisotropic regularizer, which accounts for the unbalanced slicing of the measured volume data, and the generalization of an efficient numerical scheme for solving the arising minimization problem, based on linearization and fixed-point iteration. We show how the proposed energy model can be optimized globally by making use of recent continuous convex relaxation techniques. The accuracy and robustness of the presented approach are demonstrated by evaluating it on multiple real data sets and comparing it to alternative segmentation methods based on level sets. Although the proposed model is designed with focus on the particular application at hand, it is general enough to be applied to a variety of different segmentation tasks.     

Non-rigid 3D shape tracking from multiview video

We present a fast and efficient non-rigid shape tracking method for modeling dynamic 3D objects from multiview video. Starting from an initial mesh representation, the shape of a dynamic object is tracked over time, both in geometry and topology, based on multiview silhouette and 3D scene flow information. The mesh representation of each frame is obtained by deforming the mesh representation of the previous frame towards the optimal surface defined by the time-varying multiview silhouette information with the aid of 3D scene flow vectors. The whole time-varying shape is then represented as a mesh sequence which can efficiently be encoded in terms of restructuring and topological operations, and small-scale vertex displacements along with the initial model. The proposed method has the ability to deal with dynamic objects that may undergo non-rigid transformations and topological changes. The time-varying mesh representations of such non-rigid shapes, which are not necessarily of fixed connectivity, can successfully be tracked thanks to restructuring and topological operations employed in our deformation scheme. We demonstrate the performance of the proposed method both on real and synthetic sequences.