A neural network-based stochastic active contour model (NNS-SNAKE)for contour finding of distinct features

Contour finding of distinct features in 2-D/3-D images is essential for image analysis and computer vision. To overcome the potential problems associated with existing contour finding algorithms, we propose a framework, called the neural network-based stochastic active contour model (NNS-SNAKE), which integrates a neural network classifier for systematic knowledge building, an active contour model (also known as the "Snake") for automated contour finding using energy functions, and the Gibbs sampler to help the snake to find the most probable contour using a stochastic decision mechanism. Successful application of the NNS-SNAKE to extraction of several types of contours on magnetic resonance (MR) images is presented.     

Detection of the carpal bone contours from 3-D MR images of the wrist using a planar radial scale-space snake

In this paper we consider the problems encountered when applying snake models to detect the contours of the carpal bones in 3-D MR images of the wrist. In order to improve the performance of the original snake model introduced by Kass [1], we propose a new image force based on one-dimensional (1-D) second-order Gaussian filtering and contrast equalization. The improved snake is less sensitive to model initialization and has no tendency to cut off contour sections of high curvature, because 1-D radial scale-space relaxation is used. Contour orientation is used to minimize the influence of neighboring image structures. Due to 1-D contrast equalization an intensity insensitive measure of external energy is obtained. As a consequence a good balance between internal and external energetic contributions of the snake is established, which also improves convergence. By incorporating this new image force into the snake model, we succeed in accurate contour detection, even when relatively high noise levels are present and when the contrast varies along the contours of the bones.     

Development of a vertebral endplate 3-D reconstruction technique

The increase of low back problems has stimulated the development of different analysis and evaluation techniques. Among these methods, the direct linear transformation (DLT) technique is commonly used to reconstruct the spine in three dimensions by means of its known image coordinates on radiographs. Despite its efficiency and precision, general reconstruction of some standard anatomical landmarks does not give all the necessary data for a detailed analysis of the intrinsic geometrical characteristics of lumbar vertebrae. Thus, in order to obtain such geometrical information a three-dimensional (3-D) reconstruction vertebral endplate contour technique has been developed. This technique involves: (1) iterative optimization and reconstruction processes of the vertebral endplate centroid; and (2) 3-D reconstruction of vertebral endplate contour. Validation based on mathematical simulations demonstrated that two or three iterations are necessary to correct (within 2 mm) the endplate centroid position for simulated error higher than 10 mm. Other validations based on 3-D reconstructions of a chamfered tube and a dry vertebra contours of known dimensions have given mean errors of 2 mm. Application on a healthy subject demonstrated the potential of this 3-D reconstruction technique. Finally, 3-D data obtained on vertebral endplates would allow the development of new clinical measurements that could be used to evaluate the lumbar spine geometrical behavior and orthoses biomechanical effects     

A multistage, optimal active contour model

Energy-minimizing active contour models or snakes can be used in many applications such as edge detection, motion tracking, image matching, computer vision, and three-dimensional (3-D) reconstruction. We present a novel snake that is superior both in accuracy and convergence speed over previous snake algorithms. High performance is achieved by using spline representation and dividing the energy-minimization process into multiple stages. The first stage is designed to optimize the convergence speed in order to allow the snake to quickly approach the minimum-energy state. The second stage is devoted to snake refinement and to local minimization of energy, thereby driving the snake to a quasiminimum-energy state. The third stage uses the Bellman (1957) optimality principle to fine-tune the snake to the global minimum-energy state. This three-stage scheme is optimized for both accuracy and speed.     

Deformable boundary detection of stents in angiographic images

In this paper, a procedure is described for deformable boundary detection of medical tools, called stents, in angiographic images. A stent is a surgical stainless steel coil that is placed in the artery in order to improve blood circulation in regions where a stenosis has appeared. Assuming initially a set of three-dimensional (3-D) models of stents and using perspective projection of various deformations of the 3-D model of the stent, a large set of synthetic two-dimensional (2-D) images of stents is constructed. These synthetic images are then used as a training set for deriving a multivariate Gaussian density estimate based on eigenspace decomposition and formulating a maximum-likelihood estimation framework in order to reach an initial rough estimate for automatic object recognition. The silhouette of the detected stent is then refined by using a 2-D active contour (snake) algorithm integrated with a novel iterative initialization technique, which takes into consideration the geometry of the stent. The algorithm is experimentally evaluated using real angiographic images containing stents.     

ROPES: a semiautomated segmentation method for accelerated analysis of three-dimensional echocardiographic data

Echocardiography (cardiac ultrasound) is today the predominant technique for quantitative assessment of cardiac function and valvular heart lesions. Segmentation of cardiac structures is required to determine many important diagnostic parameters. As the heart is a moving organ, reliable information can be obtained only from three-dimensional (3-D) data over time (3-D + time = 4-D). Due to their size, the resulting four-dimensional (4-D) data sets are not reasonably accessible to simple manual segmentation methods. Automatic segmentation often yields unsatisfactory results in a clinical environment, especially for ultrasonic images. We describe a semiautomated segmentation algorithm (ROPES) that is able to greatly reduce the time necessary for user interaction and its application to extract various parameters from 4-D echocardiographic data. After searching for candidate contour points, which have to fulfill a multiscale edge criterion, the candidates are connected by minimizing a cost function to line segments that then are connected to form a closed contour. The contour is automatically checked for plausibility. If necessary, two correction methods that can also be used interactively are applied (fitting of other line segments into the contour and searching for additional candidates with a relaxed criterion). The method is validated using in vivo transesophageal echocardiographic data sets.     

DMD芯片在光栅投影三维轮廓测量技术中的应用

光栅投影成像法经常用于物体的非接触形状测量和形变测量。通过莫尔相移法,可以实时获得物体表面的等高轮廓线。但是在测量高速运动物体三维轮廓图像时误差较大,因为相移法需要拍摄几张经过相移后的变形光栅。在加入了DMD芯片后,可以在CCD的一帧图像时间内完成所有的相移后变形光栅的图像拍摄,有效地降低了高速运动物体三维轮廓成像的误差。     

Vessels as 4-D curves: global minimal 4-D paths to extract 3-D tubular surfaces and centerlines

In this paper, we propose an innovative approach to the segmentation of tubular structures. This approach combines all of the benefits of minimal path techniques such as global minimizers, fast computation, and powerful incorporation of user input, while also having the capability to represent and detect vessel surfaces directly which so far has been a feature restricted to active contour and surface techniques. The key is to represent the trajectory of a tubular structure not as a 3-D curve but to go up a dimension and represent the entire structure as a 4-D curve. Then we are able to fully exploit minimal path techniques to obtain global minimizing trajectories between two user supplied endpoints in order to reconstruct tubular structures from noisy or low contrast 3-D data without the sensitivity to local minima inherent in most active surface techniques. In contrast to standard purely spatial 3-D minimal path techniques, however, we are able to represent a full tubular surface rather than just a curve which runs through its interior. Our representation also yields a natural notion of a tube's "central curve." We demonstrate and validate the utility of this approach on magnetic resonance (MR) angiography and computed tomography (CT) images of coronary arteries.     

Automated optic disk boundary detection by modified active contour model

This paper presents a novel deformable-model-based algorithm for fully automated detection of optic disk boundary in fundus images. The proposed method improves and extends the original snake (deforming-only technique) in two aspects: clustering and smoothing update. The contour points are first self-separated into edge-point group or uncertain-point group by clustering after each deformation, and these contour points are then updated by different criteria based on different groups. The updating process combines both the local and global information of the contour to achieve the balance of contour stability and accuracy. The modifications make the proposed algorithm more accurate and robust to blood vessel occlusions, noises, ill-defined edges and fuzzy contour shapes. The comparative results show that the proposed method can estimate the disk boundaries of 100 test images closer to the groundtruth, as measured by mean distance to closest point (MDCP) <3 pixels, with the better success rate when compared to those obtained by gradient vector flow snake (GVF-snake) and modified active shape models (ASM).     

Design of RF needle applicators for optimum SAR distributions inirregularly shaped tumors

The impedance method has been used to obtain specific absorption rate (SAR) distributions for a model of a brain tumor for which the shape was determined from CT head scans. Different locations of 4, 5, or 6 needles were used to obtain optimum arrangements that gave minimum standard deviations (SDs) for the SARs in the volume of the tumor. Further work, presently underway, will develop the thermal model to obtain 3-D temperature distributions for the tumor and its surrounding volume to help design applicators giving tumor temperatures with minimum SDs. The procedure described should be applicable for treatment planning of thermotherapy for a number of tumors for which local hyperthermia by RF needle applicators has been found useful     

Tracking visible boundary of objects using occlusion adaptive motion snake

We propose a novel technique for tracking the visible boundary of a video object in the presence of occlusion. Starting with an initial contour that is interactively specified by the user and may be automatically refined by using intra-energy terms, the proposed technique employs piecewise contour prediction using local motion and color information on both sides of the contour segment, and contour snapping using scale-invariant intra-frame and inter-frame energy terms. The piecewise (segmented) nature of the contour prediction scheme and modeling of the motion on both sides of each contour segment enable accurate determination of whether and where the tracked boundary is occluded by another object. The proposed snake energy terms are associated with contour segments (as opposed to node points) and they are scale/resolution independent to allow multi-resolution contour tracking without the need to retune the weights of the energy terms at each resolution level. This facilitates contour prediction at coarse resolution and snapping at fine resolution with high accuracy. Experimental results are provided to illustrate the performance of the proposed occlusion detection algorithm and the novel snake energy terms that enable visible boundary tracking in the presence of occlusion.     

基于斜对称性的闭合曲线恢复

在计算机视觉中，对称性是三维物体的重要几何特征之一，可以利用它来恢复物体的结构，确定三给空间位置，但由于物体之间互相遮挡以及噪声影响，很难获得完整的对称图形，本文基于以前所获得有关闭合曲线的斜对称性质，阐述了以给定的一段曲线，只要找出两条相邻的斜对称轴线，确定其对称度，经线性几何正反变换，就可完整地恢复闭合曲线的算法，使用该算法所进行的实验是令人满意的。     

Image guidance of breast cancer surgery using 3-D ultrasound imagesand augmented reality visualization

This paper describes augmented reality visualization for the guidance of breast-conservative cancer surgery using ultrasonic images acquired in the operating room just before surgical resection. By combining an optical three-dimensional (3-D) position sensor, the position and orientation of each ultrasonic cross section are precisely measured to reconstruct geometrically accurate 3-D tumor models from the acquired ultrasonic images. Similarly, the 3-D position and orientation of a video camera are obtained to integrate video and ultrasonic images in a geometrically accurate manner. Superimposing the 3-D tumor models onto live video images of the patient's breast enables the surgeon to perceive the exact 3-D position of the tumor, including irregular cancer invasions which cannot be perceived by touch, as if it were visible through the breast skin. Using the resultant visualization, the surgeon can determine the region for surgical resection in a more objective and accurate manner, thereby minimizing the risk of a relapse and maximizing breast conservation. The system was shown to be effective in experiments using phantom and clinical data     

Three-dimensional optical tomographic imaging of breast in a humansubject

We present for the first time a full three-dimensional (3-D) reconstruction of absorption images of breast from continuous-wave (cw) measurements performed on a premenopausal woman. Our 3-D optical images clearly reveal a large primary tumor as well as a small secondary tumor in a separate location of the breast. The multiple tumors identified by our 3-D optical imaging have been confirmed by the subsequent biopsy examination of the breast. Quantitative information of the optical images obtained is provided in terms of the location, size, and absorption coefficient of the tumors.     

Three-dimensional tumor perfusion reconstruction using fractal interpolation functions

It has been shown that the perfusion of blood in tumor tissue can be approximated using the relative perfusion index determined from dynamic contrast-enhanced magnetic resonance imaging (DE-MRI) of the tumor blood pool. Also, it was concluded in a previous report that the blood perfusion in a two-dimensional (2-D) tumor vessel network has a fractal structure and that the evolution of the perfusion front can be characterized using invasion percolation. In this paper, the three-dimensional (3-D) tumor perfusion is reconstructed from the 2-D slices using the method of fractal interpolation functions (FIF), i.e., the piecewise self-affine fractal interpolation model (PSAFIM) and the piecewise hidden variable fractal interpolation model (PHVFIM). The fractal models are compared to classical interpolation techniques (linear, spline, polynomial) by means of determining the 2-D fractal dimension of the reconstructed slices. Using FIFs instead of classical interpolation techniques better conserves the fractal-like structure of the perfusion data. Among the two FIF methods, PHVFIM conserves the 3-D fractality better due to the cross correlation that exists between the data in the 2-D slices and the data along the reconstructed direction. The 3-D structures resulting from PHVFIM have a fractal dimension within 3%-5% of the one reported in literature for 3-D percolation. It is, thus, concluded that the reconstructed 3-D perfusion has a percolation-like scaling. As the perfusion term from bio-heat equation is possibly better described by reconstruction via fractal interpolation, a more suitable computation of the temperature field induced during hyperthermia treatments is expected.     

一种基于参数活动轮廓模型的高能闪光照相图像分割算法

针对高能闪光照相系统成像质量较差的特点,提出了一种基于参数活动轮廓模型(Snake模型)的闪光照相图像分割算法.该算法在传统高斯力Snake模型中引入包含图像区域信息的变力,以目标和背景两区域具有最小方差为准则,构建兼顾边缘和区域信息的外部能量函数.数值实验结果表明,该算法对初始轮廓位置不敏感,较好地解决了客体凹陷区域分割问题,能够实现对含噪声的弱边界闪光图像的自动分割.     

A new approach for subset 2-D AR model identification fordescribing textures

This paper addresses the problem of identification of appropriate autoregressive (AR) components to describe textural regions of digital images by a general class of two-dimensional (2-D) AR models. In analogy with univariate time series, the proposed technique first selects a neighborhood set of 2-D lag variables corresponding to the significant multiple partial auto-correlation coefficients. A matrix is then suitably formed from these 2-D lag variables. Using singular value decomposition (SVD) and orthonormal with column pivoting factorization (QRcp) techniques, the prime information of this matrix corresponding to different pseudoranks is obtained. Schwarz's (1978) information criterion (SIG) is then used to obtain the optimum set of 2-D lag variables, which are the appropriate autoregressive components of the model for a given textural image. A four-class texture classification scheme is illustrated with such models and a comparison of the technique with the work of Chellappa and Chatterjee (1985) is provided.     

新体制SAR三维成像技术研究进展

常规SAR成像,平台沿直线飞行,形成直线型合成孔径,仅能获取2维图像,即3维空间中的观测场景在斜距-方位平面的2维投影,图像具有叠掩、透视缩短、阴影等畸变现象。SAR 3维成像突破了斜距-方位2维频率信息获取,能够获取第3维频率信息,实现3维分辨,可获得观测场景的散射中心在3维空间中的分布,从而解决叠掩问题,消除透视缩短、顶底倒置等几何形变现象,更直观地描述客观场景,已成为国际研究热点。该文介绍SAR 3维成像的概念和主要观测模式,分析该领域国内外研究现状和进展,重点阐述作者所在研究团队的SAR 3维成像研究进展,最后对SAR 3维成像技术进行总结和展望。