Lung motion correction on respiratory gated 3-D PET/CT images

Motion is a source of degradation in positron emission tomography (PET)/computed tomography (CT) images. As the PET images represent the sum of information over the whole respiratory cycle, attenuation correction with the help of CT images may lead to false staging or quantification of the radioactive uptake especially in the case of small tumors. We present an approach avoiding these difficulties by respiratory-gating the PET data and correcting it for motion with optical flow algorithms. The resulting dataset contains all the PET information and minimal motion and, thus, allows more accurate attenuation correction and quantification.     

3-D active appearance models: segmentation of cardiac MR and ultrasound images

A model-based method for three-dimensional image segmentation was developed and its performance assessed in segmentation of volumetric cardiac magnetic resonance (MR) images and echocardiographic temporal image sequences. Comprehensive design of a three-dimensional (3-D) active appearance model (AAM) is reported for the first time as an involved extension of the AAM framework introduced by Cootes et al. The model's behavior is learned from manually traced segmentation examples during an automated training stage. Information about shape and image appearance of the cardiac structures is contained in a single model. This ensures a spatially and/or temporally consistent segmentation of three-dimensional cardiac images. The clinical potential of the 3-D AAM is demonstrated in short-axis cardiac MR images and four-chamber echocardiographic sequences. The method's performance was assessed by comparison with manually identified independent standards in 56 clinical MR and 64 clinical echo image sequences. The AAM method showed good agreement with the independent standard using quantitative indexes of border positioning errors, endo- and epicardial volumes, and left ventricular mass. In MR, the endocardial volumes, epicardial volumes, and left ventricular wall mass correlation coefficients between manual and AAM were R2 = 0.94, 0.97, 0.82, respectively. For echocardiographic analysis, the area correlation was R2 = 0.79. The AAM method shows high promise for successful application to MR and echocardiographic image analysis in a clinical setting.     

Quantitative evaluation of three calibration methods for 3-D freehand ultrasound

In this paper, three different calibration methods for three-dimensional (3-D) freehand ultrasound (US) are evaluated. Calibration is the process of estimating the rigid transformation from US image coordinates to the coordinate system of the tracking sensor mounted onto the probe. Calibration accuracy has an important impact on quantitative studies. Geometrical precision can also be crucial in many interventions and surgery. The proposed evaluation framework relies on a single point phantom and a 3-D US phantom which mimics the US characteristics of human liver. Four quality measures are used: 3-D point localization criterion, distance and volume measurements, and shape based criterion. Results show that during the acquisition procedure, volumetric measurements and shapes of the reconstructed object depend on probe motion used, particularly fan motions for which errors are larger. It is also shown that accurate calibration is essential to obtain reliable quantitative information.     

Automated 3-D PDM construction from segmented images using deformable models

In recent years, several methods have been proposed for constructing statistical shape models to aid image analysis tasks by providing a priori knowledge. Examples include principal component analysis of manually or semiautomatically placed corresponding landmarks on the learning shapes [point distribution models (PDMs)], which is time consuming and subjective. However, automatically establishing surface correspondences continues to be a difficult problem. This paper presents a novel method for the automated construction of three-dimensional PDM from segmented images. Corresponding surface landmarks are established by adapting a triangulated learning shape to segmented volumetric images of the remaining shapes. The adaptation is based on a novel deformable model technique. We illustrate our approach using computed tomography data of the vertebra and the femur. We demonstrate that our method accurately represents and predicts shapes.     

Combinatorial and probabilistic fusion of noisy correlation measurements for untracked freehand 3-D ultrasound

In freehand 3-D ultrasound (US), the relative positions of US images are usually measured using a position tracking device despite its cumbersome nature. The probe trajectory can instead be estimated from image data, using registration techniques to recover in-plane motion and speckle decorrelation to recover out-of-plane transformations. The relationship between speckle decorrelation and elevational separation is typically represented by a single curve, estimated from calibration data. Distances read off such a curve are corrupted by bias and uncertainty, and only provide an absolute estimate of elevational displacement. This paper presents a probabilistic model of the relationship between correlation measurements and elevational separation. This representation captures the skewed distribution of distance estimates based on high correlations and the uncertainties attached to each measurement. Multiple redundant correlation measurements can then be integrated within a maximum likelihood estimation framework. This paper also introduces a new method based on the traveling salesman problem for resolving sign ambiguities in data sets resulting from nonmonotonic probe motion and frame intersections. Experiments with real and synthetic US data show that by combining these new methods, out-of-plane US probe motion is recovered with improved accuracy over baseline methods using a deterministic model and fewer measurements.      

Deformable segmentation of 3-D ultrasound prostate images using statistical texture matching method

This paper presents a novel deformable model for automatic segmentation of prostates from three-dimensional ultrasound images, by statistical matching of both shape and texture. A set of Gabor-support vector machines (G-SVMs) are positioned on different patches of the model surface, and trained to adaptively capture texture priors of ultrasound images for differentiation of prostate and nonprostate tissues in different zones around prostate boundary. Each G-SVM consists of a Gabor filter bank for extraction of rotation-invariant texture features and a kernel support vector machine for robust differentiation of textures. In the deformable segmentation procedure, these pretrained G-SVMs are used to tentatively label voxels around the surface of deformable model as prostate or nonprostate tissues by a statistical texture matching. Subsequently, the surface of deformable model is driven to the boundary between the tentatively labeled prostate and non-prostate tissues. Since the step of tissue labeling and the step of label-based surface deformation are dependent on each other, these two steps are repeated until they converge. Experimental results by using both synthesized and real data show the good performance of the proposed model in segmenting prostates from ultrasound images.     

Automatic construction of 3-D statistical deformation models of the brain using nonrigid registration

In this paper, we show how the concept of statistical deformation models (SDMs) can be used for the construction of average models of the anatomy and their variability. SDMs are built by performing a statistical analysis of the deformations required to map anatomical features in one subject into the corresponding features in another subject. The concept of SDMs is similar to statistical shape models (SSMs) which capture statistical information about shapes across a population, but offers several advantages over SSMs. First, SDMs can be constructed directly from images such as three-dimensional (3-D) magnetic resonance (MR) or computer tomography volumes without the need for segmentation which is usually a prerequisite for the construction of SSMs. Instead, a nonrigid registration algorithm based on free-form deformations and normalized mutual information is used to compute the deformations required to establish dense correspondences between the reference subject and the subjects in the population class under investigation. Second, SDMs allow the construction of an atlas of the average anatomy as well as its variability across a population of subjects. Finally, SDMs take the 3-D nature of the underlying anatomy into account by analysing dense 3-D deformation fields rather than only information about the surface shape of anatomical structures. We show results for the construction of anatomical models of the brain from the MR images of 25 different subjects. The correspondences obtained by the nonrigid registration are evaluated using anatomical landmark locations and show an average error of 1.40 mm at these anatomical landmark positions. We also demonstrate that SDMs can be constructed so as to minimize the bias toward the chosen reference subject.     

Analysis of 3-D myocardial motion in tagged MR images using nonrigid image registration

Tagged magnetic resonance imaging (MRI) is unique in its ability to noninvasively image the motion and deformation of the heart in vivo, but one of the fundamental reasons limiting its use in the clinical environment is the absence of automated tools to derive clinically useful information from tagged MR images. In this paper, we present a novel and fully automated technique based on nonrigid image registration using multilevel free-form deformations (MFFDs) for the analysis of myocardial motion using tagged MRI. The novel aspect of our technique is its integrated nature for tag localization and deformation field reconstruction using image registration and voxel based similarity measures. To extract the motion field within the myocardium during systole we register a sequence of images taken during systole to a set of reference images taken at end-diastole, maximizing the normalized mutual information between the images. We use both short-axis and long-axis images of the heart to estimate the full four-dimensional motion field within the myocardium. We also present validation results from data acquired from twelve volunteers.     

Registration of real-time 3-D ultrasound images of the heart for novel 3-D stress echocardiography

Stress echocardiography is a routinely used clinical procedure to diagnose cardiac dysfunction by comparing wall motion information in prestress and poststress ultrasound images. Incomplete data, complicated imaging protocols and misaligned prestress and poststress views, however, are known limitations of conventional stress echocardiography. We discuss how the first two limitations are overcome via the use of real-time three-dimensional (3-D) ultrasound imaging, an emerging modality, and have called the new procedure "3-D stress echocardiography." We also show that the problem of misaligned views can be solved by registration of prestress and poststress 3-D image sequences. Such images are misaligned because of variations in placing the ultrasound transducer and stress-induced anatomical changes. We have developed a technique to temporally align 3-D images of the two sequences first and then to spatially register them to rectify probe placement error while preserving the stress-induced changes. The 3-D spatial registration is mutual information-based. Image registration used in conjunction with 3-D stress echocardiography can potentially improve the diagnostic accuracy of stress testing.     

Concurrent 3-D motion segmentation and 3-D interpretation of temporal sequences of monocular images.

The purpose of this study is to investigate a variational method for joint multiregion three-dimensional (3-D) motion segmentation and 3-D interpretation of temporal sequences of monocular images. Interpretation consists of dense recovery of 3-D structure and motion from the image sequence spatiotemporal variations due to short-range image motion. The method is direct insomuch as it does not require prior computation of image motion. It allows movement of both viewing system and multiple independently moving objects. The problem is formulated following a variational statement with a functional containing three terms. One term measures the conformity of the interpretation within each region of 3-D motion segmentation to the image sequence spatiotemporal variations. The second term is of regularization of depth. The assumption that environmental objects are rigid accounts automatically for the regularity of 3-D motion within each region of segmentation. The third and last term is for the regularity of segmentation boundaries. Minimization of the functional follows the corresponding Euler-Lagrange equations. This results in iterated concurrent computation of 3-D motion segmentation by curve evolution, depth by gradient descent, and 3-D motion by least squares within each region of segmentation. Curve evolution is implemented via level sets for topology independence and numerical stability. This algorithm and its implementation are verified on synthetic and real image sequences. Viewers presented with anaglyphs of stereoscopic images constructed from the algorithm's output reported a strong perception of depth.     

Nonrigid registration of 3-D free-hand ultrasound images of the breast

Three-dimensional (3-D) ultrasound imaging of the breast enables better assessment of diseases than conventional two-dimensional (2-D) imaging. Free-hand techniques are often used for generating 3-D data from a sequence of 2-D slice images. However, the breast deforms substantially during scanning because it is composed primarily of soft tissue. This often causes tissue mis-registration in spatial compounding of multiple scan sweeps. To overcome this problem, in this paper, instead of introducing additional constraints on scanning conditions, we use image processing techniques. We present a fully automatic algorithm for 3-D nonlinear registration of free-hand ultrasound data. It uses a block matching scheme and local statistics to estimate local tissue deformation. A Bayesian regularization method is applied to the sample displacement field. The final deformation field is obtained by fitting a B-spline approximating mesh to the sample displacement field. Registration accuracy is evaluated using phantom data and similar registration errors are achieved with (0.19 mm) and without (0.16 mm) gaps in the data. Experimental results show that registration is crucial in spatial compounding of different sweeps. The execution time of the method on moderate hardware is sufficiently fast for fairly large research studies.     

Segmentation of skin lesions in 2-D and 3-D ultrasound images using a spatially coherent generalized Rayleigh mixture model

This paper addresses the problem of jointly estimating the statistical distribution and segmenting lesions in multiple-tissue high-frequency skin ultrasound images. The distribution of multiple-tissue images is modeled as a spatially coherent finite mixture of heavy-tailed Rayleigh distributions. Spatial coherence inherent to biological tissues is modeled by enforcing local dependence between the mixture components. An original Bayesian algorithm combined with a Markov chain Monte Carlo method is then proposed to jointly estimate the mixture parameters and a label-vector associating each voxel to a tissue. More precisely, a hybrid Metropolis-within-Gibbs sampler is used to draw samples that are asymptotically distributed according to the posterior distribution of the Bayesian model. The Bayesian estimators of the model parameters are then computed from the generated samples. Simulation results are conducted on synthetic data to illustrate the performance of the proposed estimation strategy. The method is then successfully applied to the segmentation of in vivo skin tumors in high-frequency 2-D and 3-D ultrasound images.     

Reconstruction and quantification of the carotid artery bifurcation from 3-D ultrasound images

Three-dimensional (3-D) ultrasound is a relatively new technique, which is well suited to imaging superficial blood vessels, and potentially provides a useful, noninvasive method for generating anatomically realistic 3-D models of the peripheral vasculature. Such models are essential for accurate simulation of blood flow using computational fluid dynamics (CFD), but may also be used to quantify atherosclerotic plaque more comprehensively than routine clinical methods. In this paper, we present a spline-based method for reconstructing the normal and diseased carotid artery bifurcation from images acquired using a freehand 3-D ultrasound system. The vessel wall (intima-media interface) and lumen surfaces are represented by a geometric model defined using smoothing splines. Using this coupled wall-lumen model, we demonstrate how plaque may be analyzed automatically to provide a comprehensive set of quantitative measures of size and shape, including established clinical measures, such as degree of (diameter) stenosis. The geometric accuracy of 3-D ultrasound reconstruction is assessed using pulsatile phantoms of the carotid bifurcation, and we conclude by demonstrating the in vivo application of the algorithms outlined to 3-D ultrasound scans from a series of patient carotid arteries.     

Quantifying 3-D vascular structures in MRA images using hybrid PDE and geometric deformable models

The aim of this paper is to present a hybrid approach to accurate quantification of vascular structures from magnetic resonance angiography (MRA) images using level set methods and deformable geometric models constructed with 3-D Delaunay triangulation. Multiple scale filtering based on the analysis of local intensity structure using the Hessian matrix is used to effectively enhance vessel structures with various diameters. The level set method is then applied to automatically segment vessels enhanced by the filtering with a speed function derived from enhanced MRA images. Since the goal of this paper is to obtain highly accurate vessel borders, suitable for use in fluid flow simulations, in a subsequent step, the vessel surface determined by the level set method is triangulated using 3-D Delaunay triangulation and the resulting surface is used as a parametric deformable model. Energy minimization is then performed within a variational setting with a first-order internal energy; the external energy is derived from 3-D image gradients. Using the proposed method, vessels are accurately segmented from MRA data.     

Registration of 3-D images using weighted geometrical features

The authors present a weighted geometrical feature (WGF) registration algorithm. Its efficacy is demonstrated by combining points and a surface. The technique is an extension of Besl and McKay's (1992) iterative closest point (ICP) algorithm. The authors use the WGF algorithm to register X-ray computed tomography (CT) and T2-weighted magnetic resonance (MR) volume head images acquired from eleven patients that underwent craniotomies in a neurosurgical clinical trial. Each patient had five external markers attached to transcutaneous posts screwed into the outer table of the skull. The authors define registration error as the distance between positions of corresponding markers that are not used for registration. The CT and MR images are registered using fiducial paints (marker positions) only, a surface only, and various weighted combinations of points and a surface. The CT surface is derived from contours corresponding to the inner surface of the skull. The MR surface is derived from contours corresponding to the cerebrospinal fluid (CSF)-dura interface. Registration using points and a surface is found to be significantly more accurate then registration using only points or a surface     

3-D face structure extraction and recognition from images using 3-D morphing and distance mapping

We describe a novel approach for creating a three-dimensional (3-D) face structure from multiple image views of a human face taken at a priori unknown poses by appropriately morphing a generic 3-D face. A cubic explicit polynomial in 3-D is used to morph a generic face into the specific face structure. The 3-D face structure allows for accurate pose estimation as well as the synthesis of virtual images to be matched with a test image for face identification. The estimation of a 3-D person's face and pose estimation is achieved through the use of a distance map metric. This distance map residual error (geometric-based face classifier) and the image intensity residual error are fused in identifying a person in the database from one or more arbitrary image view(s). Experimental results are shown on simulated data in the presence of noise, as well as for images of real faces, and promising results are obtained.     

Quantification of thyroid volume using 3-D ultrasound imaging

Ultrasound (US) is among the most popular diagnostic techniques today. It is non-invasive, fast, comparably cheap, and does not require ionizing radiation. US is commonly used to examine the size, and structure of the thyroid gland. In clinical routine, thyroid imaging is usually performed by means of 2-D US. Conventional approaches for measuring the volume of the thyroid gland or its nodules may therefore be inaccurate due to the lack of 3-D information. This work reports a semi-automatic segmentation approach for the classification, and analysis of the thyroid gland based on 3-D US data. The images are scanned in 3-D, pre-processed, and segmented. Several pre-processing methods, and an extension of a commonly used geodesic active contour level set formulation are discussed in detail. The results obtained by this approach are compared to manual interactive segmentations by a medical expert in five representative patients. Our work proposes a novel framework for the volumetric quantification of thyroid gland lobes, which may also be expanded to other parenchymatous organs.     

用散斑照相法分析工程结构的三维形变

本文阐述了用白光散斑或激光散斑照相法分析实际工程结构的三维位移的实用技术，推导了三维位移的定量分析方程，提出了位移矢量指向的判别及剔除刚体位移的方法。由实验验证了这一理论分析，并应用此技术测试了一台精密车床主轴箱的三维热变形。     

3-D tracking and motion estimation using hierarchical Kalman filter

The authors present a novel approach to the problem of tracking and reconstructing articulated objects in 3-D space. The newly conceived computational process and its supporting data structure, the hierarchical Kalman filter (HKF) and the adaptive hierarchical structure (AHS). Allow the problem to be treated in a singlet unified framework. There are three novelties in the authors' formulation: reducing the 3-D tracking problem to 2-D tracking; incorporating the kinematic and the dynamic properties of object; and tracking nonrigid objects. To demonstrate the appropriateness of the proposed method, the authors present some of the experimental results on both synthetic and real images