Phenomenological model of diffuse global and regional atrophy using finite-element methods

The main goal of this work is the generation of ground-truth data for the validation of atrophy measurement techniques, commonly used in the study of neurodegenerative diseases such as dementia. Several techniques have been used to measure atrophy in cross-sectional and longitudinal studies, but it is extremely difficult to compare their performance since they have been applied to different patient populations. Furthermore, assessment of performance based on phantom measurements or simple scaled images overestimates these techniques' ability to capture the complexity of neurodegeneration of the human brain. We propose a method for atrophy simulation in structural magnetic resonance (MR) images based on finite-element methods. The method produces cohorts of brain images with known change that is physically and clinically plausible, providing data for objective evaluation of atrophy measurement techniques. Atrophy is simulated in different tissue compartments or in different neuroanatomical structures with a phenomenological model. This model of diffuse global and regional atrophy is based on volumetric measurements such as the brain or the hippocampus, from patients with known disease and guided by clinical knowledge of the relative pathological involvement of regions and tissues. The consequent biomechanical readjustment of structures is modelled using conventional physics-based techniques based on biomechanical tissue properties and simulating plausible tissue deformations with finite-element methods. A thermoelastic model of tissue deformation is employed, controlling the rate of progression of atrophy by means of a set of thermal coefficients, each one corresponding to a different type of tissue. Tissue characterization is performed by means of the meshing of a labelled brain atlas, creating a reference volumetric mesh that will be introduced to a finite-element solver to create the simulated deformations. Preliminary work on the simulation of acquisition artefacts is also presented. Cross-sectional and longitudinal sets of simulated data are shown and a visual classification protocol has been used by experts to rate real and simulated scans according to their degree of atrophy. Results confirm the potential of the proposed methodology.     

Deformation analysis to detect and quantify active lesions inthree-dimensional medical image sequences

Evaluating precisely the temporal variations of lesion volumes is very important for at least three types of practical applications: pharmaceutical trials, decision making for drug treatment or surgery, and patient follow-up. In this paper we present a volumetric analysis technique, combining precise rigid registration of three-dimensional (3-D) (volumetric) medical images, nonrigid deformation computation, and flow-field analysis. Our analysis technique has two outcomes: the detection of evolving lesions and the quantitative measurement of volume variations. The originality of our approach is that no precise segmentation of the lesion is needed but the approximative designation of a region of interest (ROI) which can be automated. We distinguish between tissue transformation (image intensity changes without deformation) and expansion or contraction effects reflecting a change of mass within the tissue. A real lesion is generally the combination of both effects. The method is tested with synthesized volumetric image sequences and applied, in a first attempt to quantify in vivo a mass effect, to the analysis of a real patient case with multiple sclerosis (MS).     

Deformation-based mapping of volume change from serial brain MRI in the presence of local tissue contrast change

This paper is motivated by the analysis of serial structural magnetic resonance imaging (MRI) data of the brain to map patterns of local tissue volume loss or gain over time, using registration-based deformation tensor morphometry. Specifically, we address the important confound of local tissue contrast changes which can be induced by neurodegenerative or neurodevelopmental processes. These not only modify apparent tissue volume, but also modify tissue integrity and its resulting MRI contrast parameters. In order to address this confound we derive an approach to the voxel-wise optimization of regional mutual information (RMI) and use this to drive a viscous fluid deformation model between images in a symmetric registration process. A quantitative evaluation of the method when compared to earlier approaches is included using both synthetic data and clinical imaging data. Results show a significant reduction in errors when tissue contrast changes locally between acquisitions. Finally, examples of applying the technique to map different patterns of atrophy rate in different neurodegenerative conditions is included.     

Three-dimensional anatomical model-based segmentation of MR brainimages through principal axes registration

Model-based segmentation and analysis of brain images depends on anatomical knowledge which may be derived from conventional atlases. Classical anatomical atlases are based on the rigid spatial distribution provided by a single cadaver. Their use to segment internal anatomical brain structures in a high-resolution MR brain image does not provide any knowledge about the subject variability, and therefore they are not very efficient in analysis. The authors present a method to develop three-dimensional computerized composite models of brain structures to build a computerized anatomical atlas. The composite models are developed using the real MR brain images of human subjects which are registered through the principal axes transformation. The composite models provide probabilistic spatial distributions, which represent the variability of brain structures and can be easily updated for additional subjects. The authors demonstrate the use of such a composite model of ventricular structure to help segmentation of the ventricles and cerebrospinal fluid of MR brain images. Here, a composite model of ventricles using a set of 22 human subjects is developed and used in a model-based segmentation of ventricles, sulci, and white matter lesions. To illustrate the clinical usefulness, automatic volumetric measurements on ventricular size and cortical atrophy for an additional eight alcoholics and 10 normal subjects were made. The volumetric quantitative results indicated regional brain atrophy in chronic alcoholics     

Volumetric intraoperative brain deformation compensation: model development and phantom validation

During neurosurgery, nonrigid brain deformation may affect the reliability of tissue localization based on preoperative images. To provide accurate surgical guidance in these cases, preoperative images must be updated to reflect the intraoperative brain. This can be accomplished by warping these preoperative images using a biomechanical model. Due to the possible complexity of this deformation, intraoperative information is often required to guide the model solution. In this paper, a linear elastic model of the brain is developed to infer volumetric brain deformation associated with measured intraoperative cortical surface displacement. The developed model relies on known material properties of brain tissue, and does not require further knowledge about intraoperative conditions. To provide an initial estimation of volumetric model accuracy, as well as determine the model's sensitivity to the specified material parameters and surface displacements, a realistic brain phantom was developed. Phantom results indicate that the linear elastic model significantly reduced localization error due to brain shift, from > 16 mm to under 5 mm, on average. In addition, though in vivo quantitative validation is necessary, preliminary application of this approach to images acquired during neocortical epilepsy cases confirms the feasibility of applying the developed model to in vivo data.     

HAMMER: hierarchical attribute matching mechanism for elastic registration

A new approach is presented for elastic registration of medical images, and is applied to magnetic resonance images of the brain. Experimental results demonstrate very high accuracy in superposition of images from different subjects. There are two major novelties in the proposed algorithm. First, it uses an attribute vector, i.e., a set of geometric moment invariants (GMIs) that are defined on each voxel in an image and are calculated from the tissue maps, to reflect the underlying anatomy at different scales. The attribute vector, if rich enough, can distinguish between different parts of an image, which helps establish anatomical correspondences in the deformation procedure; it also helps reduce local minima, by reducing ambiguity in potential matches. This is a fundamental deviation of our method, referred to as the hierarchical attribute matching mechanism for elastic registration (HAMMER), from other volumetric deformation methods, which are typically based on maximizing image similarity. Second, in order to avoid being trapped by local minima, i.e., suboptimal poor matches, HAMMER uses a successive approximation of the energy function being optimized by lower dimensional smooth energy functions, which are constructed to have significantly fewer local minima. This is achieved by hierarchically selecting the driving features that have distinct attribute vectors, thus, drastically reducing ambiguity in finding correspondence. A number of experiments demonstrate that the proposed algorithm results in accurate superposition of image data from individuals with significant anatomical differences.     

B-Mode Ultrasound Image Simulation in Deformable 3-D Medium

This paper presents an algorithm for fast image synthesis inside deformed volumes. Given the node displacements of a mesh and a reference 3-D image dataset of a predeformed volume, the method first maps the image pixels that need to be synthesized from the deformed configuration to the nominal predeformed configuration, where the pixel intensities are obtained easily through interpolation in the regular-grid structure of the reference voxel volume. This mapping requires the identification of the mesh element enclosing each pixel for every image frame. To accelerate this point location operation, a fast method of projecting the deformed mesh on image pixels is introduced in this paper. The method presented was implemented for ultrasound B-mode image simulation of a synthetic tissue phantom. The phantom deformation as a result of ultrasound probe motion was modeled using the finite element method. Experimental images of the phantom under deformation were then compared with the corresponding synthesized images using sum of squared differences and mutual information metrics. Both this quantitative comparison and a qualitative assessment show that realistic images can be synthesized using the proposed technique. An ultrasound examination system was also implemented to demonstrate that real-time image synthesis with the proposed technique can be successfully integrated into a haptic simulation.      

JP3D compressed-domain watermarking of still and volumetric medical images

Digital watermarking can be used as data hiding technique to interleave medical images with patient information before transmitting and storing applications. While digital image watermarking and lossy compression methods have been widely studied, much less attention has been paid to their application in medical imaging situations, due partially to speculations on loss in viewer performance caused by degradation of image information. This article describes an hybrid data hiding/compression system, adapted to medical imaging. The central contribution is to integrate blind watermarking, based on turbo trellis-coded quantization, to JP3D encoder. The latter meets conformity condition, with respect to its antecedents JPEG2000 coders. Thus, the watermark embedding can be applied on two-dimensional as well as volumetric images. Results of our method applied to magnetic resonance and computed tomography medical images have shown that our watermarking scheme is robust to JP3D compression attacks and can provide relative high data embedding rate whereas keep a relative lower distortion.     

Clinical evaluation of respiratory motion compensation for anatomical roadmap guided cardiac electrophysiology procedures

X-ray fluoroscopically guided cardiac electrophysiological procedures are routinely carried out for diagnosis and treatment of cardiac arrhythmias. X-ray images have poor soft tissue contrast and, for this reason, overlay of static 3-D roadmaps derived from preprocedural volumetric data can be used to add anatomical information. However, the registration between the 3-D roadmap and the 2-D X-ray image can be compromised by patient respiratory motion. Three methods were designed and evaluated to correct for respiratory motion using features in the 2-D X-ray images. The first method is based on tracking either the diaphragm or the heart border using the image intensity in a region of interest. The second method detects the tracheal bifurcation using the generalized Hough transform and a 3-D model derived from 3-D preoperative volumetric data. The third method is based on tracking the coronary sinus (CS) catheter. This method uses blob detection to find all possible catheter electrodes in the X-ray image. A cost function is applied to select one CS catheter from all catheter-like objects. All three methods were applied to X-ray images from 18 patients undergoing radiofrequency ablation for the treatment of atrial fibrillation. The 2-D target registration errors (TRE) at the pulmonary veins were calculated to validate the methods. A TRE of 1.6 mm ± 0.8 mm was achieved for the diaphragm tracking; 1.7 mm ± 0.9 mm for heart border tracking, 1.9 mm ± 1.0 mm for trachea tracking, and 1.8 mm ± 0.9 mm for CS catheter tracking. We present a comprehensive comparison between the techniques in terms of robustness, as computed by tracking errors, and accuracy, as computed by TRE using two independent approaches.     

In vivo quantification of retraction deformation modeling for updated image-guidance during neurosurgery

The use of coregistered preoperative anatomical scans to provide navigational information in the operating room has greatly benefited the field of neurosurgery. Nonetheless, it has been widely acknowledged that significant errors between the operating field and the preoperative images are generated as surgery progresses. Quantification of tissue shift can be accomplished with volumetric intraoperative imaging; however, more functional, lower cost alternative solutions to this challenge are desirable. We are developing the strategy of exploiting a computational model driven by sparse data obtained from intraoperative ultrasound and cortical surface tracking to warp preoperative images to reflect the current state of the operating field. This paper presents an initial quantification of the predictive capability of the current model to computationally capture tissue deformation during retraction in the porcine brain. Performance validation is achieved through comparisons of displacement and pressure predictions to experimental measurements obtained from computed tomographic images and pressure sensor recordings. Group results are based upon a generalized set of boundary conditions for four subjects that, on average, account for at least 75% of tissue motion generated during interhemispheric retraction. Individualized boundary conditions can improve the degree of data-model match by 10% or more but warrant further study. Overall, the level of quantitative agreement achieved in these experiments is encouraging for updating preoperative images to reflect tissue deformation resulting from retraction, especially since model improvements are likely as a result of the intraoperative constraints that can be applied through sparse data collection.     

Accounting for signal loss due to dephasing in the correction of distortions in gradient-echo EPI via nonrigid registration

Gradient-echo (GE) echo planar imaging (EPI) is susceptible to both geometric distortions and signal loss. This paper presents a retrospective correction approach based on nonrigid image registration. A new physics-based intensity correction factor derived to compensate for intravoxel dephasing in GE EPI images is incorporated into a previously reported nonrigid registration algorithm. Intravoxel dephasing causes signal loss and thus intensity attenuation in the images. The new rephasing factor we introduce, which changes the intensity of a voxel in images during the registration, is used to improve the accuracy of the intensity-based nonrigid registration method and mitigate the intensity attenuation effect. Simulation-based experiments are first used to evaluate the method. A magnetic resonance (MR) simulator and a real field map are used to generate a realistic GE EPI image. The geometric distortion computed from the field map is used as the ground truth to which the estimated nonrigid deformation is compared. We then apply the algorithm to a set of real human brain images. The results show that, after registration, alignment between EPI and multi-shot, spin-echo images, which have relatively long acquisition times but negligible distortion, is improved and that signal loss caused by dephasing can be recovered.     

乳腺DCE-MRI增强场时间序列和组织形变场的联合估计

乳腺DCE-MRI扫描过程中,病人运动等会使图像序列产生运动伪影,需要对DCE-MRI时间序列图像进行运动补偿,消除运动伪影的影响.为充分利用数据信息和增强在空间和时间上的先验信息,本文提出了联合估计增强场时间序列和组织形变场的贝叶斯框架.采用离散马尔科夫随机场模型分别对增强场时间序列和组织形变场进行建模和添加平滑约束,并通过分步迭代方式进行估计.利用估计的增强场对DCE-MRI时间序列图像进行“去增强”处理后,可将增强时间序列图像视为同一模态图像进行配准.实验结果表明,本文方法可准确估计增强场时间序列,并可达到较高的配准精度.     

Scalable user-friendly image sharing

Image sharing addresses a fault-tolerant protection mechanism for important images. In a typical image sharing scheme, the generated shadow images usually have a noise-like appearance that conceals the secret image completely, but this makes them difficult to identify and manage. This paper proposes a scalable user-friendly image sharing scheme in which each generated shadow image looks like a shrunken replica of the original image. The scheme provides an easy-to-identify interface for managing the shadow images. Compared with previous user-friendly image sharing schemes, the proposed method can reconstruct the original image without any loss and still has the small-size shadow images. A notable feature is that the qualities of generated shadow images are scalable in the proposed scheme, which allows the quality of the shadow images to be adjusted according to the requirements of diverse applications.     

Young's Modulus Reconstruction for Radio-Frequency Ablation Electrode-Induced Displacement Fields: A Feasibility Study

Radio-frequency (RF) ablation is a minimally invasive treatment for tumors in various abdominal organs. It is effective if good tumor localization and intraprocedural monitoring can be done. In this paper, we investigate the feasibility of using an ultrasound-based Young's modulus reconstruction algorithm to image an ablated region whose stiffness is elevated due to tissue coagulation. To obtain controllable tissue deformations for abdominal organs during and/or intermediately after the RF ablation, the proposed modulus imaging method is specifically designed for using tissue deformation fields induced by the RF electrode. We have developed a new scheme under which the reconstruction problem is simplified to a 2-D problem. Based on this scheme, an iterative Young's modulus reconstruction technique with edge-preserving regularization was developed to estimate the Young's modulus distribution. The method was tested in experiments using a tissue-mimicking phantom and on ex vivo bovine liver tissues. Our preliminary results suggest that high contrast modulus images can be successfully reconstructed. In both experiments, the geometries of the reconstructed modulus images of thermal ablation zones match well with the phantom design and the gross pathology image, respectively.      

Segmentation of ultrasound B-mode images with intensity inhomogeneity correction

Displayed ultrasound (US) B-mode images often exhibit tissue intensity inhomogeneities dominated by nonuniform beam attenuation within the body. This is a major problem for intensity-based, automatic segmentation of video-intensity images because conventional threshold-based or intensity-statistic-based approaches do not work well in the presence of such image distortions. Time gain compensation (TGC) is typically used in standard US machines in an attempt to overcome this. However this compensation method is position-dependent which means that different tissues in the same TGC time-range (or corresponding depth range) will be, incorrectly, compensated by the same amount. Compensation should really be tissue-type dependent but automating this step is difficult. The main contribution of this paper is to develop a method for simultaneous estimation of video-intensity inhomogeities and segmentation of US image tissue regions. The method uses a combination of the maximum a posteriori (MAP) and Markov random field (MRF) methods to estimate the US image distortion field assuming it follows a multiplicative model while at the same time labeling image regions based on the corrected intensity statistics. The MAP step is used to estimate the intensity model parameters while the MRF step provides a novel way of incorporating the distributions of image tissue classes as a spatial smoothness constraint. We explain how this multiplicative model can be related to the ultrasonic physics of image formation to justify our approach. Experiments are presented on synthetic images and a gelatin phantom to evaluate quantitatively the accuracy of the method. We also discuss qualitatively the application of the method to clinical breast and cardiac US images. Limitations of the method and potential clinical applications are outlined in the conclusion.     

Simultaneous multi-scale registration using large deformation diffeomorphic metric mapping

In the framework of large deformation diffeomorphic metric mapping (LDDMM), we present a practical methodology to integrate prior knowledge about the registered shapes in the regularizing metric. Our goal is to perform rich anatomical shape comparisons from volumetric images with the mathematical properties offered by the LDDMM framework. We first present the notion of characteristic scale at which image features are deformed. We then propose a methodology to compare anatomical shape variations in a multi-scale fashion, i.e., at several characteristic scales simultaneously. In this context, we propose a strategy to quantitatively measure the feature differences observed at each characteristic scale separately. After describing our methodology, we illustrate the performance of the method on phantom data. We then compare the ability of our method to segregate a group of subjects having Alzheimer's disease and a group of controls with a classical coarse to fine approach, on standard 3D MR longitudinal brain images. We finally apply the approach to quantify the anatomical development of the human brain from 3D MR longitudinal images of pre-term babies. Results show that our method registers accurately volumetric images containing feature differences at several scales simultaneously with smooth deformations.     

一种基于多小波变换的医学图像融合方法

本文讨论了医学图像CT与NMR的融合问题。由于骨骼组织仅能在CT中清晰显示,而软组织仅能在NMR中清晰显示,所以CT与NMR图像各自都不能同时清晰显示骨骼组织和软组织。在分析了CT与NMR图像成像机理的基础上,提出了一种基于多小波变换的融合方法。它可将CT与NMR图像进行有效的综合。所获得的融合图像,可同时清晰地显示骨组织和软组织信息。     

Incremental variations of image moments for nonlinear image registration

In this paper, we use image moments to solve the problem of estimating deformation fields given a pair of images as input. We use a single family of polynomials to parameterize the deformation field and to define image moments. In this way, variations in image moments can be represented by a set of linear equations. We solve these equations iteratively for the deformation parameters between two shapes. Our approach improves existing moment-based registration methods in both robustness to noise and convergence rate. In addition, our method does not rely on solving the correspondence problem. We have extensively tested our new method on both synthetically deformed MPEG-7 shapes and real-world biomedical images.     

Validation of nonrigid image registration using finite-element methods: application to breast MR images

This paper presents a novel method for validation of nonrigid medical image registration. This method is based on the simulation of physically plausible, biomechanical tissue deformations using finite-element methods. Applying a range of displacements to finite-element models of different patient anatomies generates model solutions which simulate gold standard deformations. From these solutions, deformed images are generated with a range of deformations typical of those likely to occur in vivo. The registration accuracy with respect to the finite-element simulations is quantified by co-registering the deformed images with the original images and comparing the recovered voxel displacements with the biomechanically simulated ones. The functionality of the validation method is demonstrated for a previously described nonrigid image registration technique based on free-form deformations using B-splines and normalized mutual information as a voxel similarity measure, with an application to contrast-enhanced magnetic resonance mammography image pairs. The exemplar nonrigid registration technique is shown to be of subvoxel accuracy on average for this particular application. The validation method presented here is an important step toward more generic simulations of biomechanically plausible tissue deformations and quantification of tissue motion recovery using nonrigid image registration. It will provide a basis for improving and comparing different nonrigid registration techniques for a diversity of medical applications, such as intrasubject tissue deformation or motion correction in the brain, liver or heart.     

Estimation of 3-D left ventricular deformation from medical images using biomechanical models

The quantitative estimation of regional cardiac deformation from three-dimensional (3-D) image sequences has important clinical implications for the assessment of viability in the heart wall. We present here a generic methodology for estimating soft tissue deformation which integrates image-derived information with biomechanical models, and apply it to the problem of cardiac deformation estimation. The method is image modality independent. The images are segmented interactively and then initial correspondence is established using a shape-tracking approach. A dense motion field is then estimated using a transversely isotropic, linear-elastic model, which accounts for the muscle fiber directions in the left ventricle. The dense motion field is in turn used to calculate the deformation of the heart wall in terms of strain in cardiac specific directions. The strains obtained using this approach in open-chest dogs before and after coronary occlusion, exhibit a high correlation with strains produced in the same animals using implanted markers. Further, they show good agreement with previously published results in the literature. This proposed method provides quantitative regional 3-D estimates of heart deformation.