Registration and real-time visualization of transcranial magnetic stimulation with 3-D MR images

This paper describes a method for registering and visualizing in real-time the results of transcranial magnetic stimulations (TMS) in physical space on the corresponding anatomical locations in MR images of the brain. The method proceeds in three main steps. First, the patient scalp is digitized in physical space with a magnetic-field digitizer, following a specific digitization pattern. Second, a registration process minimizes the mean square distance between those points and a segmented scalp surface extracted from the magnetic resonance image. Following this registration, the physician can follow the change in coil position in real-time through the visualization interface and adjust the coil position to the desired anatomical location. Third, amplitude of motor evoked potentials can be projected onto the segmented brain in order to create functional brain maps. The registration has subpixel accuracy in a study with simulated data, while we obtain a point to surface root-mean-square error of 1.17+/-0.38 mm in a 24 subject study.     

Estimating regional brain activity from evoked potential fields onthe scalp

Potential fields on the surface of the brain were estimated from discretely sampled scalp fields in human subjects. Relatively simple methods of linear algebra were combined with detailed anatomical information from magnetic resonance imaging. The method was verified using a tank model of the human head that encased a fully hydrated human skull in a polymer matrix of controlled resistivity matching that of human brain and scalp. Brain surface fields evoked by checkerboard contrast reversal spread less than their scalp field counterparts, and provided information helpful in localizing brain activity     

Automated 3-D PDM construction from segmented images using deformable models

In recent years, several methods have been proposed for constructing statistical shape models to aid image analysis tasks by providing a priori knowledge. Examples include principal component analysis of manually or semiautomatically placed corresponding landmarks on the learning shapes [point distribution models (PDMs)], which is time consuming and subjective. However, automatically establishing surface correspondences continues to be a difficult problem. This paper presents a novel method for the automated construction of three-dimensional PDM from segmented images. Corresponding surface landmarks are established by adapting a triangulated learning shape to segmented volumetric images of the remaining shapes. The adaptation is based on a novel deformable model technique. We illustrate our approach using computed tomography data of the vertebra and the femur. We demonstrate that our method accurately represents and predicts shapes.     

Twenty new digital brain phantoms for creation of validation image data bases

Simulations provide a way of generating data where ground truth is known, enabling quantitative testing of image processing methods. In this paper, we present the construction of 20 realistic digital brain phantoms that can be used to simulate medical imaging data. The phantoms are made from 20 normal adults to take into account intersubject anatomical variabilities. Each digital brain phantom was created by registering and averaging four T1, T2, and proton density (PD)-weighted magnetic resonance imaging (MRI) scans from each subject. A fuzzy minimum distance classification was used to classify voxel intensities from T1, T2, and PD average volumes into grey-matter, white matter, cerebro-spinal fluid, and fat. Automatically generated mask volumes were required to separate brain from nonbrain structures and ten fuzzy tissue volumes were created: grey matter, white matter, cerebro-spinal fluid, skull, marrow within the bone, dura, fat, tissue around the fat, muscles, and skin/muscles. A fuzzy vessel class was also obtained from the segmentation of the magnetic resonance angiography scan of the subject. These eleven fuzzy volumes that describe the spatial distribution of anatomical tissues define the digital phantom, where voxel intensity is proportional to the fraction of tissue within the voxel. These fuzzy volumes can be used to drive simulators for different modalities including MRI, PET, or SPECT. These phantoms were used to construct 20 simulated T1-weighted MR scans. To evaluate the realism of these simulations, we propose two approaches to compare them to real data acquired with the same acquisition parameters. The first approach consists of comparing the intensities within the segmented classes in both real and simulated data. In the second approach, a whole brain voxel-wise comparison between simulations and real T1-weighted data is performed. The first comparison underlines that segmented classes appear to properly represent the anatomy on average, and that inside these classes, the simulated and real intensity values are quite similar. The second comparison enables the study of the regional variations with no a priori class. The experiments demonstrate that these variations are small when real data are corrected for intensity nonuniformity.     

Sparse registration for three-dimensional stress echocardiography

Three-dimensional (3-D) stress echocardiography is a novel technique for diagnosing cardiac dysfunction. It involves evaluating wall motion of the left ventricle, by visually analyzing ultrasound images obtained in rest and in different stages of stress. Since the acquisitions are performed minutes apart, variabilities may exist in the visualized cross-sections. To improve anatomical correspondence between rest and stress, aligning the images is essential. We developed a new intensity-based, sparse registration method to retrieve standard anatomical views from 3-D stress images that were equivalent to the manually selected views in the rest images. Using sparse image planes, the influence of common image artifacts could be reduced. We investigated different similarity measures and different levels of sparsity. The registration was tested using data of 20 patients and quantitatively evaluated based on manually defined anatomical landmarks. Alignment was best using sparse registration with two long-axis and two short-axis views; registration errors were reduced significantly, to the range of interobserver variabilities. In 91% of the cases, the registration result was qualitatively assessed as better than or equal to the manual alignment. In conclusion, sparse registration improves the alignment of rest and stress images, with a performance similar to manual alignment. This is an important step towards objective quantification in 3-D stress echocardiography.      

Automated segmentation of human brain MR images aided by fuzzy information granulation and fuzzy inference

This paper proposes an automated procedure for segmenting an magnetic resonance (MR) image of a human brain based on fuzzy logic. An MR volumetric image composed of many slice images consists of several parts: gray matter, white matter, cerebrospinal fluid, and others. Generally, the histogram shapes of MR volumetric images are different from person to person. Fuzzy information granulation of the histograms can lead to a series of histogram peaks. The intensity thresholds for segmenting the whole brain of a subject are automatically determined by finding the peaks of the intensity histogram obtained from the MR images. After these thresholds are evaluated by a procedure called region growing, the whole brain can be identified. A segmentation experiment was done on 50 human brain MR volumes. A statistical analysis showed that the automated segmented volumes were similar to the volumes manually segmented by a physician. Next, we describe a procedure for decomposing the obtained whole brain into the left and right cerebral hemispheres, the cerebellum and the brain stem. Fuzzy if-then rules can represent information on the anatomical locations, segmentation boundaries as well as intensities. Evaluation of the inferred result using the region growing method can then lead to the decomposition of the whole brain. We applied this method to 44 MR volumes. The decomposed portions were statistically compared with those manually decomposed by a physician. Consequently, our method can identify the whole brain, the left cerebral hemisphere, the right cerebral hemisphere, the cerebellum and the brain stem with high accuracy and therefore can provide the three dimensional shapes of these regions.     

Quantification of small cerebral ventricular volume changes in treated growth hormone patients using nonrigid registration

Nonrigid registration can automatically quantify small changes in volume of anatomical structures over time by means of segmentation propagation. Here, we use a nonrigid registration algorithm based on optimising normalized mutual information to quantify small changes in brain ventricle volume in magnetic resonance (MR) images of a group of five patients treated with growth hormone replacement therapy and a control group of six volunteers. The lateral ventricles are segmented from each subject image by registering with the brainweb image which has this structure delineated. The mean (standard deviation) volume change measurements are 1.09 (0.73) cm3 for the patient group and 0.08 (0.62) cm3 for the volunteer group; this difference is statistically significant at the 1% level. We validate our volume measurements by determining the precision from three consecutive scans of five volunteers and also comparing the measurements to previously published volume change estimates obtained by visual inspection of difference images. Results demonstrate a precision of sigma < or = 0.52 cm3 (n = 5) and a rank correlation coefficient with assessed difference images of p = 0.7 (n = 11). To determine the level of shape correspondence we manually segmented subject's ventricles and compared them to the propagations using a voxel overlap similarity index, this gave a mean similarity index of 0.81 (n = 7).     

Differentiation of sCJD and vCJD forms by automated analysis of basal ganglia intensity distribution in multisequence MRI of the brain--definition and evaluation of new MRI-based ratios

We present a method for the analysis of basal ganglia (including the thalamus) for accurate detection of human spongiform encephalopathy in multisequence magnetic resonance imaging (MRI) of the brain. One common feature of most forms of prion protein diseases is the appearance of hyperintensities in the deep grey matter area of the brain in T2-weighted magnetic resonance (MR) images. We employ T1, T2, and Flair-T2 MR sequences for the detection of intensity deviations in the internal nuclei. First, the MR data are registered to a probabilistic atlas and normalized in intensity. Then smoothing is applied with edge enhancement. The segmentation of hyperintensities is performed using a model of the human visual system. For more accurate results, a priori anatomical data from a segmented atlas are employed to refine the registration and remove false positives. The results are robust over the patient data and in accordance with the clinical ground truth. Our method further allows the quantification of intensity distributions in basal ganglia. The caudate nuclei are highlighted as main areas of diagnosis of sporadic Creutzfeldt-Jakob Disease (sCJD), in agreement with the histological data. The algorithm permitted the classification of the intensities of abnormal signals in sCJD patient FLAIR images with a higher hypersignal in caudate nuclei (10/10) and putamen (6/10) than in thalami. Defining normalized MRI measures of the intensity relations between the internal grey nuclei of patients, we robustly differentiate sCJD and variant CJD (vCJD) patients, in an attempt to create an automatic classification tool of human spongiform encephalopathies.     

Validation of object-induced MR distortion correction for framelessstereotactic neurosurgery

Spatial fidelity is a paramount issue in image guided neurosurgery. Until recently, three-dimensional computed tomography (3D CT) has been the primary modality because it provides fast volume capture with pixel level (1 mm) accuracy. While three-dimensional magnetic resonance (3D MR) images provide superior anatomic information, published image capture protocols are time consuming and result in scanner- and object-induced magnetic field inhomogeneities which raise inaccuracy above pixel size. Using available scanner calibration software, a volumetric algorithm to correct for object-based geometric distortion, and a Fast Low Angle SHot (FLASH) 3D MR-scan protocol, the authors were able to reduce mean CT to MR skin-adhesed fiducial marker registration error from 1.36 to 1.09 mm. After dropping the worst one or two of six fiducial markers, mean registration error dropped to 0.62 mm (subpixel accuracy). Three dimensional object-induced error maps present highest 3D MR spatial infidelity at the tissue interfaces (skin/air, scalp/skull) where frameless stereotactic fiducial markers are commonly applied. The algorithm produced similar results in two patient 3D MR-scans     

Reconstruction of the human cerebral cortex from magnetic resonanceimages

Reconstructing the geometry of the human cerebral cortex from MR images is an important step in both brain mapping and surgical path planning applications. Difficulties with imaging noise, partial volume averaging, image intensity inhomogeneities, convoluted cortical structures, and the requirement to preserve anatomical topology make the development of accurate automated algorithms particularly challenging. In this paper we address each of these problems and describe a systematic method for obtaining a surface representation of the geometric central layer of the human cerebral cortex. Using fuzzy segmentation, an isosurface algorithm, and a deformable surface model, the method reconstructs the entire cortex with the correct topology, including deep convoluted sulci and gyri. The method is largely automated and its results are robust to imaging noise, partial volume averaging, and image intensity inhomogeneities. The performance of this method is demonstrated, both qualitatively and quantitatively, and the results of its application to six subjects and one simulated MR brain volume are presented.     

The need for correct realistic geometry in the inverse EEG problem

For accurate electroencephalogram-based localization of mesial temporal and frontal sources correct modeling of skull shape and thickness is required. In a simulation study in which results for matched sets of computed tomography and magnetic resonance (MR) images are compared, it is found that errors arising from skull models based on smooth and inflated segmented MR images of the cortex are of the order of 1 cm. These errors are comparable to those found when overestimating or underestimating skull conductivity by a factor of two.     

Modelling prostate motion for data fusion during image-guided interventions

There is growing clinical demand for image registration techniques that allow multimodal data fusion for accurate targeting of needle biopsy and ablative prostate cancer treatments. However, during procedures where transrectal ultrasound (TRUS) guidance is used, substantial gland deformation can occur due to TRUS probe pressure. In this paper, the ability of a statistical shape/motion model, trained using finite element simulations, to predict and compensate for this source of motion is investigated. Three-dimensional ultrasound images acquired on five patient prostates, before and after TRUS-probe-induced deformation, were registered using a nonrigid, surface-based method, and the accuracy of different deformation models compared. Registration using a statistical motion model was found to outperform alternative elastic deformation methods in terms of accuracy and robustness, and required substantially fewer target surface points to achieve a successful registration. The mean final target registration error (based on anatomical landmarks) using this method was 1.8 mm. We conclude that a statistical model of prostate deformation provides an accurate, rapid and robust means of predicting prostate deformation from sparse surface data, and is therefore well-suited to a number of interventional applications where there is a need for deformation compensation.     

Parameter distribution models for estimation of population based left ventricular deformation using sparse fiducial markers

We present a method to estimate left ventricular (LV) motion based on three-dimensional (3-D) images that can be derived from any anatomical tomographic or 3-D modality, such as echocardiography, computed tomography, or magnetic resonance imaging. A finite element mesh of the LV was constructed to fit the geometry of the wall. The mesh was deformed by optimizing the nodal parameters to the motion of a sparse number of fiducial markers that were manually tracked in the images through the cardiac cycle. A parameter distribution model (PDM) of LV deformations was obtained from a database of MR tagging studies. This was used to filter the calculated deformation and incorporate a priori information on likely motions. The estimated deformation obtained from 13 normal untagged studies was compared with the deformation obtained from MR tagging. The end systolic (ES) circumferential and longitudinal strain values matched well with a mean difference of 0.1 +/- 3.2% and 0.3 +/- 3.0%, respectively. The calculated apex-base twist angle at ES had a mean difference of 1.0 +/- 2.3 degrees. We conclude that fiducial marker fitting in conjunction with a PDM provides accurate reconstruction of LV deformation in normal subjects.     

磁共振辅助的近红外扩散光学断层成像

将大脑磁共振T1加权像分割为头皮、头骨、脑脊液、灰质和白质,并生成分层体网格.利用具有大脑解剖结构信息的分层体网格建立近红外扩散光学断层成像前向光学模型和实现功能重建,可以避免目前所使用的半球头模或图谱头模空间定位不准的问题,解决图像重建过程中所解方程的欠定性和病态性.在棋盘格旋转视觉刺激及扩张视觉刺激实验中,基于磁共振图像的扩散光学断层成像重建的含氧血红蛋白图像具有更高的空间分辨率及定位精度.     

Registration of 3-D images using weighted geometrical features

The authors present a weighted geometrical feature (WGF) registration algorithm. Its efficacy is demonstrated by combining points and a surface. The technique is an extension of Besl and McKay's (1992) iterative closest point (ICP) algorithm. The authors use the WGF algorithm to register X-ray computed tomography (CT) and T2-weighted magnetic resonance (MR) volume head images acquired from eleven patients that underwent craniotomies in a neurosurgical clinical trial. Each patient had five external markers attached to transcutaneous posts screwed into the outer table of the skull. The authors define registration error as the distance between positions of corresponding markers that are not used for registration. The CT and MR images are registered using fiducial paints (marker positions) only, a surface only, and various weighted combinations of points and a surface. The CT surface is derived from contours corresponding to the inner surface of the skull. The MR surface is derived from contours corresponding to the cerebrospinal fluid (CSF)-dura interface. Registration using points and a surface is found to be significantly more accurate then registration using only points or a surface     

A Surface Registration Method for Quantification of Intraoperative Brain Deformations in Image-Guided Neurosurgery

Intraoperative brain deformations decrease accuracy in image-guided neurosurgery. Approaches to quantify these deformations based on 3-D reconstruction of cortectomy surfaces have been described and have shown promising results regarding the extrapolation to the whole brain volume using additional prior knowledge or sparse volume modalities. Quantification of brain deformations from surface measurement requires the registration of surfaces at different times along the surgical procedure, with different challenges according to the patient and surgical step. In this paper, we propose a new flexible surface registration approach for any textured point cloud computed by stereoscopic or laser range approach. This method includes three terms: the first term is related to image intensities, the second to Euclidean distance, and the third to anatomical landmarks automatically extracted and continuously tracked in the 2-D video flow. Performance evaluation was performed on both phantom and clinical cases. The global method, including textured point cloud reconstruction, had accuracy within 2 mm, which is the usual rigid registration error of neuronavigation systems before deformations. Its main advantage is to consider all the available data, including the microscope video flow with higher temporal resolution than previously published methods.      

Multimodality Image Registration Using Spatial Procrustes Analysis and Modified Conditional Entropy

In this paper, we propose a new image registration technique using two kinds of information known as object shapes and voxel intensities. The proposed approach consists of two registration steps. First, an initial registration is carried out for two volume images by applying Procrustes analysis theory to the two sets of 3D feature points representing object shapes. During this first stage, a volume image is segmented by using a geometric deformable model. Then, 3D feature points are extracted from the boundary of a segmented object. We conduct an initial registration by applying Procrustes analysis theory with two sets of 3D feature points. Second, a fine registration is followed by using a new measure based on the entropy of conditional probabilities. Here, to achieve the final registration, we define a modified conditional entropy (MCE) computed from the joint histograms for voxel intensities of two given volume images. By using a two step registration method, we can improve the registration precision. To evaluate the performance of the proposed registration method, we conduct various experiments for our method as well as existing methods based on the mutual information (MI) and maximum likelihood (ML) criteria. We evaluate the precision of MI, ML and MCE-based measurements by comparing their registration traces obtained from magnetic resonance (MR) images and transformed computed tomography (CT) images with respect to x-translation and rotation. The experimental results show that our method has great potential for the registration of a variety of medical images.     

Automatic construction of 3-D statistical deformation models of the brain using nonrigid registration

In this paper, we show how the concept of statistical deformation models (SDMs) can be used for the construction of average models of the anatomy and their variability. SDMs are built by performing a statistical analysis of the deformations required to map anatomical features in one subject into the corresponding features in another subject. The concept of SDMs is similar to statistical shape models (SSMs) which capture statistical information about shapes across a population, but offers several advantages over SSMs. First, SDMs can be constructed directly from images such as three-dimensional (3-D) magnetic resonance (MR) or computer tomography volumes without the need for segmentation which is usually a prerequisite for the construction of SSMs. Instead, a nonrigid registration algorithm based on free-form deformations and normalized mutual information is used to compute the deformations required to establish dense correspondences between the reference subject and the subjects in the population class under investigation. Second, SDMs allow the construction of an atlas of the average anatomy as well as its variability across a population of subjects. Finally, SDMs take the 3-D nature of the underlying anatomy into account by analysing dense 3-D deformation fields rather than only information about the surface shape of anatomical structures. We show results for the construction of anatomical models of the brain from the MR images of 25 different subjects. The correspondences obtained by the nonrigid registration are evaluated using anatomical landmark locations and show an average error of 1.40 mm at these anatomical landmark positions. We also demonstrate that SDMs can be constructed so as to minimize the bias toward the chosen reference subject.     

Method to reduce blur distortion from EEG's using a realistic headmodel

A mathematical procedure, called deblurring, was developed to reduce spatial blur distortion of scalp-recorded brain potentials due to transmission through the skull and other tissues. Deblurring estimates potentials at the superficial cerebral cortical surface from EEGs recorded at the scalp using a finite-element model of each subject's scalp, skull, and cortical surface constructed from their magnetic resonance images (MRIs). Simulations indicate that deblurring is numerically stable, and a comparison of deblurred data with a direct cortical recording from a neurosurgery patient suggests that the procedure is valid. Application of deblurring to somatosensory evoked potential data recorded at 124 scalp sites suggests that the method greatly improves spatial detail and merits further development     

Expectation maximization reconstruction of positron emissiontomography images using anatomical magnetic resonance information

Using statistical methods the reconstruction of positron emission tomography (PET) images can be improved by high-resolution anatomical information obtained from magnetic resonance (MR) images. The authors implemented two approaches that utilize MR data for PET reconstruction. The anatomical MR information is modeled as a priori distribution of the PET image and combined with the distribution of the measured PET data to generate the a posteriori function from which the expectation maximization (EM)-type algorithm with a maximum a posteriori (MAP) estimator is derived. One algorithm (Markov-GEM) uses a Gibbs function to model interactions between neighboring pixels within the anatomical regions. The other (Gauss-EM) applies a Gauss function with the same mean for all pixels in a given anatomical region. A basic assumption of these methods is that the radioactivity is homogeneously distributed inside anatomical regions. Simulated and phantom data are investigated under the following aspects: count density, object size, missing anatomical information, and misregistration of the anatomical information. Compared with the maximum likelihood-expectation maximization (ML-EM) algorithm the results of both algorithms show a large reduction of noise with a better delineation of borders. Of the two algorithms tested, the Gauss-EM method is superior in noise reduction (up to 50%). Regarding incorrect a priori information the Gauss-EM algorithm is very sensitive, whereas the Markov-GEM algorithm proved to be stable with a small change of recovery coefficients between 0.5 and 3%