Alignment of sparse freehand 3-D ultrasound with preoperative images of the liver using models of respiratory motion and deformation

We present a method for alignment of an interventional plan to optically tracked two-dimensional intraoperative ultrasound (US) images of the liver. Our clinical motivation is to enable the accurate transfer of information from three-dimensional preoperative imaging modalities [magnetic resonance (MR) or computed tomography (CT)] to intraoperative US to aid needle placement for thermal ablation of liver metastases. An initial rigid registration to intraoperative coordinates is obtained using a set of US images acquired at maximum exhalation. A preprocessing step is applied to both the preoperative images and the US images to produce evidence of corresponding structures. This yields two sets of images representing classification of regions as vessels. The registration then proceeds using these images. The preoperative images and plan are then warped to correspond to a single US slice acquired at an unknown point in the breathing cycle where the liver is likely to have moved and deformed relative to the preoperative image. Alignment is constrained using a patient-specific model of breathing motion and deformation. Target registration error is estimated by carrying out simulation experiments using resliced MR volumes to simulate real US and comparing the registration results to a "bronze-standard" registration performed on the full MR volume. Finally, the system is tested using real US and verified using visual inspection.     

Registration of head volume images using implantable fiducialmarkers

Describes an extrinsic-point-based, interactive image-guided neurosurgical system designed at Vanderbilt University, Nashville, TN, as part of a collaborative effort among the Departments of Neurological Surgery, Computer Science, and Biomedical Engineering. Multimodal image-to-image (II) and image-to-physical (IP) registration is accomplished using implantable markers. Physical space tracking is accomplished with optical triangulation. The authors investigate the theoretical accuracy of point-based registration using numerical simulations, the experimental accuracy of their system using data obtained with a phantom, and the clinical accuracy of their system using data acquired in a prospective clinical trial by 6 neurosurgeons at 4 medical centers from 158 patients undergoing craniotomies to respect cerebral lesions. The authors can determine the position of their markers with an error of approximately 0.4 mm in X-ray computed tomography (CT) and magnetic resonance (MR) images and 0.3 mm in physical space. The theoretical registration error using 4 such markers distributed around the head in a configuration that is clinically practical is approximately 0.5-0.6 mm. The mean CT-physical registration error for the: phantom experiments is 0.5 mm and for the clinical data obtained with rigid head fixation during scanning is 0.7 mm. The mean CT-MR registration error for the clinical data obtained without rigid head fixation during scanning is 1.4 mm, which is the highest mean error that the authors observed. These theoretical and experimental findings indicate that this system is an accurate navigational aid that can provide real-time feedback to the surgeon about anatomical structures encountered in the surgical field     

Surface-based registration of CT images to physical space forimage-guided surgery of the spine: a sensitivity study

This paper presents a method designed to register preoperative computed tomography (CT) images to vertebral surface points acquired intraoperatively from ultrasound (US) images or via a tracked probe. It also presents a comparison of the registration accuracy achievable with surface points acquired from the entire posterior surface of the vertebra to the accuracy achievable with points acquired only from the spinous process and central laminar regions. Using a marker-based method as a reference, this work shows that submillimetric registration accuracy can be obtained even when a small portion of the posterior vertebral surface is used for registration. It also shows that when selected surface patches are used, CT slice thickness is not a critical parameter in the registration process. Furthermore, the paper includes qualitative results of registering vertebral surface points in US images to multiple CT slices. The method has been tested with US points and physical points on a plastic spine phantom and with simulated data on a patient CT scan     

Cortical surface registration for image-guided neurosurgery using laser-range scanning

In this paper, a method of acquiring intraoperative data using a laser range scanner (LRS) is presented within the context of model-updated image-guided surgery. Registering textured point clouds generated by the LRS to tomographic data is explored using established point-based and surface techniques as well as a novel method that incorporates geometry and intensity information via mutual information (SurfaceMI). Phantom registration studies were performed to examine accuracy and robustness for each framework. In addition, an in vivo registration is performed to demonstrate feasibility of the data acquisition system in the operating room. Results indicate that SurfaceMI performed better in many cases than point-based (PBR) and iterative closest point (ICP) methods for registration of textured point clouds. Mean target registration error (TRE) for simulated deep tissue targets in a phantom were 1.0 +/- 0.2, 2.0 +/- 0.3, and 1.2 +/- 0.3 mm for PBR, ICP, and SurfaceMI, respectively. With regard to in vivo registration, the mean TRE of vessel contour points for each framework was 1.9 +/- 1.0, 0.9 +/- 0.6, and 1.3 +/- 0.5 for PBR, ICP, and SurfaceMI, respectively. The methods discussed in this paper in conjunction with the quantitative data provide impetus for using LRS technology within the model-updated image-guided surgery framework.     

Volumetric intraoperative brain deformation compensation: model development and phantom validation

During neurosurgery, nonrigid brain deformation may affect the reliability of tissue localization based on preoperative images. To provide accurate surgical guidance in these cases, preoperative images must be updated to reflect the intraoperative brain. This can be accomplished by warping these preoperative images using a biomechanical model. Due to the possible complexity of this deformation, intraoperative information is often required to guide the model solution. In this paper, a linear elastic model of the brain is developed to infer volumetric brain deformation associated with measured intraoperative cortical surface displacement. The developed model relies on known material properties of brain tissue, and does not require further knowledge about intraoperative conditions. To provide an initial estimation of volumetric model accuracy, as well as determine the model's sensitivity to the specified material parameters and surface displacements, a realistic brain phantom was developed. Phantom results indicate that the linear elastic model significantly reduced localization error due to brain shift, from > 16 mm to under 5 mm, on average. In addition, though in vivo quantitative validation is necessary, preliminary application of this approach to images acquired during neocortical epilepsy cases confirms the feasibility of applying the developed model to in vivo data.     

In vivo quantification of a homogeneous brain deformation model for updating preoperative images during surgery

Clinicians using image-guidance for neurosurgical procedures have recently recognized that intraoperative deformation from surgical loading can compromise the accuracy of patient registration in the operating room. While whole brain intraoperative imaging is conceptually appealing it presents significant practical limitations. Alternatively, a promising approach may be to combine incomplete intraoperatively acquired data with a computational model of brain deformation to update high resolution preoperative images during surgery. The success of such an approach is critically dependent on identifying a valid model of brain deformation physics. Towards this end, we evaluate a three-dimensional finite element consolidation theory model for predicting brain deformation in vivo through a series of controlled repeat-experiments. This database is used to construct an interstitial pressure boundary condition calibration curve which is prospectively tested in a fourth validation experiment. The computational model is found to recover 75%-85% of brain motion occurring under loads comparable to clinical conditions. Additionally, the updating of preoperative images using the model calculations is presented and demonstrates that model-updated image-guided neurosurgery may be a viable option for addressing registration errors related to intraoperative tissue motion.     

A Comparison of a Similarity-Based and a Feature-Based 2-D–3-D Registration Method for Neurointerventional Use

Two-dimensional (2-D)-to-three-dimensional (3-D) registration can improve visualization which may aid minimally invasive neurointerventions. Using clinical and phantom studies, two state-of-the-art approaches to rigid registration are compared quantitatively: an intensity-based algorithm using the gradient difference similarity measure; and an iterative closest point (ICP)-based algorithm. The gradient difference approach was found to be more accurate, with an average registration accuracy of 1.7 mm for clinical data, compared to the ICP-based algorithm with an average accuracy of 2.8 mm. In phantom studies, the ICP-based algorithm proved more reliable, but with more complicated clinical data, the gradient difference algorithm was more robust. Average computation time for the ICP-based algorithm was 20 s per registration, compared with 14 min and 50 s for the gradient difference algorithm.     

A comparison of a similarity-based and a feature-based 2-D-3-D registration method for neurointerventional use.

Two-dimensional (2-D)-to-three-dimensional (3-D) registration can improve visualization which may aid minimally invasive neurointerventions. Using clinical and phantom studies, two state-of-the-art approaches to rigid registration are compared quantitatively: an intensity-based algorithm using the gradient difference similarity measure; and an iterative closest point (ICP)-based algorithm. The gradient difference approach was found to be more accurate, with an average registration accuracy of 1.7 mm for clinical data, compared to the ICP-based algorithm with an average accuracy of 2.8 mm. In phantom studies, the ICP-based algorithm proved more reliable, but with more complicated clinical data, the gradient difference algorithm was more robust. Average computation time for the ICP-based algorithm was 20 s per registration, compared with 14 min and 50 s for the gradient difference algorithm.     

Registration of 3-D intraoperative MR images of the brain using a finite-element biomechanical model

We present a new algorithm for the nonrigid registration of three-dimensional magnetic resonance (MR) intraoperative image sequences showing brain shift. The algorithm tracks key surfaces of objects (cortical surface and the lateral ventricles) in the image sequence using a deformable surface matching algorithm. The volumetric deformation field of the objects is then inferred from the displacements at the boundary surfaces using a linear elastic biomechanical finite-element model. Two experiments on synthetic image sequences are presented, as well as an initial experiment on intraoperative MR images showing brain shift. The results of the registration algorithm show a good correlation of the internal brain structures after deformation, and a good capability of measuring surface as well as subsurface shift. We measured distances between landmarks in the deformed initial image and the corresponding landmarks in the target scan. Cortical surface shifts of up to 10 mm and subsurface shifts of up to 6 mm were recovered with an accuracy of 1 mm or less and 3 mm or less respectively.     

3-D/2-D registration of CT and MR to X-ray images

A crucial part of image-guided therapy is registration of preoperative and intraoperative images, by which the precise position and orientation of the patient's anatomy is determined in three dimensions. This paper presents a novel approach to register three-dimensional (3-D) computed tomography (CT) or magnetic resonance (MR) images to one or more two-dimensional (2-D) X-ray images. The registration is based solely on the information present in 2-D and 3-D images. It does not require fiducial markers, intraoperative X-ray image segmentation, or timely construction of digitally reconstructed radiographs. The originality of the approach is in using normals to bone surfaces, preoperatively defined in 3-D MR or CT data, and gradients of intraoperative X-ray images at locations defined by the X-ray source and 3-D surface points. The registration is concerned with finding the rigid transformation of a CT or MR volume, which provides the best match between surface normals and back projected gradients, considering their amplitudes and orientations. We have thoroughly validated our registration method by using MR, CT, and X-ray images of a cadaveric lumbar spine phantom for which "gold standard" registration was established by means of fiducial markers, and its accuracy assessed by target registration error. Volumes of interest, containing single vertebrae L1-L5, were registered to different pairs of X-ray images from different starting positions, chosen randomly and uniformly around the "gold standard" position. CT/X-ray (MR/ X-ray) registration, which is fast, was successful in more than 91% (82% except for L1) of trials if started from the "gold standard" translated or rotated for less than 6 mm or 17 degrees (3 mm or 8.6 degrees), respectively. Root-mean-square target registration errors were below 0.5 mm for the CT to X-ray registration and below 1.4 mm for MR to X-ray registration.     

A Surface Registration Method for Quantification of Intraoperative Brain Deformations in Image-Guided Neurosurgery

Intraoperative brain deformations decrease accuracy in image-guided neurosurgery. Approaches to quantify these deformations based on 3-D reconstruction of cortectomy surfaces have been described and have shown promising results regarding the extrapolation to the whole brain volume using additional prior knowledge or sparse volume modalities. Quantification of brain deformations from surface measurement requires the registration of surfaces at different times along the surgical procedure, with different challenges according to the patient and surgical step. In this paper, we propose a new flexible surface registration approach for any textured point cloud computed by stereoscopic or laser range approach. This method includes three terms: the first term is related to image intensities, the second to Euclidean distance, and the third to anatomical landmarks automatically extracted and continuously tracked in the 2-D video flow. Performance evaluation was performed on both phantom and clinical cases. The global method, including textured point cloud reconstruction, had accuracy within 2 mm, which is the usual rigid registration error of neuronavigation systems before deformations. Its main advantage is to consider all the available data, including the microscope video flow with higher temporal resolution than previously published methods.      

Modelling prostate motion for data fusion during image-guided interventions

There is growing clinical demand for image registration techniques that allow multimodal data fusion for accurate targeting of needle biopsy and ablative prostate cancer treatments. However, during procedures where transrectal ultrasound (TRUS) guidance is used, substantial gland deformation can occur due to TRUS probe pressure. In this paper, the ability of a statistical shape/motion model, trained using finite element simulations, to predict and compensate for this source of motion is investigated. Three-dimensional ultrasound images acquired on five patient prostates, before and after TRUS-probe-induced deformation, were registered using a nonrigid, surface-based method, and the accuracy of different deformation models compared. Registration using a statistical motion model was found to outperform alternative elastic deformation methods in terms of accuracy and robustness, and required substantially fewer target surface points to achieve a successful registration. The mean final target registration error (based on anatomical landmarks) using this method was 1.8 mm. We conclude that a statistical model of prostate deformation provides an accurate, rapid and robust means of predicting prostate deformation from sparse surface data, and is therefore well-suited to a number of interventional applications where there is a need for deformation compensation.     

Intraoperative brain shift compensation: accounting for dural septa

Biomechanical models that describe soft tissue deformation provide a relatively inexpensive way to correct registration errors in image-guided neurosurgical systems caused by nonrigid brain shift. Quantifying the factors that cause this deformation to sufficient precision is a challenging task. To circumvent this difficulty, atlas-based methods have been developed recently that allow for uncertainty, yet still capture the first-order effects associated with deformation. The inverse solution is driven by sparse intraoperative surface measurements, which could bias the reconstruction and affect the subsurface accuracy of the model prediction. Studies using intraoperative MR have shown that the deformation in the midline, tentorium, and contralateral hemisphere is relatively small. The dural septa act as rigid membranes supporting the brain parenchyma and compartmentalizing the brain. Accounting for these structures in models may be an important key to improving subsurface shift accuracy. A novel method to segment the tentorium cerebelli will be described, along with the procedure for modeling the dural septa. Results in seven clinical cases show a qualitative improvement in subsurface shift accuracy making the predicted deformation more congruous with previous observations in the literature. The results also suggest a considerably more important role for hyperosmotic drug modeling for the intraoperative shift correction environment.     

基于模型的自由形态物体匹配方法研究

匹配是物体识别中的一个重要部分。针对自由形态物体识别问题提出了一种快速匹配算法以计算模型与物体之间的刚体变换。算法在最近点迭代匹配算法的基础上,针对用结构光方法重建获得的三维物体表面,对数据点进行了加权处理,以减弱曲面重建产生误差对匹配精度的影响。并对匹配运算采用了多分辨率分层匹配方法,对低分辨率模型的刚体变换进行粗略计算,将结果作为高分辨率模型数据计算的初始值,大大减少了匹配的计算代价。实验结果证明了文中提出方法的有效性。     

Rapid elastic image registration for 3-D ultrasound

A Subvolume-based algorithm for elastic Ultrasound REgistration (SURE) was developed and evaluated. Designed primarily to improve spatial resolution in three-dimensional compound imaging, the algorithm registers individual image volumes nonlinearly before combination into compound volumes. SURE works in one or two stages, optionally using MIAMI Fuse software first to determine a global affine registration before iteratively dividing the volume into subvolumes and computing local rigid registrations in the second stage. Connectivity of the entire volume is ensured by global interpolation using thin-plate splines after each iteration. The performance of SURE was quantified in 20 synthetically deformed in vivo ultrasound volumes, and in two phantom scans, one of which was distorted at acquisition by placing an aberrating layer in the sound path. The aberrating layer was designed to induce beam aberrations reported for the female breast. Synthetic deformations of 1.5-2.5 mm were reduced by over 85% when SURE was applied to register the distorted image volumes with the original ones. Registration times were below 5 min on a 500-MHz CPU for an average data set size of 13 MB. In the aberrated phantom scans, SURE reduced the average deformation between the two volumes from 1.01 to 0.30 mm. This was a statistically significant (P = 0.01) improvement over rigid and affine registration transformations, which produced reductions to 0.59 and 0.50 mm, respectively.     

Investigation of intraoperative brain deformation using a 1.5-Tinterventional MR system: preliminary results

All image-guided neurosurgical systems that the authors are aware of assume that the head and its contents behave as a rigid body. It is important to measure intraoperative brain deformation (brain shift) to provide some indication of the application accuracy of image-guided surgical systems, and also to provide data to develop and validate nonrigid registration algorithms to correct for such deformation. The authors are collecting data from patients undergoing neurosurgery in a high-field (1.5 T) interventional magnetic resonance (MR) scanner. High-contrast and high-resolution gradient-echo MR image volumes are collected immediately prior to surgery, during surgery, and at the end of surgery, with the patient intubated and lying on the operating table in the operative position. Here, the authors report initial results from six patients: one freehand biopsy, one stereotactic functional procedure, and four resections. The authors investigate intraoperative brain deformation by examining threshold boundary overlays and difference images and by measuring ventricular volume. They also present preliminary results obtained using a nonrigid registration algorithm to quantify deformation. They found that some cases had much greater deformation than others, and also that, regardless of the procedure, there was very little deformation of the midline, the tentorium, the hemisphere contralateral to the procedure, and ipsilateral structures except those that are within 1 cm of the lesion or are gravitationally above the surgical site     

Biomechanical 3-D finite element modeling of the human breast using MRI data

Breast tissue deformation modeling has recently gained considerable interest in various medical applications. A biomechanical model of the breast is presented using a finite element (FE) formulation. Emphasis is given to the modeling of breast tissue deformation which takes place in breast imaging procedures. The first step in implementing the FE modeling (FEM) procedure is mesh generation. For objects with irregular and complex geometries such as the breast, this step is one of the most difficult and tedious tasks. For FE mesh generation, two automated methods are presented which process MRI breast images to create a patient-specific mesh. The main components of the breast are adipose, fibroglandular and skin tissues. For modeling the adipose and fibroglandular tissues, we used eight noded hexahedral elements with hyperelastic properties, while for the skin, we chose four noded hyperelastic membrane elements. For model validation, an MR image of an agarose phantom was acquired and corresponding FE meshes were created. Based on assigned elasticity parameters, a numerical experiment was performed using the FE meshes, and good results were obtained. The model was also applied to a breast image registration problem of a volunteer's breast. Although qualitatively reasonable, further work is required to validate the results quantitatively.     

Spherical harmonics based intrasubject 3-D kidney modeling/registration technique applied on partial information

This paper presents a three-dimensional (3-D) shape reconstruction/intrapatient rigid registration technique used to establish a Nephron-Sparing Surgery preoperative planning. The usual preoperative imaging system is the Spiral CT Urography, which provides successive 3-D acquisitions of complementary information on kidney anatomy. Because the kidney is difficult to demarcate from the liver or from the spleen only limited information on its volume or surface is available. In this paper, we propose a methodology allowing a global kidney spatial representation on a spherical harmonics basis. The spherical harmonics are exploited to recover the kidney 3-D shape and also to perform intrapatient 3-D rigid registration. An evaluation performed on synthetic data showed that this technique presented lower performance then expected for the 3-D shape recovering but exhibited registration results slightly more accurate as the iterative closest point technique with faster computation time.     

Reconstruction of 3-D head geometry from digitized point sets: an evaluation study

In this paper, we evaluate different methods to estimate patient-specific scalp, skull, and brain surfaces from a set of digitized points from the target's scalp surface. The reconstruction problem is treated as a registration problem: An a priori surface model, consisting of the scalp, skull, and brain surfaces, is registered to the digitized surface points. The surface model is generated from segmented magnetic resonance (MR) volume images. We study both affine and free-form deformation (FFD) registration, the use of average models, the averaging of individual registration results, a model selection procedure, and statistical deformation models. The registration algorithms are mainly previously published, and the objective of this paper is to evaluate these methods in this particular application with sparse data. The main interest of this paper is to generate geometric head models for biomedical applications, such as electroencephalography and magnetoencephalographic. However, the methods can also be applied to other anatomical regions and to other application areas. The methods were validated using 15 MR volume images, from which the scalp, skull, and brain were manually segmented. The best results were achieved by averaging the results of the FFD registrations of the database: the mean distance from the manually segmented target surface to a deformed a priori model surface for the studied anatomical objects was 1.68-2.08 mm, depending on the point set used. The results support the use of the evaluated methods for the reconstruction of geometric models in applications with sparse data.     

Non-Rigid Image Registration by Neural Computation

Non-rigid image registration is a prerequisite for many medical image analysis applications such as image fusion of multimodality images and quantitative change analysis of a temporal sequence in computer-aided diagnosis. By establishing the point correspondence of the extracted feature points, it is possible to recover the deformation using nonlinear interpolation methods. However, it may be very difficult to establish such correspondence at an initial stage when confronted with large and complex deformation. In this paper, a mixture of principal axes registration (mPAR) method is proposed to resolve the correspondence problem through a neural computational approach. The novel feature of mPAR is the alignment of two point sets without the need of establishing explicit point correspondence. Instead, it aligns the two point sets by minimizing the relative entropy between their probability distributions resulting in a maximum likelihood estimate of the transformation matrix. The registration process consists of two steps: (1) a finite mixture scheme to establish an improved point correspondence and (2) a multilayer perceptron neural network (MLP) to recover the nonlinear deformation. The neural computation for registration uses a committee machine to obtain a mixture of piece-wise rigid registrations, which gives a reliable point correspondence using multiple extracted objects in a finite mixture scheme. Then the MLP is used to determine the coefficients of a polynomial transform using extracted control points. We have applied our mPAR method to register synthetic data sets, surgical prostate models, and a temporal sequence of mammograms of a single patient. The experimental results show that mPAR not only improves the accuracy of the point correspondence but also results in a desirable error-resilience property for control point selection errors.