A computational model for tracking subsurface tissue deformationduring stereotactic neurosurgery

Recent advances in the field of sterotactic neurosurgery have made it possible to coregister preoperative computed tomography (CT) and magnetic resonance (MR) images with instrument locations in the operating field. However, accounting for intraoperative movement of brain tissue remains a challenging problem. While intraoperative CT and MR scanners record concurrent tissue motion, there is motivation to develop methodologies which would be significantly lower in cost and more widely available. The approach the authors present is a computational model of brain tissue deformation that could be used in conjunction with a limited amount of concurrently obtained operative data to estimate subsurface tissue motion. Specifically, the authors report on the initial development of a finite element model of brain tissue adapted from consolidation theory. Validations of the computational mathematics in two and three dimensions are shown with errors of 1%-2% for the discretizations used. Experience with the computational strategy for estimating surgically induced brain tissue motion in vivo is also presented. While the predicted tissue displacements differ from measured values by about 15%, they suggest that exploiting a physics-based computational framework for updating preoperative imaging databases during the course of surgery has considerable merit. However, additional model and computational developments are needed before this approach can become a clinical reality     

Volumetric intraoperative brain deformation compensation: model development and phantom validation

During neurosurgery, nonrigid brain deformation may affect the reliability of tissue localization based on preoperative images. To provide accurate surgical guidance in these cases, preoperative images must be updated to reflect the intraoperative brain. This can be accomplished by warping these preoperative images using a biomechanical model. Due to the possible complexity of this deformation, intraoperative information is often required to guide the model solution. In this paper, a linear elastic model of the brain is developed to infer volumetric brain deformation associated with measured intraoperative cortical surface displacement. The developed model relies on known material properties of brain tissue, and does not require further knowledge about intraoperative conditions. To provide an initial estimation of volumetric model accuracy, as well as determine the model's sensitivity to the specified material parameters and surface displacements, a realistic brain phantom was developed. Phantom results indicate that the linear elastic model significantly reduced localization error due to brain shift, from > 16 mm to under 5 mm, on average. In addition, though in vivo quantitative validation is necessary, preliminary application of this approach to images acquired during neocortical epilepsy cases confirms the feasibility of applying the developed model to in vivo data.     

Alignment of sparse freehand 3-D ultrasound with preoperative images of the liver using models of respiratory motion and deformation

We present a method for alignment of an interventional plan to optically tracked two-dimensional intraoperative ultrasound (US) images of the liver. Our clinical motivation is to enable the accurate transfer of information from three-dimensional preoperative imaging modalities [magnetic resonance (MR) or computed tomography (CT)] to intraoperative US to aid needle placement for thermal ablation of liver metastases. An initial rigid registration to intraoperative coordinates is obtained using a set of US images acquired at maximum exhalation. A preprocessing step is applied to both the preoperative images and the US images to produce evidence of corresponding structures. This yields two sets of images representing classification of regions as vessels. The registration then proceeds using these images. The preoperative images and plan are then warped to correspond to a single US slice acquired at an unknown point in the breathing cycle where the liver is likely to have moved and deformed relative to the preoperative image. Alignment is constrained using a patient-specific model of breathing motion and deformation. Target registration error is estimated by carrying out simulation experiments using resliced MR volumes to simulate real US and comparing the registration results to a "bronze-standard" registration performed on the full MR volume. Finally, the system is tested using real US and verified using visual inspection.     

Biomechanical modeling of the human head for physically based, nonrigid image registration

The accuracy of image-guided neurosurgery generally suffers from brain deformations due to intraoperative changes. These deformations cause significant changes of the anatomical geometry (organ shape and spatial interorgan relations), thus making intraoperative navigation based on preoperative images error prone. In order to improve the navigation accuracy, we developed a biomechanical model of the human head based on the finite element method, which can be employed for the correction of preoperative images to cope with the deformations occurring during surgical interventions. At the current stage of development, the two-dimensional (2-D) implementation of the model comprises two different materials, though the theory holds for the three-dimensional (3-D) case and is capable of dealing with an arbitrary number of different materials. For the correction of a preoperative image, a set of homologous landmarks must be specified which determine correspondences. These correspondences can be easily integrated into the model and are maintained throughout the computation of the deformation of the preoperative image. The necessary material parameter values have been determined through a comprehensive literature study. Our approach has been tested for the case of synthetic images and yields physically plausible deformation results. Additionally, we carried out registration experiments with a preoperative MR image of the human head and a corresponding postoperative image simulating an intraoperative image. We found that our approach yields good prediction results, even in the case when correspondences are given in a relatively small area of the image only.     

In vivo quantification of retraction deformation modeling for updated image-guidance during neurosurgery

The use of coregistered preoperative anatomical scans to provide navigational information in the operating room has greatly benefited the field of neurosurgery. Nonetheless, it has been widely acknowledged that significant errors between the operating field and the preoperative images are generated as surgery progresses. Quantification of tissue shift can be accomplished with volumetric intraoperative imaging; however, more functional, lower cost alternative solutions to this challenge are desirable. We are developing the strategy of exploiting a computational model driven by sparse data obtained from intraoperative ultrasound and cortical surface tracking to warp preoperative images to reflect the current state of the operating field. This paper presents an initial quantification of the predictive capability of the current model to computationally capture tissue deformation during retraction in the porcine brain. Performance validation is achieved through comparisons of displacement and pressure predictions to experimental measurements obtained from computed tomographic images and pressure sensor recordings. Group results are based upon a generalized set of boundary conditions for four subjects that, on average, account for at least 75% of tissue motion generated during interhemispheric retraction. Individualized boundary conditions can improve the degree of data-model match by 10% or more but warrant further study. Overall, the level of quantitative agreement achieved in these experiments is encouraging for updating preoperative images to reflect tissue deformation resulting from retraction, especially since model improvements are likely as a result of the intraoperative constraints that can be applied through sparse data collection.     

Model-updated image guidance: initial clinical experiences with gravity-induced brain deformation

Image-guided neurosurgery relies on accurate registration of the patient, the preoperative image series, and the surgical instruments in the same coordinate space. Recent clinical reports have documented the magnitude of gravity-induced brain deformation in the operating room and suggest these levels of tissue motion may compromise the integrity of such systems. We are investigating a model-based strategy which exploits the wealth of readily-available preoperative information in conjunction with intraoperatively acquired data to construct and drive a three dimensional (3-D) computational model which estimates volumetric displacements in order to update the neuronavigational image set. Using model calculations, the preoperative image database can be deformed to generate a more accurate representation of the surgical focus during an operation. In this paper, we present a preliminary study of four patients that experienced substantial brain deformation from gravity and correlate cortical shift measurements with model predictions. Additionally, we illustrate our image deforming algorithm and demonstrate that preoperative image resolution is maintained. Results over the four cases show that the brain shifted, on average, 5.7 mm in the direction of gravity and that model predictions could reduce this misregistration error to an average of 1.2 mm.     

Motion estimation of skeletonized angiographic images using elastic registration

An approach for estimating the motion of arteries in digital angiographic image sequences is proposed. Binary skeleton images are registered using an elastic registration algorithm in order to estimate the motion of the corresponding arteries. This algorithm operates recursively on the skeleton images by considering an autoregressive (AR) model of the deformation in conjunction with a dynamic programming (DP) algorithm. The AR model is used at the pixel level and provides a suitable cost function to DP through the innovation process. In addition, a moving average (MA) model for the motion of the entire skeleton is used in combination with the local AR model for improved registration results. The performance of this motion estimation method is demonstrated on simulated and real digital angiographic image sequences. It is shown that motion estimation using elastic registration of skeletons is very successful especially with low contrast and noisy angiographic images.     

Robust nonrigid registration to capture brain shift from intraoperative MRI

We present a new algorithm to register 3-D preoperative magnetic resonance (MR) images to intraoperative MR images of the brain which have undergone brain shift. This algorithm relies on a robust estimation of the deformation from a sparse noisy set of measured displacements. We propose a new framework to compute the displacement field in an iterative process, allowing the solution to gradually move from an approximation formulation (minimizing the sum of a regularization term and a data error term) to an interpolation formulation (least square minimization of the data error term). An outlier rejection step is introduced in this gradual registration process using a weighted least trimmed squares approach, aiming at improving the robustness of the algorithm. We use a patient-specific model discretized with the finite element method in order to ensure a realistic mechanical behavior of the brain tissue. To meet the clinical time constraint, we parallelized the slowest step of the algorithm so that we can perform a full 3-D image registration in 35 s (including the image update time) on a heterogeneous cluster of 15 personal computers. The algorithm has been tested on six cases of brain tumor resection, presenting a brain shift of up to 14 mm. The results show a good ability to recover large displacements, and a limited decrease of accuracy near the tumor resection cavity.     

Stereopsis-guided brain shift compensation

Brain deformation models have proven to be a powerful tool in compensating for soft tissue deformation during image-guided neurosurgery. The accuracy of these models can be improved by incorporating intraoperative measurements of brain motion. We have designed and implemented a passive intraoperative stereo vision system capable of estimating the three-dimensional shape of the surgical scene in near real-time. This intraoperative shape is compared with the cortical surface in the co-registered preoperative magnetic resonance (MR) volume for the estimation of the cortical motion resulting from the open cranial surgery. The estimated cortical motion is then used to guide a full brain model, which updates a preoperative MR volume. We have found that the stereo vision system is accurate to within approximately 1 mm. Based on data from two representative clinical cases, we show that stereopsis guidance improves the accuracy of brain shift compensation both at and below the cortical surface.     

Nonrigid image registration in shared-memory multiprocessor environments with application to brains, breasts, and bees

One major problem with nonrigid image registration techniques is their high computational cost. Because of this, these methods have found limited application to clinical situations where fast execution is required, e.g., intraoperative imaging. This paper presents a parallel implementation of a nonrigid image registration algorithm. It takes advantage of shared-memory multiprocessor computer architectures using multithreaded programming by partitioning of data and partitioning of tasks, depending on the computational subproblem. For three different biomedical applications (intraoperative brain deformation, contrast-enhanced MR mammography, intersubject brain registration), the scaling behavior of the algorithm is quantitatively analyzed. The method is demonstrated to perform the computation of intra-operative brain deformation in less than a minute using 64 CPUs on a 128-CPU shared-memory supercomputer (SGI Origin 3800). It is shown that its serial component is no more than 2% of the total computation time, allowing a speedup of at least a factor of 50. In most cases, the theoretical limit of the speedup is substantially higher (up to 132-fold in the application examples presented in this paper). The parallel implementation of our algorithm is, therefore, capable of solving nonrigid registration problems with short execution time requirements and may be considered an important step in the application of such techniques to clinically important problems such as the computation of brain deformation during cranial image-guided surgery.     

Image-Guided Intraoperative Cortical Deformation Recovery Using Game Theory: Application to Neocortical Epilepsy Surgery

During neurosurgery, nonrigid brain deformation prevents preoperatively-acquired images from accurately depicting the intraoperative brain. Stereo vision systems can be used to track intraoperative cortical surface deformation and update preoperative brain images in conjunction with a biomechanical model. However, these stereo systems are often plagued with calibration error, which can corrupt the deformation estimation. In order to decouple the effects of camera calibration from the surface deformation estimation, a framework that can solve for disparate and often competing variables is needed. Game theory, which was developed to handle decision making in this type of competitive environment, has been applied to various fields from economics to biology. In this paper, game theory is applied to cortical surface tracking during neocortical epilepsy surgery and used to infer information about the physical processes of brain surface deformation and image acquisition. The method is successfully applied to eight in vivo cases, resulting in an 81% decrease in mean surface displacement error. This includes a case in which some of the initial camera calibration parameters had errors of 70%. Additionally, the advantages of using a game theoretic approach in neocortical epilepsy surgery are clearly demonstrated in its robustness to initial conditions.      

A comparative study of biomechanical simulators in deformable registration of brain tumor images

Simulating the brain tissue deformation caused by tumor growth has been found to aid the deformable registration of brain tumor images. In this paper, we evaluate the impact that different biomechanical simulators have on the accuracy of deformable registration. We use two alternative frameworks for biomechanical simulations of mass effect in 3-D magnetic resonance (MR) brain images. The first one is based on a finite-element model of nonlinear elasticity and unstructured meshes using the commercial software package ABAQUS. The second one employs incremental linear elasticity and regular grids in a fictitious domain method. In practice, biomechanical simulations via the second approach may be at least ten times faster. Landmarks error and visual examination of the coregistered images indicate that the two alternative frameworks for biomechanical simulations lead to comparable results of deformable registration. Thus, the computationally less expensive biomechanical simulator offers a practical alternative for registration purposes.     

Registration of 3-D intraoperative MR images of the brain using a finite-element biomechanical model

We present a new algorithm for the nonrigid registration of three-dimensional magnetic resonance (MR) intraoperative image sequences showing brain shift. The algorithm tracks key surfaces of objects (cortical surface and the lateral ventricles) in the image sequence using a deformable surface matching algorithm. The volumetric deformation field of the objects is then inferred from the displacements at the boundary surfaces using a linear elastic biomechanical finite-element model. Two experiments on synthetic image sequences are presented, as well as an initial experiment on intraoperative MR images showing brain shift. The results of the registration algorithm show a good correlation of the internal brain structures after deformation, and a good capability of measuring surface as well as subsurface shift. We measured distances between landmarks in the deformed initial image and the corresponding landmarks in the target scan. Cortical surface shifts of up to 10 mm and subsurface shifts of up to 6 mm were recovered with an accuracy of 1 mm or less and 3 mm or less respectively.     

Displacement estimation with co-registered ultrasound for image guided neurosurgery: a quantitative in vivo porcine study

Brain shift during open cranial surgery presents a challenge for maintaining registration with image-guidance systems. Ultrasound (US) is a convenient intraoperative imaging modality that may be a useful tool in detecting tissue shift and updating preoperative images based on intraoperative measurements of brain deformation. We have quantitatively evaluated the ability of spatially tracked freehand US to detect displacement of implanted markers in a series of three in vivo porcine experiments, where both US and computed tomography (CT) image acquisitions were obtained before and after deforming the brain. Marker displacements ranged from 0.5 to 8.5 mm. Comparisons between CT and US measurements showed a mean target localization error of 1.5 mm, and a mean vector error for displacement of 1.1 mm. Mean error in the magnitude of displacement was 0.6 mm. For one of the animals studied, the US data was used in conjunction with a biomechanical model to nonrigidly re-register a baseline CT to the deformed brain. The mean error between the actual and deformed CT's was found to be on average 1.2 and 1.9 mm at the marker locations depending on the extent of the deformation induced. These findings indicate the potential accuracy in coregistered freehand US displacement tracking in brain tissue and suggest that the resulting information can be used to drive a modeling re-registration strategy to comparable levels of agreement.     

Validation of nonrigid image registration using finite-element methods: application to breast MR images

This paper presents a novel method for validation of nonrigid medical image registration. This method is based on the simulation of physically plausible, biomechanical tissue deformations using finite-element methods. Applying a range of displacements to finite-element models of different patient anatomies generates model solutions which simulate gold standard deformations. From these solutions, deformed images are generated with a range of deformations typical of those likely to occur in vivo. The registration accuracy with respect to the finite-element simulations is quantified by co-registering the deformed images with the original images and comparing the recovered voxel displacements with the biomechanically simulated ones. The functionality of the validation method is demonstrated for a previously described nonrigid image registration technique based on free-form deformations using B-splines and normalized mutual information as a voxel similarity measure, with an application to contrast-enhanced magnetic resonance mammography image pairs. The exemplar nonrigid registration technique is shown to be of subvoxel accuracy on average for this particular application. The validation method presented here is an important step toward more generic simulations of biomechanically plausible tissue deformations and quantification of tissue motion recovery using nonrigid image registration. It will provide a basis for improving and comparing different nonrigid registration techniques for a diversity of medical applications, such as intrasubject tissue deformation or motion correction in the brain, liver or heart.     

Intraoperative brain shift compensation: accounting for dural septa

Biomechanical models that describe soft tissue deformation provide a relatively inexpensive way to correct registration errors in image-guided neurosurgical systems caused by nonrigid brain shift. Quantifying the factors that cause this deformation to sufficient precision is a challenging task. To circumvent this difficulty, atlas-based methods have been developed recently that allow for uncertainty, yet still capture the first-order effects associated with deformation. The inverse solution is driven by sparse intraoperative surface measurements, which could bias the reconstruction and affect the subsurface accuracy of the model prediction. Studies using intraoperative MR have shown that the deformation in the midline, tentorium, and contralateral hemisphere is relatively small. The dural septa act as rigid membranes supporting the brain parenchyma and compartmentalizing the brain. Accounting for these structures in models may be an important key to improving subsurface shift accuracy. A novel method to segment the tentorium cerebelli will be described, along with the procedure for modeling the dural septa. Results in seven clinical cases show a qualitative improvement in subsurface shift accuracy making the predicted deformation more congruous with previous observations in the literature. The results also suggest a considerably more important role for hyperosmotic drug modeling for the intraoperative shift correction environment.     

Modelling prostate motion for data fusion during image-guided interventions

There is growing clinical demand for image registration techniques that allow multimodal data fusion for accurate targeting of needle biopsy and ablative prostate cancer treatments. However, during procedures where transrectal ultrasound (TRUS) guidance is used, substantial gland deformation can occur due to TRUS probe pressure. In this paper, the ability of a statistical shape/motion model, trained using finite element simulations, to predict and compensate for this source of motion is investigated. Three-dimensional ultrasound images acquired on five patient prostates, before and after TRUS-probe-induced deformation, were registered using a nonrigid, surface-based method, and the accuracy of different deformation models compared. Registration using a statistical motion model was found to outperform alternative elastic deformation methods in terms of accuracy and robustness, and required substantially fewer target surface points to achieve a successful registration. The mean final target registration error (based on anatomical landmarks) using this method was 1.8 mm. We conclude that a statistical model of prostate deformation provides an accurate, rapid and robust means of predicting prostate deformation from sparse surface data, and is therefore well-suited to a number of interventional applications where there is a need for deformation compensation.     

ORBIT: a multiresolution framework for deformable registration of brain tumor images

A deformable registration method is proposed for registering a normal brain atlas with images of brain tumor patients. The registration is facilitated by first simulating the tumor mass effect in the normal atlas in order to create an atlas image that is as similar as possible to the patient's image. An optimization framework is used to optimize the location of tumor seed as well as other parameters of the tumor growth model, based on the pattern of deformation around the tumor region. In particular, the optimization is implemented in a multiresolution and hierarchical scheme, and it is accelerated by using a principal component analysis (PCA)-based model of tumor growth and mass effect, trained on a computationally more expensive biomechanical model. Validation on simulated and real images shows that the proposed registration framework, referred to as ORBIT (optimization of tumor parameters and registration of brain images with tumors), outperforms other available registration methods particularly for the regions close to the tumor, and it has the potential to assist in constructing statistical atlases from tumor-diseased brain images.      

Compensating for intraoperative soft-tissue deformations using incomplete surface data and finite elements

Image-guided liver surgery requires the ability to identify and compensate for soft tissue deformation in the organ. The predeformed state is represented as a complete three-dimensional surface of the organ, while the intraoperative data is a range scan point cloud acquired from the exposed liver surface. The first step is to rigidly align the coordinate systems of the intraoperative and preoperative data. Most traditional rigid registration methods minimize an error metric over the entire data set. In this paper, a new deformation-identifying rigid registration (DIRR) is reported that identifies and aligns minimally deformed regions of the data using a modified closest point distance cost function. Once a rigid alignment has been established, deformation is accounted for using a linearly elastic finite element model (FEM) and implemented using an incremental framework to resolve geometric nonlinearities. Boundary conditions for the incremental formulation are generated from intraoperatively acquired range scan surfaces of the exposed liver surface. A series of phantom experiments is presented to assess the fidelity of the DIRR and the combined DIRR/FEM approaches separately. The DIRR approach identified deforming regions in 90% of cases under conditions of realistic surgical exposure. With respect to the DIRR/FEM algorithm, subsurface target errors were correctly located to within 4 mm in phantom experiments.     

Spatio-temporal nonrigid registration for ultrasound cardiac motion estimation

We propose a new spatio-temporal elastic registration algorithm for motion reconstruction from a series of images. The specific application is to estimate displacement fields from two-dimensional ultrasound sequences of the heart. The basic idea is to find a spatio-temporal deformation field that effectively compensates for the motion by minimizing a difference with respect to a reference frame. The key feature of our method is the use of a semi-local spatio-temporal parametric model for the deformation using splines, and the reformulation of the registration task as a global optimization problem. The scale of the spline model controls the smoothness of the displacement field. Our algorithm uses a multiresolution optimization strategy to obtain a higher speed and robustness. We evaluated the accuracy of our algorithm using a synthetic sequence generated with an ultrasound simulation package, together with a realistic cardiac motion model. We compared our new global multiframe approach with a previous method based on pairwise registration of consecutive frames to demonstrate the benefits of introducing temporal consistency. Finally, we applied the algorithm to the regional analysis of the left ventricle. Displacement and strain parameters were evaluated showing significant differences between the normal and pathological segments, thereby illustrating the clinical applicability of our method.