Fiducial optimization for minimal target registration error in image-guided neurosurgery

This paper presents new methods for the optimal selection of anatomical landmarks and optimal placement of fiducial markers in image-guided neurosurgery. These methods allow the surgeon to optimally plan fiducial marker locations on routine diagnostic images before preoperative imaging and to intraoperatively select the set of fiducial markers and anatomical landmarks that minimize the expected target registration error (TRE). The optimization relies on a novel empirical simulation-based TRE estimation method built on actual fiducial localization error (FLE) data. Our methods take the guesswork out of the registration process and can reduce localization error without additional imaging and hardware. Our clinical experiments on five patients who underwent brain surgery with a navigation system show that optimizing one marker location and the anatomical landmarks configuration reduced the TRE. The average TRE values using the usual fiducials setup and using the suggested method were 4.7 mm and 3.2 mm, respectively. We observed a maximum improvement of 4 mm. Reducing the target registration error has the potential to support safer and more accurate minimally invasive neurosurgical procedures.     

Self-calibrating 3D-ultrasound-based bone registration for minimally invasive orthopedic surgery

Intraoperative freehand three-dimensional (3-D) ultrasound (3D-US) has been proposed as a noninvasive method for registering bones to a preoperative computed tomography image or computer-generated bone model during computer-aided orthopedic surgery (CAOS). In this technique, an US probe is tracked by a 3-D position sensor and acts as a percutaneous device for localizing the bone surface. However, variations in the acoustic properties of soft tissue, such as the average speed of sound, can introduce significant errors in the bone depth estimated from US images, which limits registration accuracy. We describe a new self-calibrating approach to US-based bone registration that addresses this problem, and demonstrate its application within a standard registration scheme. Using realistic US image data acquired from 6 femurs and 3 pelves of intact human cadavers, and accurate Gold Standard registration transformations calculated using bone-implanted fiducial markers, we show that self-calibrating registration is significantly more accurate than a standard method, yielding an average root mean squared target registration error of 1.6 mm. We conclude that self-calibrating registration results in significant improvements in registration accuracy for CAOS applications over conventional approaches where calibration parameters of the 3D-US system remain fixed to values determined using a preoperative phantom-based calibration.     

3-D/2-D registration of CT and MR to X-ray images

A crucial part of image-guided therapy is registration of preoperative and intraoperative images, by which the precise position and orientation of the patient's anatomy is determined in three dimensions. This paper presents a novel approach to register three-dimensional (3-D) computed tomography (CT) or magnetic resonance (MR) images to one or more two-dimensional (2-D) X-ray images. The registration is based solely on the information present in 2-D and 3-D images. It does not require fiducial markers, intraoperative X-ray image segmentation, or timely construction of digitally reconstructed radiographs. The originality of the approach is in using normals to bone surfaces, preoperatively defined in 3-D MR or CT data, and gradients of intraoperative X-ray images at locations defined by the X-ray source and 3-D surface points. The registration is concerned with finding the rigid transformation of a CT or MR volume, which provides the best match between surface normals and back projected gradients, considering their amplitudes and orientations. We have thoroughly validated our registration method by using MR, CT, and X-ray images of a cadaveric lumbar spine phantom for which "gold standard" registration was established by means of fiducial markers, and its accuracy assessed by target registration error. Volumes of interest, containing single vertebrae L1-L5, were registered to different pairs of X-ray images from different starting positions, chosen randomly and uniformly around the "gold standard" position. CT/X-ray (MR/ X-ray) registration, which is fast, was successful in more than 91% (82% except for L1) of trials if started from the "gold standard" translated or rotated for less than 6 mm or 17 degrees (3 mm or 8.6 degrees), respectively. Root-mean-square target registration errors were below 0.5 mm for the CT to X-ray registration and below 1.4 mm for MR to X-ray registration.     

A statistical model for point-based target registration error with anisotropic fiducial localizer error

Error models associated with point-based medical image registration problems were first introduced in the late 1990s. The concepts of fiducial localizer error, fiducial registration error, and target registration error are commonly used in the literature. The model for estimating the target registration error at a position r in a coordinate frame defined by a set of fiducial markers rigidly fixed relative to one another is ubiquitous in the medical imaging literature. The model has also been extended to simulate the target registration error at the point of interest in optically tracked tools. However, the model is limited to describing the error in situations where the fiducial localizer error is assumed to have an isotropic normal distribution in R3. In this work, the model is generalized to include a fiducial localizer error that has an anisotropic normal distribution. Similar to the previous models, the root mean square statistic rms tre is provided along with an extension that provides the covariance Sigma tre. The new model is verified using a Monte Carlo simulation and a set of statistical hypothesis tests. Finally, the differences between the two assumptions, isotropic and anisotropic, are discussed within the context of their use in 1) optical tool tracking simulation and 2) image registration.     

Distribution of Fiducial Registration Error in Rigid-Body Point-Based Registration

Rigid-body point-based registration is frequently used in computer assisted surgery to align corresponding points, or fiducials, in preoperative and intraoperative data. This alignment is mostly achieved by assuming the same homogeneous error distribution for all the points; however, due to the properties of the medical instruments used in measuring the point coordinates, the error distribution might be inhomogeneous and different for each point. In this paper, in an effort to understand the effect of error distribution in the localized points on the performed registration, we derive a closed-form solution relating the error distribution of each point with the performed registration accuracy. The solution uses maximum likelihood estimation to calculate the probability density function of registration error at each fiducial point. Extensive numerical simulations are performed to validated the proposed solution.      

Voxel-based 2-D/3-D registration of fluoroscopy images and CT scansfor image-guided surgery

Registration of intraoperative fluoroscopy images with preoperative 3D CT images can he used for several purposes in image-guided surgery. On the one hand, it can be used to display the position of surgical instruments, which are being tracked by a localizer, in the preoperative CT scan. On the other hand, the registration result can be used to project preoperative planning information or important anatomical structures visible in the CT image on to the fluoroscopy image. For this registration task, a novel voxel-based method in combination with a new similarity measure (pattern intensity) has been developed. The basic concept of the method is explained at the example of 2D/3D registration of a vertebra in an X-ray fluoroscopy image with a 3D CT image. The registration method is described, and the results for a spine phantom are presented and discussed. Registration has been carried out repeatedly with different starting estimates to study the capture range. Information about registration accuracy has been obtained by comparing the registration results with a highly accurate “ground-truth” registration, which has been derived from fiducial markers attached to the phantom prior to imaging. In addition, registration results for different vertebrae have been compared. The results show that the rotation parameters and the shifts parallel to the projection plane can accurately be determined from a single projection. Because of the projection geometry, the accuracy of the height above the projection plane is significantly lower     

On designing an isotropic fiducial mark

The Crame/spl acute/r-Rao lower bound (CRLB) of image registration error using an isotropic fiducial mark is derived. The derived CRLB is a function of the intensity profile of the fiducial mark. Following the development of the CRLB, a new method for designing an isotropic fiducial mark, suitable for digital image registration, is presented. A parameterization method of the fiducial intensity profile is introduced which guarantees no aliasing effect when the fiducial mark is digitized with the proper sampling rate. A method for computing the fiducial intensity profile, based on minimization of the CRLB registration error, and subject to certain practical constraints, is developed. For imaging systems with a significant low-pass effect, it is proposed to pre-emphasize the high frequency components of the fiducial mark by converting the designed gray-scale fiducial marks into binary fiducial marks. Experimental results show that the designed fiducial mark can provide very accurate registration results and that the registration accuracy is independent of its location.     

The distribution of target registration error in rigid-body point-based registration

Guidance systems designed for neurosurgery, hip surgery, spine surgery and for approaches to other anatomy that is relatively rigid can use rigid-body transformations to accomplish image registration. These systems often rely on point-based registration to determine the transformation and many such systems use attached fiducial markers to establish accurate fiducial points for the registration, the points being established by some fiducial localization process. Accuracy is important to these systems, as is knowledge of the level of that accuracy. An advantage of marker-based systems, particularly those in which the markers are bone-implanted, is that registration error depends only on the fiducial localization and is, thus, to a large extent independent of the particular object being registered. Thus, it should be possible to predict the clinical accuracy of marker-based systems on the basis of experimental measurements made with phantoms or previous patients. For most registration tasks, the most important error measure is target registration error (TRE), which is the distance after registration between corresponding points not used in calculating the registration transform. In this paper, we derive an approximation to the distribution of TRE; this is an extension of previous work that gave the expected squared value of TRE. We show the distribution of the squared magnitude of TRE and that of the component of TRE in an arbitrary direction. Using numerical simulations, we show that our theoretical results are a close match to the simulated ones.     

A comparison of similarity measures for use in 2-D-3-D medicalimage registration

A comparison of six similarity measures for use in intensity-based two-dimensional-three-dimensional (2-D-3-D) image registration is presented. The accuracy of the similarity measures are compared to a “gold-standard” registration which has been accurately calculated using fiducial markers. The similarity measures are used to register a computed tomography (CT) scan of a spine phantom to a fluoroscopy image of the phantom. The registration is carried out within a region-of-interest in the fluoroscopy image which is user defined to contain a single vertebra. Many of the problems involved in this type of registration are caused by features which were not modeled by a phantom image alone. More realistic “gold-standard” data sets were simulated using the phantom image with clinical image features overlaid. Results show that the introduction of soft-tissue structures and interventional instruments into the phantom image can have a large effect on the performance of some similarity measures previously applied to 2-D-3-D image registration. Two measures were able to register accurately and robustly even when soft-tissue structures and interventional instruments were present as differences between the images. These measures were pattern intensity and gradient difference. Their registration accuracy, for all the rigid-body parameters except for the source to film translation, was within a root-mean-square (rms) error of 0.53 mm or degrees to the “gold-standard” values. No failures occurred while registering using these measures     

An ultrasonic approach to localization of fiducial markers forinteractive, image-guided neurosurgery. I. Principles

Fiducial markers are reference points used in the registration of image space(s) with physical (patient) space. As applied to interactive, image-guided surgery, the registration of image space with physical space allows the current location of a surgical tool to be indicated on a computer display of patient-specific preoperative images. This intrasurgical guidance information is particularly valuable in surgery within the brain, where visual feedback is limited. The accuracy of the mapping between physical and image space depends upon the accuracy with which the fiducial markers were located in each coordinate system. To effect accurate space registration for interactive, image-guided neurosurgery, the use of permanent fiducial markers implanted into the surface of the skull is proposed in this paper. These small cylindrical markers are composed of materials that make them visible in the image sets. The challenge lies in locating the subcutaneous markers in physical space. This paper presents an ultrasonic technique for transcutaneously detecting the location of these markers. The technique incorporates an algorithm based on detection of characteristic properties of the reflected A-mode ultrasonic waveform. The results demonstrate that ultrasound is an appropriate technique for accurate transcutaneous marker localization. The companion paper to this article describes an automatic, enhanced implementation of the marker-localization theory described in this article     

Volume registration using needle paths and point landmarks for evaluation of interventional MRI treatments

We created a method for three-dimensional (3-D) registration of medical images (e.g., magnetic resonance imaging (MRI) or computed tomography) to images of physical tissue sections or to other medical images and evaluated its accuracy. Our method proved valuable for evaluation of animal model experiments on interventional-MRI guided thermal ablation and on a new localized drug delivery system. The method computes an optimum set of rigid body registration parameters by minimization of the Euclidean distances between automatically chosen correspondence points, along manually selected fiducial needle paths, and optional point landmarks, using the iterative closest point algorithm. For numerically simulated experiments, using two needle paths over a range of needle orientations, mean voxel displacement errors depended mostly on needle localization error when the angle between needles was at least 20 degrees. For parameters typical of our in vivo experiments, the mean voxel displacement error was < 0.35 mm. In addition, we determined that the distance objective function was a useful diagnostic for predicting registration quality. To evaluate the registration quality of physical specimens, we computed the misregistration for a needle not considered during the optimization procedure. We registered an ex vivo sheep brain MR volume with another MR volume and tissue section photographs, using various combinations of needle and point landmarks. Mean registration error was always < or = 0.54 mm for MR-to-MR registrations and < or = 0.52 mm for MR to tissue section registrations. We also applied the method to correlate MR volumes of radio-frequency induced thermal ablation lesions with actual tissue destruction. In this case, in vivo rabbit thigh volumes were registered to photographs of ex vivo tissue sections using two needle paths. Mean registration errors were between 0.7 and 1.36 mm over all rabbits, the largest error less than two MR voxel widths. We conclude that our method provides sufficient spatial correspondence to facilitate comparison of 3-D image data with data from gross pathology tissue sections and histology.     

Designing optically tracked instruments for image-guided surgery

Most image-guided surgery (IGS) systems track the positions of surgical instruments in the physical space occupied by the patient. This task is commonly performed using an optical tracking system that determines the positions of fiducial markers such as infrared-emitting diodes or retroreflective spheres that are attached to the instrument. Instrument tracking error is an important component of the overall IGS system error. This paper is concerned with the effect of fiducial marker configuration (number and spatial distribution) on tip position tracking error. Statistically expected tip position tracking error is calculated by applying results from the point-based registration error theory developed by Fitzpatrick et al. Tracking error depends not only on the error in localizing the fiducials, which is the error value generally provided by manufacturers of optical tracking systems, but also on the number and spatial distribution of the tracking fiducials and the position of the instrument tip relative to the fiducials. The theory is extended in two ways. First, a formula is derived for the special case in which the fiducials and the tip are collinear. Second, the theory is extended for the case in which there is a composition of transformations, as is the situation for tracking an instrument relative to a coordinate reference frame (i.e., a set of fiducials attached to the patient). The derivation reveals that the previous theory may be applied independently to the two transformations; the resulting independent components of tracking error add in quadrature to give the overall tracking error. The theoretical results are verified with numerical simulations and experimental measurements. The results in this paper may be useful for the design of optically tracked instruments for image-guided surgery; this is illustrated with several examples.     

Validation of object-induced MR distortion correction for framelessstereotactic neurosurgery

Spatial fidelity is a paramount issue in image guided neurosurgery. Until recently, three-dimensional computed tomography (3D CT) has been the primary modality because it provides fast volume capture with pixel level (1 mm) accuracy. While three-dimensional magnetic resonance (3D MR) images provide superior anatomic information, published image capture protocols are time consuming and result in scanner- and object-induced magnetic field inhomogeneities which raise inaccuracy above pixel size. Using available scanner calibration software, a volumetric algorithm to correct for object-based geometric distortion, and a Fast Low Angle SHot (FLASH) 3D MR-scan protocol, the authors were able to reduce mean CT to MR skin-adhesed fiducial marker registration error from 1.36 to 1.09 mm. After dropping the worst one or two of six fiducial markers, mean registration error dropped to 0.62 mm (subpixel accuracy). Three dimensional object-induced error maps present highest 3D MR spatial infidelity at the tissue interfaces (skin/air, scalp/skull) where frameless stereotactic fiducial markers are commonly applied. The algorithm produced similar results in two patient 3D MR-scans     

Design and evaluation of a system for microscope-assisted guided interventions (MAGI)

The problem of providing surgical navigation using image overlays on the operative scene can be split into four main tasks--calibration of the optical system; registration of preoperative images to the patient; system and patient tracking, and display using a suitable visualization scheme. To achieve a convincing result in the magnified microscope view a very high alignment accuracy is required. We have simulated an entire image overlay system to establish the most significant sources of error and improved each of the stages involved. The microscope calibration process has been automated. We have introduced bone-implanted markers for registration and incorporated a locking acrylic dental stent (LADS) for patient tracking. The LADS can also provide a less-invasive registration device with mean target error of 0.7 mm in volunteer experiments. These improvements have significantly increased the alignment accuracy of our overlays. Phantom accuracy is 0.3-0.5 mm and clinical overlay errors were 0.5-1.0 mm on the bone fiducials and 0.5-4 mm on target structures. We have improved the graphical representation of the stereo overlays. The resulting system provides three-dimensional surgical navigation for microscope-assisted guided interventions (MAGI).     

A system for video-based navigation for endoscopic endonasal skull base surgery

Surgeries of the skull base require accuracy to safely navigate the critical anatomy. This is particularly the case for endoscopic endonasal skull base surgery (ESBS) where the surgeons work within millimeters of neurovascular structures at the skull base. Today's navigation systems provide approximately 2 mm accuracy. Accuracy is limited by the indirect relationship of the navigation system, the image and the patient. We propose a method to directly track the position of the endoscope using video data acquired from the endoscope camera. Our method first tracks image feature points in the video and reconstructs the image feature points to produce 3D points, and then registers the reconstructed point cloud to a surface segmented from preoperative computed tomography (CT) data. After the initial registration, the system tracks image features and maintains the 2D-3D correspondence of image features and 3D locations. These data are then used to update the current camera pose. We present a method for validation of our system, which achieves submillimeter (0.70 mm mean) target registration error (TRE) results.     

Markerless real-time 3-D target region tracking by motion backprojection from projection images

Accurate and fast localization of a predefined target region inside the patient is an important component of many image-guided therapy procedures. This problem is commonly solved by registration of intraoperative 2-D projection images to 3-D preoperative images. If the patient is not fixed during the intervention, the 2-D image acquisition is repeated several times during the procedure, and the registration problem can be cast instead as a 3-D tracking problem. To solve the 3-D problem, we propose in this paper to apply 2-D region tracking to first recover the components of the transformation that are in-plane to the projections. The 2-D motion estimates of all projections are backprojected into 3-D space, where they are then combined into a consistent estimate of the 3-D motion. We compare this method to intensity-based 2-D to 3-D registration and a combination of 2-D motion backprojection followed by a 2-D to 3-D registration stage. Using clinical data with a fiducial marker-based gold-standard transformation, we show that our method is capable of accurately tracking vertebral targets in 3-D from 2-D motion measured in X-ray projection images. Using a standard tracking algorithm (hyperplane tracking), tracking is achieved at video frame rates but fails relatively often (32% of all frames tracked with target registration error (TRE) better than 1.2 mm, 82% of all frames tracked with TRE better than 2.4 mm). With intensity-based 2-D to 2-D image registration using normalized mutual information (NMI) and pattern intensity (PI), accuracy and robustness are substantially improved. NMI tracked 82% of all frames in our data with TRE better than 1.2 mm and 96% of all frames with TRE better than 2.4 mm. This comes at the cost of a reduced frame rate, 1.7 s average processing time per frame and projection device. Results using PI were slightly more accurate, but required on average 5.4 s time per frame. These results are still substantially faster than 2-D to 3-D registration. We conclude that motion backprojection from 2-D motion tracking is an accurate and efficient method for tracking 3-D target motion, but tracking 2-D motion accurately and robustly remains a challenge.     

Surgical navigation by autostereoscopic image overlay of integral videography

This paper describes an autostereoscopic image overlay technique that is integrated into a surgical navigation system to superimpose a real three-dimensional (3-D) image onto the patient via a half-silvered mirror. The images are created by employing a modified version of integral videography (IV), which is an animated extension of integral photography. IV records and reproduces 3-D images using a microconvex lens array and flat display; it can display geometrically accurate 3-D autostereoscopic images and reproduce motion parallax without the need for special devices. The use of semitransparent display devices makes it appear that the 3-D image is inside the patient's body. This is the first report of applying an autostereoscopic display with an image overlay system in surgical navigation. Experiments demonstrated that the fast IV rendering technique and patient-image registration method produce an average registration accuracy of 1.13 mm. Experiments using a target in phantom agar showed that the system can guide a needle toward a target with an average error of 2.6 mm. Improvement in the quality of the IV display will make this system practical and its use will increase surgical accuracy and reduce invasiveness.     

Displacement estimation with co-registered ultrasound for image guided neurosurgery: a quantitative in vivo porcine study

Brain shift during open cranial surgery presents a challenge for maintaining registration with image-guidance systems. Ultrasound (US) is a convenient intraoperative imaging modality that may be a useful tool in detecting tissue shift and updating preoperative images based on intraoperative measurements of brain deformation. We have quantitatively evaluated the ability of spatially tracked freehand US to detect displacement of implanted markers in a series of three in vivo porcine experiments, where both US and computed tomography (CT) image acquisitions were obtained before and after deforming the brain. Marker displacements ranged from 0.5 to 8.5 mm. Comparisons between CT and US measurements showed a mean target localization error of 1.5 mm, and a mean vector error for displacement of 1.1 mm. Mean error in the magnitude of displacement was 0.6 mm. For one of the animals studied, the US data was used in conjunction with a biomechanical model to nonrigidly re-register a baseline CT to the deformed brain. The mean error between the actual and deformed CT's was found to be on average 1.2 and 1.9 mm at the marker locations depending on the extent of the deformation induced. These findings indicate the potential accuracy in coregistered freehand US displacement tracking in brain tissue and suggest that the resulting information can be used to drive a modeling re-registration strategy to comparable levels of agreement.     

Biomechanical modeling of the human head for physically based, nonrigid image registration

The accuracy of image-guided neurosurgery generally suffers from brain deformations due to intraoperative changes. These deformations cause significant changes of the anatomical geometry (organ shape and spatial interorgan relations), thus making intraoperative navigation based on preoperative images error prone. In order to improve the navigation accuracy, we developed a biomechanical model of the human head based on the finite element method, which can be employed for the correction of preoperative images to cope with the deformations occurring during surgical interventions. At the current stage of development, the two-dimensional (2-D) implementation of the model comprises two different materials, though the theory holds for the three-dimensional (3-D) case and is capable of dealing with an arbitrary number of different materials. For the correction of a preoperative image, a set of homologous landmarks must be specified which determine correspondences. These correspondences can be easily integrated into the model and are maintained throughout the computation of the deformation of the preoperative image. The necessary material parameter values have been determined through a comprehensive literature study. Our approach has been tested for the case of synthetic images and yields physically plausible deformation results. Additionally, we carried out registration experiments with a preoperative MR image of the human head and a corresponding postoperative image simulating an intraoperative image. We found that our approach yields good prediction results, even in the case when correspondences are given in a relatively small area of the image only.     

Fast and accurate automatic registration for MR-guided procedures using active microcoils

A fast, robust, accurate, and automatic registration technique based on magnetic resonance (MR) active microcoils (active markers) for registration of tracked medical devices to preprocedural MR-images is presented. This allows for a straight-forward integration of position measurement systems into clinical procedures. The presented method is useful for guidance purposes in clinical applications with high demands on accuracy and ease-of-use (e.g., neurosurgical or orthopedic applications). The determination of the positions of the active markers is integrated into the preparation phase of the actual MR imaging scan. The technique features a generic interface using DICOM standards for communication with navigation workstations linked to an MR system. The position of the active markers is fixed with respect to a reference system of an optical positioning measurement system (OPMS) and thus the coregistration of the MR system and the OPMS is established. In a phantom study, a mean overall targeting accuracy of 0.9+/-0.1 mm was achieved and compared favorably to results obtained from manual registration tests (1.8+/-0.3 mm) carried out in parallel. For a test person trained for both registration methods, workflow improvements of 3-6 min per registration step were found. The need for manual interaction is entirely eliminated thus avoiding user-bias, which is advantageous for the usage in clinical routine. The method improves the ease-of-use of tracking equipment during stereotactic guidance. The method is finally demonstrated in a volunteer study using a model of a Mayfield skull clamp with integrated active and optical reference markers.