Segmentation of brain MR images through a hidden Markov random field model and the expectation-maximization algorithm

The finite mixture (FM) model is the most commonly used model for statistical segmentation of brain magnetic resonance (MR) images because of its simple mathematical form and the piecewise constant nature of ideal brain MR images. However, being a histogram-based model, the FM has an intrinsic limitation--no spatial information is taken into account. This causes the FM model to work only on well-defined images with low levels of noise; unfortunately, this is often not the the case due to artifacts such as partial volume effect and bias field distortion. Under these conditions, FM model-based methods produce unreliable results. In this paper, we propose a novel hidden Markov random field (HMRF) model, which is a stochastic process generated by a MRF whose state sequence cannot be observed directly but which can be indirectly estimated through observations. Mathematically, it can be shown that the FM model is a degenerate version of the HMRF model. The advantage of the HMRF model derives from the way in which the spatial information is encoded through the mutual influences of neighboring sites. Although MRF modeling has been employed in MR image segmentation by other researchers, most reported methods are limited to using MRF as a general prior in an FM model-based approach. To fit the HMRF model, an EM algorithm is used. We show that by incorporating both the HMRF model and the EM algorithm into a HMRF-EM framework, an accurate and robust segmentation can be achieved. More importantly, the HMRF-EM framework can easily be combined with other techniques. As an example, we show how the bias field correction algorithm of Guillemaud and Brady (1997) can be incorporated into this framework to achieve a three-dimensional fully automated approach for brain MR image segmentation.     

Atlas-based segmentation of pathological MR brain images using a model of lesion growth

We propose a method for brain atlas deformation in the presence of large space-occupying tumors, based on an a priori model of lesion growth that assumes radial expansion of the lesion from its starting point. Our approach involves three steps. First, an affine registration brings the atlas and the patient into global correspondence. Then, the seeding of a synthetic tumor into the brain atlas provides a template for the lesion. The last step is the deformation of the seeded atlas, combining a method derived from optical flow principles and a model of lesion growth. Results show that a good registration is performed and that the method can be applied to automatic segmentation of structures and substructures in brains with gross deformation, with important medical applications in neurosurgery, radiosurgery, and radiotherapy.     

Segmentation of textured images using a multiresolution Gaussianautoregressive model

We present a new algorithm for segmentation of textured images using a multiresolution Bayesian approach. The new algorithm uses a multiresolution Gaussian autoregressive (MGAR) model for the pyramid representation of the observed image, and assumes a multiscale Markov random field model for the class label pyramid. The models used in this paper incorporate correlations between different levels of both the observed image pyramid and the class label pyramid. The criterion used for segmentation is the minimization of the expected value of the number of misclassified nodes in the multiresolution lattice. The estimate which satisfies this criterion is referred to as the "multiresolution maximization of the posterior marginals" (MMPM) estimate, and is a natural extension of the single-resolution "maximization of the posterior marginals" (MPM) estimate. Previous multiresolution segmentation techniques have been based on the maximum a posterior (MAP) estimation criterion, which has been shown to be less appropriate for segmentation than the MPM criterion. It is assumed that the number of distinct textures in the observed image is known. The parameters of the MGAR model-the means, prediction coefficients, and prediction error variances of the different textures-are unknown. A modified version of the expectation-maximization (EM) algorithm is used to estimate these parameters. The parameters of the Gibbs distribution for the label pyramid are assumed to be known. Experimental results demonstrating the performance of the algorithm are presented.     

Registration of 3-D intraoperative MR images of the brain using a finite-element biomechanical model

We present a new algorithm for the nonrigid registration of three-dimensional magnetic resonance (MR) intraoperative image sequences showing brain shift. The algorithm tracks key surfaces of objects (cortical surface and the lateral ventricles) in the image sequence using a deformable surface matching algorithm. The volumetric deformation field of the objects is then inferred from the displacements at the boundary surfaces using a linear elastic biomechanical finite-element model. Two experiments on synthetic image sequences are presented, as well as an initial experiment on intraoperative MR images showing brain shift. The results of the registration algorithm show a good correlation of the internal brain structures after deformation, and a good capability of measuring surface as well as subsurface shift. We measured distances between landmarks in the deformed initial image and the corresponding landmarks in the target scan. Cortical surface shifts of up to 10 mm and subsurface shifts of up to 6 mm were recovered with an accuracy of 1 mm or less and 3 mm or less respectively.     

Segmentation of brain parenchyma and cerebrospinal fluid in multispectral magnetic resonance images

Presents a new method to segment brain parenchyma and cerebrospinal fluid spaces automatically in routine axial spin echo multispectral MR images. The algorithm simultaneously incorporates information about anatomical boundaries (shape) and tissue signature (grey scale) using a priori knowledge. The head and brain are divided into four regions and seven different tissue types. Each tissue type c is modeled by a multivariate Gaussian distribution N(mu(c),Sigma(c)). Each region is associated with a finite mixture density corresponding to its constituent tissue types. Initial estimates of tissue parameters {mu(c),Sigma(c )}(c=1,...,7) are obtained from k-means clustering of a single slice used for training. The first algorithmic step uses the EM-algorithm for adjusting the initial tissue parameter estimates to the MR data of new patients. The second step uses a recently developed model of dynamic contours to detect three simply closed nonintersecting curves in the plane, constituting the arachnoid/dura mater boundary of the brain, the border between the subarachnoid space and brain parenchyma, and the inner border of the parenchyma toward the lateral ventricles. The model, which is formulated by energy functions in a Bayesian framework, incorporates a priori knowledge, smoothness constraints, and updated tissue type parameters. Satisfactory maximum a posteriori probability estimates of the closed contour curves defined by the model were found using simulated annealing.     

Labeling of MR brain images using Boolean neural network

Presents a knowledge-based approach for labeling two-dimensional (2-D) magnetic resonance (MR) brain images using the Boolean neural network (BNN), which has binary inputs and outputs, integer weights, fast learning and classification, and guaranteed convergence. The approach consists of two components: a BNN clustering algorithm and a constraint satisfying Boolean neural network (CSBNN) labeling procedure. The BNN clustering algorithm is developed to initially segment an image into a number of regions. Then the segmented regions are labeled with the CSBNN, which is a modified version of BNN. The CSBNN uses a knowledge base that contains information on image-feature space and tissue models as constraints. The method is tested using sets of MR brain images. The regions of the different brain tissues are satisfactorily segmented and labeled. A comparison with the Hopfield neural network and the traditional simulated annealing method for image labeling is provided. The comparison results show that the CSBNN approach offers a fast, feasible, and reliable alternative to the existing techniques for medical image labeling.     

Unwrapping of MR phase images using a Markov random field model

Phase unwrapping is an important problem in many magnetic resonance imaging applications, such as field mapping and flow imaging. The challenge in two-dimensional phase unwrapping lies in distinguishing jumps due to phase wrapping from those due to noise and/or abrupt variations in the actual function. This paper addresses this problem using a Markov random field to model the true phase function, whose parameters are determined by maximizing the a posteriori probability. To reduce the computational complexity of the optimization procedure, an efficient algorithm is also proposed for parameter estimation using a series of dynamic programming connected by the iterated conditional modes. The proposed method has been tested with both simulated and experimental data, yielding better results than some of the state-of-the-art method (e.g., the popular least-squares method) in handling noisy phase images with rapid phase variations.     

Atlas-based segmentation of neonatal brain MR images using a gray matter enhancing step

We propose an atlas-based segmentation framework for brain magnetic resonance images, specially designed to fit neonatal images, which pose additional difficulties due to the poor differentiation between the gray and white matter. The main contribution of our work consists of a gray matter enhancing step, which is applied to either the T1w or T2w modalities after standard preprocessing and alignment steps are carried out. Our enhancing step uses Hessian and box filters for the cortical gray matter and takes advantage of both local and non-local information for the subcortical gray matter. We consider four classes, and our framework has been evaluated using publicly available data from the NeoBrainS12 challenge.     

Classification of anatomical structures in MR brain images using fuzzy parameters

We present an algorithm that automatically segments and classifies the brain structures in a set of magnetic resonance (MR) brain images using expert information contained in a small subset of the image set. The algorithm is intended to do the segmentation and classification tasks mimicking the way a human expert would reason. The algorithm uses a knowledge base taken from a small subset of semiautomatically classified images that is combined with a set of fuzzy indexes that capture the experience and expectation a human expert uses during recognition tasks. The fuzzy indexes are tissue specific and spatial specific, in order to consider the biological variations in the tissues and the acquisition inhomogeneities through the image set. The brain structures are segmented and classified one at a time. For each brain structure the algorithm needs one semiautomatically classified image and makes one pass through the image set. The algorithm uses low-level image processing techniques on a pixel basis for the segmentations, then validates or corrects the segmentations, and makes the final classification decision using higher level criteria measured by the set of fuzzy indexes. We use single-echo MR images because of their high volumetric resolution; but even though we are working with only one image per brain slice, we have multiple sources of information on each pixel: absolute and relative positions in the image, gray level value, statistics of the pixel and its three-dimensional neighborhood and relation to its counterpart pixels in adjacent images. We have validated our algorithm for ease of use and precision both with clinical experts and with measurable error indexes over a Brainweb simulated MR set.     

Knowledge-based interpretation of MR brain images

The authors have developed a method for fully automated segmentation and labeling of 17 neuroanatomic structures such as thalamus, caudate nucleus, ventricular system, etc. in magnetic resonance (MR) brain images. The authors' method is based on a hypothesize-and-verify principle and uses a genetic algorithm (GA) optimization technique to generate and evaluate image interpretation hypotheses in a feedback loop. The authors' method was trained in 20 individual T1-weighted MR images. Observer-defined contours of neuroanatomic structures were used as a priori knowledge. The method's performance was validated in eight MR images by comparison to observer-defined independent standards. The GA-based image interpretation method correctly interpreted neuroanatomic structures in all images from the test set. Computer-identified and observer-defined neuroanatomic structure areas correlated very well (r=0.99, y=0,95x-2.1). Border positioning errors were small, with a root mean square (rms) border positioning error of 1.5+/-0.6 pixels. The authors' GA-based image interpretation method represents a novel approach to image interpretation and has been shown to produce accurate labeling of neuroanatomic structures in a set of MR brain images.     

Segmentation of prostate boundaries from ultrasound images using statistical shape model

This paper presents a statistical shape model for the automatic prostate segmentation in transrectal ultrasound images. A Gabor filter bank is first used to characterize the prostate boundaries in ultrasound images in both multiple scales and multiple orientations. The Gabor features are further reconstructed to be invariant to the rotation of the ultrasound probe and incorporated in the prostate model as image attributes for guiding the deformable segmentation. A hierarchical deformation strategy is then employed, in which the model adaptively focuses on the similarity of different Gabor features at different deformation stages using a multiresolution technique, i.e., coarse features first and fine features later. A number of successful experiments validate the algorithm.     

Segmentation and measurement of the cortex from 3-D MR images using coupled-surfaces propagation

The cortex is the outermost thin layer of gray matter in the brain; geometric measurement of the cortex helps in understanding brain anatomy and function. In the quantitative analysis of the cortex from MR images, extracting the structure and obtaining a representation for various measurements are key steps. While manual segmentation is tedious and labor intensive, automatic reliable efficient segmentation and measurement of the cortex remain challenging problems, due to its convoluted nature. Here we present a new approach of coupled-surfaces propagation, using level set methods to address such problems. Our method is motivated by the nearly constant thickness of the cortical mantle and takes this tight coupling as an important constraint. By evolving two embedded surfaces simultaneously, each driven by its own image-derived information while maintaining the coupling, a final representation of the cortical bounding surfaces and an automatic segmentation of the cortex are achieved. Characteristics of the cortex, such as cortical surface area, surface curvature, and cortical thickness, are then evaluated. The level set implementation of surface propagation offers the advantage of easy initialization, computational efficiency, and the ability to capture deep sulcal folds. Results and validation from various experiments on both simulated and real three-dimensional (3-D) MR images are provided.     

Segmentation of medical images using LEGION

Advances in visualization technology and specialized graphic workstations allow clinicians to virtually interact with anatomical structures contained within sampled medical-image datasets. A hindrance to the effective use of this technology is the difficult problem of image segmentation. In this paper, we utilize a recently proposed oscillator network called the locally excitatory globally inhibitory oscillator network (LEGION) whose ability to achieve fast synchrony with local excitation and desynchrony with global inhibition makes it an effective computational framework for grouping similar features and segregating dissimilar ones in an image. We extract an algorithm from LEGION dynamics and propose an adaptive scheme for grouping. We show results of the algorithm to two-dimensional (2-D) and three-dimensional (3-D) (volume) computerized topography (CT) and magnetic resonance imaging (MRI) medical-image datasets. In addition, we compare our algorithm with other algorithms for medical-image segmentation, as well as with manual segmentation. LEGION's computational and architectural properties make it a promising approach for real-time medical-image segmentation.     

Constrained Gaussian mixture model framework for automatic segmentation of MR brain images

An automated algorithm for tissue segmentation of noisy, low-contrast magnetic resonance (MR) images of the brain is presented. A mixture model composed of a large number of Gaussians is used to represent the brain image. Each tissue is represented by a large number of Gaussian components to capture the complex tissue spatial layout. The intensity of a tissue is considered a global feature and is incorporated into the model through tying of all the related Gaussian parameters. The expectation-maximization (EM) algorithm is utilized to learn the parameter-tied, constrained Gaussian mixture model. An elaborate initialization scheme is suggested to link the set of Gaussians per tissue type, such that each Gaussian in the set has similar intensity characteristics with minimal overlapping spatial supports. Segmentation of the brain image is achieved by the affiliation of each voxel to the component of the model that maximized the a posteriori probability. The presented algorithm is used to segment three-dimensional, T1-weighted, simulated and real MR images of the brain into three different tissues, under varying noise conditions. Results are compared with state-of-the-art algorithms in the literature. The algorithm does not use an atlas for initialization or parameter learning. Registration processes are therefore not required and the applicability of the framework can be extended to diseased brains and neonatal brains.     

Automatic segmentation of subcortical brain structures in MR images using information fusion

This paper reports a new automated method for the segmentation of internal cerebral structures using an information fusion technique. The information is provided both by images and expert knowledge, and consists in morphological, topological, and tissue constitution data. All this ambiguous, complementary and redundant information is managed using a three-step fusion scheme based on fuzzy logic. The information is first modeled into a common theoretical frame managing its imprecision and incertitude. The models are then fused and a decision is taken in order to reduce the imprecision and to increase the certainty in the location of the structures. The whole process is illustrated on the segmentation of thalamus, putamen, and head of the caudate nucleus from expert knowledge and magnetic resonance images, in a protocol involving 14 healthy volunteers. The quantitative validation is achieved by comparing computed, manually segmented structures and published data by means of indexes assessing the accuracy of volume estimation and spatial location. Results suggest a consistent volume estimation with respect to the expert quantification and published data, and a high spatial similarity of the segmented and computed structures. This method is generic and applicable to any structure that can be defined by expert knowledge and morphological images.     

Learning-based deformable registration of MR brain images

This paper presents a learning-based method for deformable registration of magnetic resonance (MR) brain images. There are two novelties in the proposed registration method. First, a set of best-scale geometric features are selected for each point in the brain, in order to facilitate correspondence detection during the registration procedure. This is achieved by optimizing an energy function that requires each point to have its best-scale geometric features consistent over the corresponding points in the training samples, and at the same time distinctive from those of nearby points in the neighborhood. Second, the active points used to drive the brain registration are hierarchically selected during the registration procedure, based on their saliency and consistency measures. That is, the image points with salient and consistent features (across different individuals) are considered for the initial registration of two images, while other less salient and consistent points join the registration procedure later. By incorporating these two novel strategies into the framework of the HAMMER registration algorithm, the registration accuracy has been improved according to the results on simulated brain data, and also visible improvement is observed particularly in the cortical regions of real brain data.     

Automatic registration of CT and MR brain images using correlation of geometrical features

Describes an automated approach to register CT and MR brain images. Differential operators in scale space are applied to each type of image data, so as to produce feature images depicting "ridgeness". The resulting CT and MR feature images show similarities which can be used for matching. No segmentation is needed and the method is devoid of human interaction. The matching is accomplished by hierarchical correlation techniques. Results of 2-D and 3-D matching experiments are presented. The correlation function ensures an accurate match even if the scanned volumes to be matched do not completely overlap, or if some of the features in the images are not similar.     

Segmentation of echocardiographic images using mathematical morphology

A semiautomatic technique for isolating the ventricular endocardial border in echocardiograms from a commercially available two-dimensional phased array ultrasound system is presented. This method processes echo images using mathematical morphology to reduce the effects of range and azimuth variation inherent in echo. After morphological filtering, the endocardial border is extracted with traditional segmentation methods. Further processing of the resulting border using binary morphology produces a region of interest suitable for derivation of motion parameters of the endocardium. The area and the shape of semiautomatically-derived regions correlate well (r>0.93) with those defined by expert observers in a study of induced ischemia in seven canines.<>