Automated contour detection in X-ray left ventricular angiograms using multiview active appearance models and dynamic programming

This paper describes a new approach to the automated segmentation of X-ray left ventricular (LV) angiograms, based on active appearance models (AAMs) and dynamic programming. A coupling of shape and texture information between the end-diastolic (ED) and end-systolic (ES) frame was achieved by constructing a multiview AAM. Over-constraining of the model was compensated for by employing dynamic programming, integrating both intensity and motion features in the cost function. Two applications are compared: a semi-automatic method with manual model initialization, and a fully automatic algorithm. The first proved to be highly robust and accurate, demonstrating high clinical relevance. Based on experiments involving 70 patient data sets, the algorithm's success rate was 100% for ED and 99% for ES, with average unsigned border positioning errors of 0.68 mm for ED and 1.45 mm for ES. Calculated volumes were accurate and unbiased. The fully automatic algorithm, with intrinsically less user interaction was less robust, but showed a high potential, mostly due to a controlled gradient descent in updating the model parameters. The success rate of the fully automatic method was 91% for ED and 83% for ES, with average unsigned border positioning errors of 0.79 mm for ED and 1.55 mm for ES.     

Ovarian ultrasound image analysis: follicle segmentation

Ovarian ultrasound is an effective tool in infertility treatment. Repeated measurements of the size and shape of follicles over several days are the primary means of evaluation by physicians. Currently, follicle wall segmentation is achieved by manual tracing which is time consuming and susceptible to inter-operator variation. An automated method for follicle wall segmentation is reported that uses a four-step process based on watershed segmentation and knowledge-based graph search algorithm which utilizes priori information about follicle structure for inner and outer wall detection. The automated technique was tested on 36 ultrasonographic images of women's ovaries. Validation against manually traced borders has shown good correlation of manually defined and computer-determined area measurements (R2 = 0.85 - 0.96). The border positioning errors were small: 0.63+/-0.36 mm for inner border and 0.67+/-0.41 mm for outer border detection. The use of watershed segmentation and graph search methods facilitates fast, accurate inner and outer border detection with minimal user-interaction.     

Three-dimensional segmentation of fluid-associated abnormalities in retinal OCT: probability constrained graph-search-graph-cut

An automated method is reported for segmenting 3-D fluid-associated abnormalities in the retina, so-called symptomatic exudate-associated derangements (SEAD), from 3-D OCT retinal images of subjects suffering from exudative age-related macular degeneration. In the first stage of a two-stage approach, retinal layers are segmented, candidate SEAD regions identified, and the retinal OCT image is flattened using a candidate-SEAD aware approach. In the second stage, a probability constrained combined graph search-graph cut method refines the candidate SEADs by integrating the candidate volumes into the graph cut cost function as probability constraints. The proposed method was evaluated on 15 spectral domain OCT images from 15 subjects undergoing intravitreal anti-VEGF injection treatment. Leave-one-out evaluation resulted in a true positive volume fraction (TPVF), false positive volume fraction (FPVF) and relative volume difference ratio (RVDR) of 86.5%, 1.7%, and 12.8%, respectively. The new graph cut-graph search method significantly outperformed both the traditional graph cut and traditional graph search approaches (p < 0.01, p < 0.04) and has the potential to improve clinical management of patients with choroidal neovascularization due to exudative age-related macular degeneration.     

Segmentation of intrathoracic airway trees: a fuzzy logic approach

Three-dimensional (3-D) analysis of airway trees extracted from computed tomography (CT) image data can provide objective information about lung structure and function. However, manual analysis of 3-D lung CT images is tedious, time consuming and, thus, impractical for routine clinical care. The authors have previously reported an automated rule-based method for extraction of airway trees from 3-D CT images using a priori knowledge about airway-tree anatomy. Although the method's sensitivity was quite good, its specificity suffered from a large number of falsely detected airways. The authors present a new approach to airway-tree detection based on fuzzy logic that increases the method's specificity without compromising its sensitivity. The method was validated in 32 CT image slices randomly selected from five volumetric canine electron-beam CT data sets. The fuzzy-logic method significantly outperformed the previously reported rule-based method (p<0.002)     

Lumen centerline detection in complex coronary angiograms

The authors have developed a method for lumen centerline detection in individual coronary segments that is based on simultaneous detection of the approximate positions of the left and right coronary borders. This approach emulates that of a clinician who visually identifies the lumen centerline as the midline between the simultaneously-determined left and right borders of the vessel segment of interest. The authors' lumen centerline detection algorithm and 2 conventional centerline detection methods were compared to carefully-defined observer-identified centerlines in 89 complex coronary images. Computer-detected and observer-defined centerlines were objectively compared using 5 indices of center line position and orientation. The quality of centerlines obtained with the new simultaneous border identification approach and the 2 conventional centerline detection methods was also subjectively assessed by an experienced cardiologist who was unaware of the analysis method. The authors' centerline detection method yielded accurate centerlines in the 89 complex images. Moreover, their method outperformed the 2 conventional methods as judged by all 5 objective parameters (p<0.001 for each parameter) and by the subjective assessment of centerline quality (p<0.001). Automated detection of lumen centerlines based on simultaneous detection of both coronary borders provides improved accuracy in complex coronary arteriograms     

Image systems engineering education in an electronic classroom

Digital imaging technologies have now developed to the point where engineers specializing in image systems engineering are needed in order for imaging to reach its full potential, In 1996, the University of Iowa launched a multiphase project for the development of a well-structured interdisciplinary image systems engineering curriculum with both depth and breadth in its offerings. This project has been supported by equipment grants from the Hewlett Packard Company. The new teaching approach that we are developing is very dissimilar to the blackboard-and-chalk approach we used in previous years. Utilizing a 40-seat electronic classroom, lectures consist of presentation of concepts, immediately followed by examples, and practical exploratory problems. Four image processing classes have been offered in the new collaborative learning environment during the 1996-1997 academic year. This paper outlines the employed educational approach we are taking and summarizes our experience in the first year     

MDCT-based 3-D texture classification of emphysema and early smoking related lung pathologies

Our goal is to enhance the ability to differentiate normal lung from subtle pathologies via multidetector row CT (MDCT) by extending a two-dimensional (2-D) texturebased tissue classification [adaptive multiple feature method (AMFM)] to use three-dimensional (3-D) texture features. We performed MDCT on 34 humans and classified volumes of interest (VOIs) in the MDCT images into five categories: EC, emphysema in severe chronic obstructive pulmonary disease (COPD); MC, mild emphysema in mild COPD; NC, normal appearing lung in mild COPD; NN, normal appearing lung in normal nonsmokers; and NS, normal appearing lung in normal smokers. COPD severity was based upon pulmonary function tests (PFTs). Airways and vessels were excluded from VOIs; 24 3-D texture features were calculated; and a Bayesian classifier was used for discrimination. A leave-one-out method was employed for validation. Sensitivity of the four-class classification in the form of 3-D/2-D was: EC: 85%/71%, MC: 90%/82%; NC: 88%/50%; NN: 100%/60%. Sensitivity and specificity for NN using a two-class classification of NN and NS in the form of 3-D/2-D were: 99%/72% and 100%/75%, respectively. We conclude that 3-D AMFM analysis of lung parenchyma improves discrimination compared to 2-D AMFM of the same VOIs. Furthermore, our results suggest that the 3-D AMFM may provide a means of discriminating subtle differences between smokers and nonsmokers both with normal PFTs.     

Optimal multiple-seams search for image resizing with smoothness and shape prior

Content-aware image resizing is of increasing relevance to allow high-quality image and video to be displayed on devices with different resolution. We present a novel method to find multiple seams simultaneously with global optimality for image resizing, incorporating both region smoothness and seam shape prior using a 3-D graph-theoretic approach. The globally optimal seams can be simultaneously achieved by solving a maximum flow problem based on an arc-weighted graph representation. Representing the resizing problem in an arc-weighted graph, we can incorporate a wide spectrum of constraints into the formulation, thus improving resizing results. By removing or inserting those multiple seams, the goal of content-aware image resizing is achieved. Due to simultaneous detection of multiple seams, our algorithm exhibits several good features: the ability to handle both crossing and non-crossing-seam cases, the ability to incorporate various feasible geometry constraints, and the ability to incorporate the seams importance, region smoothness and shape prior information. The proposed method was implemented and experimented on a variety of image data and compared with the state of the art in image resizing.     

Automated analysis of brachial ultrasound image sequences: early detection of cardiovascular disease via surrogates of endothelial function

Early detection of cardiovascular disease would allow timely institution of preventive measures. Arterial endothelium play a primary role in processes leading to the development of atherosclerotic plaque and cardiovascular disease in general. Determination of flow-mediated dilatation (FMD) of brachial arteries from B-mode ultrasound image sequences offers a noninvasive surrogate index of endothelial function. A highly automated method for analysis of brachial ultrasound image sequences is reported and its performance assessed. The method overcomes the variability of brachial ultrasound images across subjects by incorporating machine learning and quality control steps. The automated method outperformed conventional manual analysis by providing a decreased analysis bias, increased reproducibility, and improved measurement accuracy. Consequently, it decreases inter- and intraobserver as well interinstitution variability. The method has been employed in a number of population studies with thousands of subjects analyzed.     

Optimal surface segmentation in volumetric images--a graph-theoretic approach

Efficient segmentation of globally optimal surfaces representing object boundaries in volumetric data sets is important and challenging in many medical image analysis applications. We have developed an optimal surface detection method capable of simultaneously detecting multiple interacting surfaces, in which the optimality is controlled by the cost functions designed for individual surfaces and by several geometric constraints defining the surface smoothness and interrelations. The method solves the surface segmentation problem by transforming it into computing a minimum s-t cut in a derived arc-weighted directed graph. The proposed algorithm has a low-order polynomial time complexity and is computationally efficient. It has been extensively validated on more than 300 computer-synthetic volumetric images, 72 CT-scanned data sets of different-sized plexiglas tubes, and tens of medical images spanning various imaging modalities. In all cases, the approach yielded highly accurate results. Our approach can be readily extended to higher-dimensional image segmentation.