Interactive image segmentation via kernel propagation

In this paper, we propose a new approach to interactive image segmentation via kernel propagation (KP), called KP Cut. The key to success in interactive image segmentation is to preserve characteristics of the user?s interactive input and maintain data-coherence effectively. To achieve this, we employ KP which is very effective in propagating the given supervised information into the entire data set. KP first learns a small-size seed-kernel matrix, and then propagates it into a large-size full-kernel matrix. It is based on a learned kernel, and thus can fit the given data better than a predefined kernel. Based on KP, we first generate a small-size seed-kernel matrix from the user?s interactive input. Then, the seed-kernel matrix is propagated into the full-kernel matrix of the entire image. During the propagation, foreground objects are effectively segmented from background. Experimental results demonstrate that KP Cut effectively extracts foreground objects from background, and outperforms the state-of-the-art methods for interactive image segmentation.     

Semi-supervised statistical region refinement for color image segmentation

Some authors have recently devised adaptations of spectral grouping algorithms to integrate prior knowledge, as constrained eigenvalues problems. In this paper, we improve and adapt a recent statistical region merging approach to this task, as a non-parametric mixture model estimation problem. The approach appears to be attractive both for its theoretical benefits and its experimental results, as slight bias brings dramatic improvements over unbiased approaches on challenging digital pictures.     

Leukocyte image segmentation using simulated visual attention

Computer-aided automatic analysis of microscopic leukocyte is a powerful diagnostic tool in biomedical fields which could reduce the effects of human error, improve the diagnosis accuracy, save manpower and time. However, it is a challenging to segment entire leukocyte populations due to the changing features extracted in the leukocyte image, and this task remains an unsolved issue in blood cell image segmentation. This paper presents an efficient strategy to construct a segmentation model for any leukocyte image using simulated visual attention via learning by on-line sampling. In the sampling stage, two types of visual attention, “bottom-up” and “top-down” together with the movement of the human eye are simulated. We focus on a few regions of interesting and sample high gradient pixels to group training sets. While in the learning stage, the SVM (support vector machine) model is trained in real-time to simulate the visual neuronal system and then classifies pixels and extracts leukocytes from the image. Experimental results show that the proposed method has better performance compared to the marker controlled watershed algorithms with manual intervention and thresholding-based methods.     

User-centric image segmentation using an interactive parameter adaptation tool

Creating successful machine vision systems often begins a process of developing customised reliable image segmentation algorithms for the detection, and possibly categorisation of regions of interest within images. This can require significant investment of time from both the image processing and the domain experts to set up. Frequently this process is mediated via interviews, or language-based systems which may not fully capture the visual decision-making process of the domain experts. The resulting algorithms can also often be “brittle” in the sense of being highly specialised to the task for which they are tuned, and are consequently sensitive to changes in operating conditions or image specifications.One approach is to use interactive evolution for developing rapidly reconfigurable systems in which the users’ tacit knowledge and requirements can be elicited and used for finding the appropriate parameters to achieve the required segmentation without any need for specialised knowledge of the underlying machine vision systems. This paper presents an interactive tool that can be used to quickly and easily evolve optimal image segmentation parameters from scratch. Building on previous work, the new algorithm reported here incorporates user-guided local search and makes the fitness function more flexible to facilitate the underlying multi-objective decision-making process.One of the key requirements for any interactive system is a high level of usability, both in terms of effectiveness—being able to build accurate models that meet end-user requirements—and efficiency—being able to achieve the required results within a minimal amount of time and undue effort. The system described in this paper has been designed with these considerations in mind to ensure a high level of user-experience of the interaction process. We present results from a series of experiments with a range of users to analyse the effect of the improvements that have been made over the previous system. The efficiency of the tool is also tested with “novice users”, and its usability by “novice users” is analysed.     

Interactive image segmentation by maximal similarity based region merging

Efficient and effective image segmentation is an important task in computer vision and object recognition. Since fully automatic image segmentation is usually very hard for natural images, interactive schemes with a few simple user inputs are good solutions. This paper presents a new region merging based interactive image segmentation method. The users only need to roughly indicate the location and region of the object and background by using strokes, which are called markers. A novel maximal-similarity based region merging mechanism is proposed to guide the merging process with the help of markers. A region R is merged with its adjacent region Q if Q has the highest similarity with Q among all Q's adjacent regions. The proposed method automatically merges the regions that are initially segmented by mean shift segmentation, and then effectively extracts the object contour by labeling all the non-marker regions as either background or object. The region merging process is adaptive to the image content and it does not need to set the similarity threshold in advance. Extensive experiments are performed and the results show that the proposed scheme can reliably extract the object contour from the complex background.     

Automatic image segmentation using constraint learning and propagation

In this paper, we propose automatic image segmentation using constraint learning and propagation. Recently, kernel learning is receiving much attention because a learned kernel can fit the given data better than a predefined kernel. To effectively learn the constraints generated by initial seeds for image segmentation, we employ kernel propagation (KP) based on kernel learning. The key idea of KP is first to learn a small-sized seed-kernel matrix and then propagate it into a large-sized full-kernel matrix. By applying KP to automatic image segmentation, we design a novel segmentation method to achieve high performance. First, we generate pairwise constraints, i.e., must-link and cannot-link, from initially selected seeds to make the seed-kernel matrix. To select the optimal initial seeds, we utilize global k-means clustering (GKM) and self-tuning spectral clustering (SSC). Next, we propagate the seed-kernel matrix into the full-kernel matrix of the entire image, and thus image segmentation results are obtained. We test our method on the Berkeley segmentation database, and the experimental results demonstrate that the proposed method is very effective in automatic image segmentation.     

Interactive 3D medical image segmentation with energy-minimizing implicit functions

We present an interactive segmentation method for 3D medical images that reconstructs the surface of an object using energy-minimizing, smooth, implicit functions. This reconstruction problem is called variational interpolation. For an intuitive segmentation of medical images, variational interpolation can be based on a set of user-drawn, planar contours that can be arbitrarily oriented in 3D space. This also allows an easy integration of the algorithm into the common manual segmentation workflow, where objects are segmented by drawing contours around them on each slice of a 3D image.Because variational interpolation is computationally expensive, we show how to speed up the algorithm to achieve almost real-time calculation times while preserving the overall segmentation quality. Moreover, we show how to improve the robustness of the algorithm by transforming it from an interpolation to an approximation problem and we discuss a local interpolation scheme.A first evaluation of our algorithm by two experienced radiology technicians on 15 liver metastases and 1 liver has shown that the segmentation times can be reduced by a factor of about 2 compared to a slice-wise manual segmentation and only about one fourth of the contours are necessary compared to the number of contours necessary for a manual segmentation.     

Multiphase image segmentation using a phase-field model

In this paper, we propose a new, fast, and stable hybrid numerical method for multiphase image segmentation using a phase-field model. The proposed model is based on the Allen-Cahn equation with a multiple well potential and a data-fitting term. The model is computationally superior to the previous multiphase image segmentation via Modica-Mortola phase transition and a fitting term. We split its numerical solution algorithm into linear and a nonlinear equations. The linear equation is discretized using an implicit scheme and the resulting discrete system of equations is solved by a fast numerical method such as a multigrid method. The nonlinear equation is solved analytically due to the availability of a closed-form solution. We also propose an initialization algorithm based on the target objects for the fast image segmentation. Finally, various numerical experiments on real and synthetic images with noises are presented to demonstrate the efficiency and robustness of the proposed model and the numerical method.     

Automating image segmentation verification and validation by learning test oracles

An image segmentation algorithm delineates (an) object(s) of interest in an image. Its output is referred to as a segmentation. Developing these algorithms is a manual, iterative process involving repetitive verification and validation tasks. This process is time-consuming and depends on the availability of experts, who may be a scarce resource (e.g., medical experts). We propose a framework referred to as Image Segmentation Automated Oracle (ISAO) that uses machine learning to construct an oracle, which can then be used to automatically verify the correctness of image segmentations, thus saving substantial resources and making the image segmentation verification and validation task significantly more efficient. The framework also gives informative feedback to the developer as the segmentation algorithm evolves and provides a systematic means of testing different parametric configurations of the algorithm. During the initial learning phase, segmentations from the first few (optimally two) versions of the segmentation algorithm are manually verified by experts. The similarity of successive segmentations of the same images is also measured in various ways. This information is then fed to a machine learning algorithm to construct a classifier that distinguishes between consistent and inconsistent segmentation pairs (as determined by an expert) based on the values of the similarity measures associated with each segmentation pair. Once the accuracy of the classifier is deemed satisfactory to support a consistency determination, the classifier is then used to determine whether the segmentations that are produced by subsequent versions of the algorithm under test, are (in)consistent with already verified segmentations from previous versions. This information is then used to automatically draw conclusions about the correctness of the segmentations. We have successfully applied this approach to 3D segmentations of the cardiac left ventricle obtained from CT scans and have obtained promising results (accuracies of 95%). Even though more experiments are needed to quantify the effectiveness of the approach in real-world applications, ISAO shows promise in increasing the quality and testing efficiency of image segmentation algorithms.     

局部颜色模型的交互式Graph-Cut分割算法

由于目前大多数交互式Graph-Cut分割算法很难达到精确分割且实时交互的效果.对此,提出一种基于局部颜色模型的改进算法.该算法利用Mean-Shift预分割,建立基于局部颜色模型的交互式分割框架,并将像素级的Graph-Cut算法转化为基于区域的算法进行快速求解.预分割之后的区域保持了原有图像的结构,不仅提高了采用局部颜色模型估计分布的准确性,而且基于区域Graph-Cut的算法明显降低了计算的复杂度.实验结果表明,改进后的算法不仅保证了分割的精确性,而且还达到了实时交互.     

Multispectral image compression using eigenregion-based segmentation

In the study, a novel segmentation technique is proposed for multispectral satellite image compression. A segmentation decision rule composed of the principal eigenvectors of the image correlation matrix is derived to determine the similarity of image characteristics of two image blocks. Based on the decision rule, we develop an eigenregion-based segmentation technique. The proposed segmentation technique can divide the original image into some proper eigenregions according to their local terrain characteristics. To achieve better compression efficiency, each eigenregion image is then compressed by an efficient compression algorithm eigenregion-based eigensubspace transform (ER-EST). The ER-EST contains 1D eigensubspace transform (EST) and 2D-DCT to decorrelate the data in spectral and spatial domains. Before performing EST, the dimension of transformation matrix of EST is estimated by an information criterion. In this way, the eigenregion image may be approximated by a lower-dimensional components in the eigensubspace. Simulation tests performed on SPOT and Landsat TM images have demonstrated that the proposed compression scheme is suitable for multispectral satellite image.     

Iterative fuzzy image segmentation

The multispectral signature of features has been used for identification of objects in remotely sensed scenes for a number of years. Recently these techniques have been applied to feature selection in natural scenes. Due to the inherent noise and degradation of the input cues to the algorithms, meaningful image segmentation is a difficult process. In an effort to reduce the sensitivity of a system to these problems, we have been led to the development of a iterative fuzzy clustering technique for image segmentation. It is believed that this method represents an image segmentation scheme which can be used as a preprocessor for a multivalued logic based computer vision system.     

基于超像素的多主体图像交互分割

目的 为解决多主体图像的交互分割问题,在保证分割效果的前提上,提高分割的效率,达到实时交互修改分割结果的目的, 提出基于超像素的图像多主体交互分割算法.方法 基于图像的超像素构造一个多层流网络,利用用户交互绘制的简单笔画给出多主体分割的指导信息.流网络的边权值保证利用图割算法将图像分割成多个部分后,每个部分代表图像的一个主体.允许用户交互给出标记,实时修改分割结果,直到得到满意的多主体分割.结果 通过实验显示,本文方法能得到的满意多主体分割结果,而且时间效率较高.对分辨率为449×275的图像,算法能在1 s内给出结果,满足实时修改的要求.结论 基于超像素建立的图规模较小,能大大减少图割算法的运行时间,达到用户实时交互添加新笔画信息,交互地修正分割结果的目的.利用超像素的边界信息,用户只需输入比较简单的笔画信息,分割算法就能得到正确的多主体分割结果.     

Interactive color image segmentation via iterative evidential labeling

We develop an interactive color image segmentation method in this paper. This method makes use of the conception of Markov random fields (MRFs) and D–S evidence theory to obtain segmentation results by considering both likelihood information and priori information under Bayesian framework. The method first uses expectation maximization (EM) algorithm to estimate the parameter of the user input regions, and the Bayesian information criterion (BIC) is used for model selection. Then the beliefs of each pixel are assigned by a predefined scheme. The result is obtained by iteratively fusion of the pixel likelihood information and the pixel contextual information until convergence. The method is initially designed for two-label segmentation, however it can be easily generalized to multi-label segmentation. Experimental results show that the proposed method is comparable to other prevalent interactive image segmentation algorithms in most cases of two-label segmentation task, both qualitatively and quantitatively.     

Scale selection for supervised image segmentation

Finding the right scales for feature extraction is crucial for supervised image segmentation based on pixel classification. There are many scale selection methods in the literature; among them the one proposed by Lindeberg is widely used for image structures such as blobs, edges and ridges. Those schemes are usually unsupervised, as they do not take into account the actual segmentation problem at hand. In this paper, we consider the problem of selecting scales, which aims at an optimal discrimination between user-defined classes in the segmentation. We show the deficiency of the classical unsupervised scale selection paradigms and present a supervised alternative. In particular, the so-called max rule is proposed, which selects a scale for each pixel to have the largest confidence in the classification across the scales. In interpreting the classifier as a complex image filter, we can relate our approach back to Lindeberg's original proposal. In the experiments, the max rule is applied to artificial and real-world image segmentation tasks, which is shown to choose the right scales for different problems and lead to better segmentation results.     

Water body segmentation of Synthetic Aperture Radar image using Deep Convolutional Neural Networks

Deep Convolutional Neural Networks are finding their way into modern machine learning tasks and proved themselves to become one of the best contenders for future development in the field. Several proposed methods in image segmentation and classification problems are giving us satisfactory results and could even perform better than humans in image recognition tasks. But also at the cost of their performance, they also require a huge amount of images for training and huge amount of computing power and time that makes them unrealistic in some situations where obtaining a large dataset is not feasible. In this work, an attempt is made for segmentation of Synthetic Aperture Radar (SAR) images which are not usually abundant enough for training, and are heavily affected by a kind of multiplicative noise called speckle noise. For the segmentation task, pre-defined filters are first applied to the images and are fed to hybrid CNN that is resulted from the concept of Inception and U-Net. The outcome of our proposed method has been examined for their effectiveness of application in a complete set of SAR images that are not used for training. The accuracy has also been compared with the manually annotated SAR images.     

Feature extraction and image segmentation using self-organizing networks

Feature extraction and image segmentation (FEIS) are two primary goals of almost all image-understanding systems. They are also the issues at which we look in this paper. We think of FEIS as a multilevel process of grouping and describing at each level. We emphasize the importance of grouping during this process because we believe that many features and events in real images are only perceived by combining weak evidence of several organized pixels or other low-level features. To realize FEIS based on this formulation, we must deal with such problems as how to discover grouping rules, how to develop grouping systems to integrate grouping rules, how to embed grouping processes into FEIS systems, and how to evaluate the quality of extracted features at various levels. We use self-organizing networks to develop grouping systems that take the organization of human visual perception into consideration. We demonstrate our approach by solving two concrete problems: extracting linear features in digital images and partitioning color images into regions. We present the results of experiments on real images.     

Watershed from propagated markers: An interactive method to morphological object segmentation in image sequences

In this paper, it is introduced an interactive method to object segmentation in image sequences, by combining classical morphological segmentation with motion estimation – the watershed from propagated markers. In this method, the objects are segmented interactively in the first frame and the mask generated by its segmentation provides the markers that will be used to track and segment the object in the next frame. Besides the interactivity, the proposed method has the following important characteristics: generality, rapid response and progressive manual edition. This paper also introduces a new benchmark to do quantitative evaluation of assisted object segmentation methods applied to image sequences. The evaluation is done according to several criteria such as the robustness of segmentation and the easiness to segment the objects through the sequence.