Color image segmentation based on mean shift and normalized cuts.

In this correspondence, we develop a novel approach that provides effective and robust segmentation of color images. By incorporating the advantages of the mean shift (MS) segmentation and the normalized cut (Ncut) partitioning methods, the proposed method requires low computational complexity and is therefore very feasible for real-time image segmentation processing. It preprocesses an image by using the MS algorithm to form segmented regions that preserve the desirable discontinuity characteristics of the image. The segmented regions are then represented by using the graph structures, and the Ncut method is applied to perform globally optimized clustering. Because the number of the segmented regions is much smaller than that of the image pixels, the proposed method allows a low-dimensional image clustering with significant reduction of the complexity compared to conventional graph-partitioning methods that are directly applied to the image pixels. In addition, the image clustering using the segmented regions, instead of the image pixels, also reduces the sensitivity to noise and results in enhanced image segmentation performance. Furthermore, to avoid some inappropriate partitioning when considering every region as only one graph node, we develop an improved segmentation strategy using multiple child nodes for each region. The superiority of the proposed method is examined and demonstrated through a large number of experiments using color natural scene images.     

Color image segmentation—an innovative approach

In this paper we describe a color image segmentation system that performs color clustering in a color space and then color region segmentation in the image domain. For color segmentation, we developed a fuzzy clustering algorithm that iteratively generates color clusters using a uniquely defined fuzzy membership function and an objective function for clustering optimization. The fuzzy membership function represents belief value of a color belonging to a color cluster and the mutual interference of neighboring clusters. The region segmentation algorithm merges clusters in the image domain based on color similarity and spatial adjacency. We developed three different methods for merging regions in the image domain. Unlike many existing clustering algorithms, the image segmentation system does not require the knowledge about the number of the color clusters to be generated at each stage and the resolution of the color regions can be controlled by one single parameter, the radius of a cluster. The color image segmentation system has been implemented and tested on a variety of color images including satellite images, car and face images. The experiment results are presented and the performance of each algorithm in the segmentation system is analyzed. The system has shown to be both effective and efficient.     

分水岭分割的方向迭代后处理算法

为了提取彩色图像中线目标，该文提出了一种新的彩色图像分割算法，首先对图像进行分水岭分割得到初始过分割图像，并通过模糊聚类方法得到区域分类概率，然后根据图像的边缘信息和空间特性，得到区域的线方向邻接区域，最后通过迭代的方法，利用线方向邻接区域信息更新区域的分类概率。实验结果显示了很好的提取效果。     

基于图像的流体型风格画仿真研究

为了模拟艺术家的流体型风格绘画,提出了一种新的流体型风格化图像绘制算法。提取图像中的流体信息,通过随机扰动生成纹理参考图,再运用小波技术的融合方法,使得输出图像具有流体效果,最后采用色彩转换的方法,将颜色参考图中的色彩特征转换到绘制图像上。实验结果表明,该算法自动化程度高,复杂度低,渲染效果更接近于流体型风格绘画。     

Interactively multiphase image segmentation based on variational formulation and graph cuts

In this paper the multiple piecewise constant (MPC) active contour model is extended to deal with multiphase case. This proposed multiphase model can be effectively optimized by solving the minimum cuts problem of a specially devised multilayer graph. Based on the proposed energy functional and its graph cuts optimization, an interactively multiphase partition method for image segmentation is presented. The user places some scribbles with different colors on the image according to the practical application demand and each group of scribbles with the same color corresponds to a potential image region. The distribution of each region can be learned from the input scribbles with some particular color. Then the corresponding multilayer graph can be constructed and its minimum cuts can be computed to determine the segmentation result of the image. Numerical experiments show that the proposed interactively multiphase segmentation method can accurately segment the image into different regions according to the input scribbles with different color.     

基于K均值聚类与区域合并的彩色图像分割算法

提出一种基于K均值聚类与区域合并的彩色图像分割算法。首先,对图像运用mean shift算法进行滤波,在对图像进行平滑的同时保持图像的边缘;然后,运用K均值算法对图像在颜色空间进行聚类,得到初始分割的结果;最后,给出了一种区域合并策略,对初始分割获得的区域进行合并,得到最终的分割结果。仿真结果表明,算法的分割结果和人的主观视觉感知具有良好的一致性。     

模糊相关图割的非监督层次化彩色图像分割

目的 基于阈值的分割方法能根据像素的信息将图像划分为同类的区域,其中常用的最大模糊相关分割方法,因能利用模糊相关度量划分的适当性,得到较好的分割结果,而广受关注。然而该算法存在划分数需预先确定,阈值的分割结果存在孤立噪声,无法对彩色图像实施分割的问题。为此,提出基于模糊相关图割的非监督层次化分割策略来解决该问题。方法 算法首先将图像划分为若干超像素,以提高层次化图像分割的效率;随后将快速模糊相关算法与图割结合,构成模糊相关图割2-划分算子,在确保分割效率的基础上,解决单一阈值分割存在孤立噪声的问题;最后设计了自顶向下层次化分割策略,利用构建的2-划分算子选择合适的区域及通道,迭代地对超像素实施层次化分割,直到算法收敛,划分数自动确定。结果 对Berkeley分割数据库上300幅图像进行了测试,结果表明算法能有效分割彩色图像,分割精度优于Ncut、JSEG方法,运行时间较这两种方法也提高了近20%。结论 本文算法为最大模糊相关算法在非监督彩色图像分割领域的应用提供指导依据,能用于目标检测和识别领域。     

面向自然图像的年画风格化算法

年画作为中国民间艺术的优秀代表之一,其风格对艺术创作有重要意义。为了快速方便地实现自然图像的年画风格化,设计了一种自动化的年画风格化算法框架,并尽可能准确的保持自然图像的原有图案与颜色分配。对于一幅用户给定的自然图像,算法首先对图像进行自动的颜色分割聚类,提取关键线条作为年画轮廓线,运用基于优化的年画配色映射方法将不同的分割区域重新着色,最后通过年画风格细节增强,使结果图的颜色风格更加接近年画风格。针对颜色配色优化,算法综合考量了生成图像与原图像的颜色相似度和相邻色块的颜色对比度,并利用差分进化策略对能量方程进行最小化求解得出合理的颜色配置方案。在实验中进行了几组不同产地的年画风格化实验,结果算法可有效地将一幅自然图像自动转化为年画风格,且效果较自然,颜色具有地方特色。     

基于矢量量化和区域生长的彩色图像分割新算法

针对光照变化和阴影对图像分割的不利影响问题,提出了一种基于矢量量化和区域生长的彩色图像分割新算法。该算法不仅考虑了彩色图像的颜色信息,而且也考虑了彩色图像的空间信息。该算法首先利用一种修改的GLA算法对彩色图像进行量化,并根据彩色图像量化的结果选取种子像素;然后基于矢量角相似性准则,并结合像素空间邻接信息,对每一个种子像素进行区域生长;最后利用模糊C-M eans算法来对未能归类的剩余像素进行分类。实验表明,该算法不仅可以在很大程度上克服光照变化及阴影对图像分割的不利影响,而且分割结果与人的主观视觉感知具有良好的一致性。     

一种融合区域笔划和梯度笔划的油画生成方法

基于笔划的油画生成是油画生成中最为重要的技术,它模拟真实画家使用 笔划的创作过程,以达到逼真的手绘作品的效果。分析了基于图像分割的区域笔划生成油画 的优缺点,提出一种融合区域笔划和梯度笔划的油画生成方法,首先通过图像分割生成区域 笔划,然后根据图像分割水平确定梯度阈值筛选出梯度笔划。通过实验可以看出,该方法生 成速度较快,不仅使笔划更加灵活多变,而且可以弥补区域笔划生成所产生的缝隙。     

Virtual restoration of the colored paintings on weathered beams in the Forbidden City using multiple deep learning algorithms

The colored paintings on the surfaces of ancient Chinese buildings have suffered from the wind and the sun and produced many defects such as paint loss, blurring, and color distortion. Previous methods have not been able to virtually repair them well. Therefore, this paper proposed a virtual restoration method for the weathered beams in the Forbidden City using multiple deep learning algorithms. Instead of using only one technology to restore paintings, this paper divided the painting into 3 parts, i.e., the background, the golden edges, and the dragon patterns, and restored them in different technology. For the background, this paper transformed the problem of unrecognizable color restoration into a semantic segmentation problem using U-Net MobileNet. For the golden edges, this paper used traditional image processing technology to obtain them from the color maps generated by the semantic segmentation algorithm. For the dragon patterns, after sketching the skeletons according to the dragon patterns, the image translation algorithm Pix2pix was applied to generate a realistic dragon pattern. Finally, the three repair results are superimposed to complete the repair. The virtually restored paintings can provide reference and guidance for traditional manual restoration and help the restorers to imagine what they looked like before oxidation, thus alleviating some repetitive work and reducing the complexity of restoration. Besides, each step of the method could form a layer, so that the restorers could overlay or modify them as they wish.     

Color image segmentation using neuro-fuzzy system in a novel optimized color space

Segmentation is one of the most important pre-processing steps toward pattern recognition and image understanding. It is often used to partition an image into separate regions, which ideally correspond to different real-world objects. In this paper, novel color image segmentation is proposed and implemented using fuzzy inference system in optimized color space. This system, which is designed by neuro-adaptive learning technique, applies a sample image as an input and can reveal the likelihood of being a special color for each pixel through the image. The intensity of each pixel shows this likelihood in the gray-level output image. After choosing threshold value, a binary image is obtained, which can be applied as a mask to segment desired color in input image. Besides using fuzzy systems, optimizing color space for segmentation is another feature of proposed method. This optimizing is implemented by genetic algorithms and influence on system accuracy. Two applications of developed method are discussed, and still it could be applicable in wide range of color image segmentation or object detection purposes.     

Hand image segmentation using color and RCE neural network

This paper presents a color segmentation method based on RCE neural network for hand image segmentation in the gesture-based human–service robot interaction system. The study on skin color distributions in different color spaces indicates that skin colors cluster in a small region in a color space. The RCE neural network characterizes the skin color distribution region using skin color prototypes together with their spherical influence fields during training stage, and identifies the skin regions in the color image during running stage. Experimental results have demonstrated the effectiveness of this method for the segmentation of various hand images as well as general color images with complex backgrounds.     

一种融合颜色和空间信息的彩色图像分割算法

提出了一种基于图像颜色和空间信息的彩色图像分割算法.该算法首先根据所提出的颜色粗糙度概念对图像进行颜色量化,并在此基础上使用增量式的区域生长算法发现颜色相近的像素之间的空间连通性,形成图像的初始分割区域.然后,根据融合了颜色和空间信息的区域距离,对初始分割区域进行分级合并,直到系统满足了所提出的停止区域合并的准则.最后,利用形态学的有关算法对分割区域的边缘进行平滑.实验证明,算法的分割结果与人的主观视觉感知具有良好的一致性.     

Consistent color and detail transfer from multiple source images for video and images

In this paper, we propose a method to jointly transfer the color and detail of multiple source images to a target video or image. Our method is based on a probabilistic segmentation scheme using Gaussian mixture model (GMM) to divide each source image as well as the target video frames or image into soft regions and determine the relevant source regions for each target region. For detail transfer, we first decompose each image as well as the target video frames or image into base and detail components. Then histogram matching is performed for detail components to transfer the detail of matching regions from source images to the target. We propose a unified framework to perform both color and detail transforms in an integrated manner. We also propose a method to maintain consistency for video targets, by enforcing consistent region segmentations for consecutive video frames using GMM-based parameter propagation and adaptive scene change detection. Experimental results demonstrate that our method automatically produces consistent color and detail transferred videos and images from a set of source images.     

符合人类视觉感知的图像对象分割方法

提出一种符合人类视觉感知的图像对象分割方法,包括双尺度的区域分割和基于模型的对象提取。运用非线性尺度算子对图像进行大尺度平滑,结合颜色量化和视觉一致性的颜色聚类完成图像的粗分割。在原尺度上融合区域的纹理、颜色信息对分割区域进行区域合并,并利用对象模型完成图像对象的提取。实验结果表明,该算法的分割结果符合人类视觉感知特性,能够较好地完成图像对象分割。     

Perceptual grouping of segmented regions in color images

Image segmentation is often the first yet important step of an image understanding system. However, general-purpose image segmentation algorithms that do not rely on specific object models still cannot produce perceptually coherent segmentation of regions at a level comparable to humans. Over-segmentation and under-segmentation have plagued the research community in spite of many significant advances in the field. Therefore, grouping of segmented region plays a significant role in bridging image segmentation and high-level image understanding. In this paper, we focused on non-purposive grouping (NPG), which is built on general expectations of a perceptually desirable segmentation as opposed to any object specific models, such that the grouping algorithm is applicable to any image understanding application. We propose a probabilistic model for the NPG problem by defining the regions as a Markov random field (MRF). A collection of energy functions is used to characterize desired single-region properties and pair-wise region properties. The single-region properties include region area, region convexity, region compactness, and color variances in one region. The pair-wise properties include color mean differences between two regions; edge strength along the shared boundary; color variance of the cross-boundary area; and contour continuity between two regions. The grouping process is implemented by a greedy method using a highest confidence first (HCF) principle. Experiments have been performed on hundreds of color photographic images to show the effectiveness of the grouping algorithm using a set of fixed parameters.     

线积分卷积与双色调映射相结合的彩色素描模拟方法

目的 目前学者已经设计了很多模拟油画、水彩、水墨等风格的非真实感绘制方法,而能够生成彩色素描的算法还不是很多。针对这一课题,在前人工作的基础上,结合线积分卷积与双色调映射技术,改进了一种彩色素描模拟方法。方法 首先基于K-means聚类对彩色图像进行分割,通过计算色彩差异性为每个区域指定两种基本色,并利用双色调映射技术计算每种颜色的密度。而后利用线积分卷积分别生成两个基本色层的素描纹理,并将两层纹理相融合来生成彩色纹理。与此同时,利用霓虹变换生成素描轮廓线。最后,将轮廓与彩色纹理相融合来得到彩色素描效果。结果 实验结果表明,本文方法能够实现由彩色图像到彩铅画的自动、实时转化。结论 本文方法从轮廓和纹理两个角度模拟了真实的彩铅绘画过程。基于K-means聚类的分割方法得到的结果能够更好地反映彩色图像的颜色分布特性。通过色彩差异性计算指定基本色的策略提高了该环节的效率,满足了实时性要求。由于粉笔、蜡笔等绘画风格的调色与彩铅画类似,本文不同颜色层上下叠加的方式可以扩展到对其他介质绘画的模拟当中。     

Color Image Segmentation for Multimedia Applications

Image segmentation is crucial for multimedia applications. Multimedia databases utilize segmentation for the storage and indexing of images and video. Image segmentation is used for object tracking in the new MPEG-7 video compression standard. It is also used in video conferencing for compression and coding purposes. These are only some of the multimedia applications in image segmentation. It is usually the first task of any image analysis process, and thus, subsequent tasks rely heavily on the quality of segmentation. The proposed method of color image segmentation is very effective in segmenting a multimedia-type image into regions. Pixels are first classified as either chromatic or achromatic depending on their HSI color values. Next, a seed determination algorithm finds seed pixels that are in the center of regions. These seed pixels are used in the region growing step to grow regions by comparing these seed pixels to neighboring pixels using the cylindrical distance metric. Merging regions that are similar in color is a final means used for segmenting the image into even smaller regions.