一种基于时空联合的视频分割算法

本文提出了一种基于时空联合的视频分割算法.在空间分割中,引入了一种新的分水岭分割算法,具有较快的执行速度;在运动分割中提出了一种分层块匹配的快速运动估计算法;最后提出了利用六个仿射参数组成的向量的范数来进行基于运动的区域合并.实验表明:这是一种稳健的而且执行速度相当快的视频分割算法.     

基于Word Embedding的遥感影像检测分割

遥感影像检测分割技术通常需提取影像特征并通过深度学习算法挖掘影像的深层特征来实现.然而传统特征（如颜色特征、纹理特征、空间关系特征等）不能充分描述影像语义信息,而单一结构或串联算法无法充分挖掘影像的深层特征和上下文语义信息.针对上述问题,本文通过词嵌入将空间关系特征映射成实数密集向量,与颜色、纹理特征的结合.其次,本文构建基于注意力机制下图卷积网络和独立循环神经网络的遥感影像检测分割并联算法（Attention Graph Convolution Networks and Independently Recurrent Neural Network,ATGIR）.该算法首先通过注意力机制对结合后的特征进行概率权重分配;然后利用图卷积网络（GCNs）算法对高权重的特征进一步挖掘并生成方向标签,同时使用独立循环神经网络（IndRNN）算法挖掘影像特征中的上下文信息,最后用Sigmoid分类器完成影像检测分割任务.以胡杨林遥感影像检测分割任务为例,我们验证了提出的特征提取方法和ATGIR算法能有效提升胡杨林检测分割任务的性能.     

基于运动窗生成的时空视频分割

本文提出了一种基于运动窗生成的时空视频分割方法.首先通过检测运动变化区域而生成运动窗,然后只对视频图像在运动窗内的部分进行时空视频分割,从而大大减少了运算量,提高了运算速度.此外,在空间分割中,本文提出了一种符合人眼视觉特性的逐级划分的空间分割方法;最后根据运动相似性将区域合并,完成视频分割.实验结果表明,本文的方法运算速度快并能有效地进行空间分割,最后能取得较好的视频分割结果.     

运动目标的自动分割与跟踪

该文提出了一种对视频序列中的运动目标进行自动分割的算法。该算法分析图像在L U V空间中的局部变化,同时使用运动信息来把目标从背景中分离出来。首先根据图像的局部变化,使用基于图论的方法把图像分割成不同的区域。然后,通过度量合成的全局运动与估计的局部运动之间的偏差来检测出运动的区域,运动的区域通过基于区域的仿射运动模型来跟踪到下一帧。为了提高提取的目标的时空连续性,使用Hausdorff跟踪器对目标的二值模型进行跟踪。对一些典型的MPEG-4测试序列所进行的评估显示了该算法的优良性能。     

Split-merge video displacement estimation

Motion Compensation is one of the most effective techniques used in interframe data compression. In this paper we present a parallel block-matching algorithm for estimating interframe displacement of blocks with minimum error. The algorithm is designed for a simple parallel architecture to process video in real time. The blocks may have variable size and shape depending on a split-and-merge technique. The algorithm performs a segmentation of the image into regions (objects) moving in the same direction and uses this knowledge to improve the transmission of the displacement vectors. This segmentation identifies the part of the frame “active” with respect to the previous frame and preserves some of the spatial correlation between blocks     

Medical image segmentation based on non-parametric mixture models with spatial information

Because of too much dependence on prior assumptions, parametric estimation methods using finite mixture models are sensitive to noise in image segmentation. In this study, we developed a new medical image segmentation method based on non-parametric mixture models with spatial information. First, we designed the non-parametric image mixture models based on the cosine orthogonal sequence and defined the spatial information functions to obtain the spatial neighborhood information. Second, we calculated the orthogonal polynomial coefficients and the mixing ratio of the models using expectation-maximization (EM) algorithm, to classify the images by Bayesian Principle. This method can effectively overcome the problem of model mismatch, restrain noise, and keep the edge property well. In comparison with other methods, our method appears to have a better performance in the segmentation of simulated brain images and computed tomography (CT) images.     

基于语义分割的双目场景流估计

针对现有场景流计算方法在复杂场景、大位移和运动遮挡等情况下易产生运动边缘模糊的问题,提出一种基于语义分割的双目场景流估计方法.首先,根据图像中的语义信息类别,通过深度学习的卷积神经网络模型将图像划分为带有语义标签的区域;针对不同语义类别的图像区域分别进行运动建模,利用语义知识计算光流信息并通过双目立体匹配的半全局匹配方法计算图像视差信息.然后,对输入图像进行超像素分割,通过最小二乘法耦合光流和视差信息,分别求解每个超像素块的运动参数.最后,在优化能量函数中添加语义分割边界的约束信息,通过更新像素到超像素块的映射关系和超像素块到移动平面的映射关系得到最终的场景流估计结果.采用KITTI 2015标准测试图像序列对本文方法和代表性的场景流计算方法进行对比分析.实验结果表明,本文方法具有较高的精度和鲁棒性,尤其对于复杂场景、运动遮挡和运动边缘模糊的图像具有较好的边缘保护作用.     

Segmentation framework based on label field fusion.

In this paper, we put forward a novel fusion framework that mixes together label fields instead of observation data as is usually the case. Our framework takes as input two label fields: a quickly estimated and to-be-refined segmentation map and a spatial region map that exhibits the shape of the main objects of the scene. These two label fields are fused together with a global energy function that is minimized with a deterministic iterative conditional mode algorithm. As explained in the paper, the energy function may implement a pure fusion strategy or a fusion-reaction function. In the latter case, a data-related term is used to make the optimization problem well posed. We believe that the conceptual simplicity, the small number of parameters, the use of a simple and fast deterministic optimizer that admits a natural implementation on a parallel architecture are among the main advantages of our approach. Our fusion framework is adapted to various computer vision applications among which are motion segmentation, motion estimation and occlusion detection.     

A spatially constrained generative asymmetric Gaussian mixture model for image segmentation

Accurate image segmentation is an essential step in image processing, where Gaussian mixture models with spatial constraint play an important role. Nevertheless, most methods suffer from one or more challenges such as limited robustness to noise, over-smoothness for segmentations, and lack of flexibility to fit the observed data. To address these issues, in this paper, we propose a generative asymmetric Gaussian mixture model with spatial constraint for image segmentation. The asymmetric distribution is modified to be easily incorporated the spatial information. Then our asymmetric model can be constructed based on the posterior and prior probabilities of within-cluster and between-cluster. Based on the Kullback-Leibler divergence, we introduce two pseudo-likelihood quantities which consider the neighboring priors of within-cluster and between-cluster. Finally, we derive an expectation maximization algorithm to maximize the approximation of the data log-likelihood. We compare our algorithm with state-of-the-art segmentation approaches to demonstrate the superior performance of the proposed algorithm.     

基于CNNs电路模型的像素演化分割方法

CNNs是一种局部互联的非线性并行模拟视觉处理系统,具有适合硬件实现处理速度快的优点。在介绍CNNs电路模型基本概念基础上,基于图像梯度信息,设计了一种基于CNNs电路模型的像素演化图像精确分割方法,并给出了相关的模板设置,分割试验结果验证了所提出方法的正确性。     

Region-level motion-based background modeling and subtraction using MRFs.

This paper presents a new approach to automatic segmentation of foreground objects from an image sequence by integrating techniques of background subtraction and motion-based foreground segmentation. First, a region-based motion segmentation algorithm is proposed to obtain a set of motion-coherence regions and the correspondence among regions at different time instants. Next, we formulate the classification problem as a graph labeling over a region adjacency graph based on Markov random fields (MRFs) statistical framework. A background model representing the background scene is built and then is used to model a likelihood energy. Besides the background model, a temporal coherence is also maintained by modeling it as the prior energy. On the other hand, color distributions of two neighboring regions are taken into consideration to impose spatial coherence. Then, the a priori energy of MRFs takes both spatial and temporal coherence into account to maintain the continuity of our segmentation. Finally, a labeling is obtained by maximizing the a posteriori energy of the MRFs. Under such formulation, we integrate two different kinds of techniques in an elegant way to make the foreground detection more accurate. Experimental results for several video sequences are provided to demonstrate the effectiveness of the proposed approach.     

A hybrid algorithm for automatic segmentation of slowly moving objects

Segmentation of moving objects in video sequences is a basic task in many applications. However, it is still challenging due to the semantic gap between the low-level visual features and the high-level human interpretation of video semantics. Compared with segmentation of fast moving objects, accurate and perceptually consistent segmentation of slowly moving objects is more difficult. In this paper, a novel hybrid algorithm is proposed for segmentation of slowly moving objects in video sequence aiming to acquire perceptually consistent results. Firstly, the temporal information of the differences among multiple frames is employed to detect initial moving regions. Then, the Gaussian mixture model (GMM) is employed and an improved expectation maximization (EM) algorithm is introduced to segment a spatial image into homogeneous regions. Finally, the results of motion detection and spatial segmentation are fused to extract final moving objects. Experiments are conducted and provide convincing results.     

基于FCM的分块自适应图像分割方法研究

基于模糊C均值聚类（FCM）的图像分割是应用较为广泛的图像分割方法之一,但是传统的模糊C均值聚类算法都是基于欧氏距离的,对于图像中的噪声是十分敏感的。针对这一局限性,提出一种基于FCM的分块自适应图像分割方法。该方法不仅考虑了噪声不均匀分布对分割结果的影响,而且充分考虑了图像像素的灰度信息和空间信息。通过对含有噪声的自然图像和合成图像的分割试验,我们可以得到,与传统的FCM图像分割算法相比,本文方法能显著提高含有噪声图像的分割质量。     

Structured representations in a content based image retrieval context

Here, we propose an automatic system to annotate and retrieve images. We assume that regions in an image can be described using a vocabulary of blobs. Blobs are generated from image features using clustering. Features are locally extracted on regions to capture Color, Texture and Shape information. Regions are processed by an efficient segmentation algorithm. Images are structured into a region adjacency graph to consider spatial relationships between regions. This representation is used to perform a similarity search into an image set. Hence, the user can express his need by giving a query image, and thereafter receiving as a result all similar images. Our graph based approach is benchmarked to conventional Bag of Words methods. Results tend to reveal a good behavior in classification of our graph based solution on two publicly available databases. Experiments illustrate that a structural approach requires a smaller vocabulary size to reach its best performance.     

一种基于区域Gibbs势能函数的视频运动对象分割算法

提出了一种基于时空联合分析框架的视频对象分割算法,通过改进的分水岭变换对视频图像进行帧内空间区域划分,并根据帧间运动信息和区域的空间特性得到初步的分割掩模;然后建立基于区域的马尔可夫随机场分布模型,并定义对应的Gibbs势能函数,通过迭代条件模式(ICM)方法求解得到最小化能量,从而获得稳定的分割标记场,准确地提取视频对象。实验结果表明,提出的分割算法性能优于欧洲COST211研究组所得到的分割结果。     

一种基于区域搜索的全局运动估计与补偿算法

开展全局运动估计与补偿研究是进行动态目标检测中的基础和前提。在总结现有运动估计与补偿方法的基础上,提出一种基于图像分割区域的运动性和大小的全局运动估计与补偿算法。首先,通过建立区域搜索的全局运动模型,同时进行区域定性分割和区域大小排序;然后,根据误差最小化准则在指定的分割区域中进行线性递归搜索,利用门限准则寻找出最佳的运动估计参数;最后,根据双线性内插法获得运动位移量。实验结果比较可知,所提算法较三步搜索算法(TSS)和全局搜索算法(FSA)等传统算法具有更高的准确性(图像平移帧差)和实时性(算法运行时间),能够很好地实现运动背景的全局校正。     

Motion-based object segmentation using hysteresis and bidirectional inter-frame change detection in sequences with moving camera

We present an unsupervised motion-based object segmentation algorithm for video sequences with moving camera, employing bidirectional inter-frame change detection. For every frame, two error frames are generated using motion compensation. They are combined and a segmentation algorithm based on thresholding is applied. We employ a simple and effective error fusion scheme and consider spatial error localization in the thresholding step. We find the optimal weights for the weighted mean thresholding algorithm that enables unsupervised robust moving object segmentation. Further, a post processing step for improving the temporal consistency of the segmentation masks is incorporated and thus we achieve improved performance compared to the previously proposed methods. The experimental evaluation and comparison with other methods demonstrate the validity of the proposed method.     

一种融合时域和空域信息的运动目标分割新方法

提出了一种融合时域和空域信息的方法，用于从视频序列中分割出运动物体。该方法是在分割过程中通过区域捆绑逐步融合时域和空域信息，而不是在时域分割结束之后再融合空域信息。分布式地表达分割物体并刻画其特征是区域捆绑的主要特征。本文的方法首先通过早期分割得到许多小区域，然后将这些小区域捆绑成一些捆绑核，再将剩下的区域通过强或弱的规则捆绑到相邻的捆绑核，从而实现目标区域的分割。实验结果显示了该方法的良好性能。     

Learning-Based Vertebra Detection and Iterative Normalized-Cut Segmentation for Spinal MRI

Automatic extraction of vertebra regions from a spinal magnetic resonance (MR) image is normally required as the first step to an intelligent spinal MR image diagnosis system. In this work, we develop a fully automatic vertebra detection and segmentation system, which consists of three stages; namely, AdaBoost-based vertebra detection, detection refinement via robust curve fitting, and vertebra segmentation by an iterative normalized cut algorithm. In order to produce an efficient and effective vertebra detector, a statistical learning approach based on an improved AdaBoost algorithm is proposed. A robust estimation procedure is applied on the detected vertebra locations to fit a spine curve, thus refining the above vertebra detection results. This refinement process involves removing the false detections and recovering the miss-detected vertebrae. Finally, an iterative normalized-cut segmentation algorithm is proposed to segment the precise vertebra regions from the detected vertebra locations. In our implementation, the proposed AdaBoost-based detector is trained from 22 spinal MR volume images. The experimental results show that the proposed vertebra detection and segmentation system can achieve nearly 98% vertebra detection rate and 96% segmentation accuracy on a variety of testing spinal MR images. Our experiments also show the vertebra detection and segmentation accuracies by using the proposed algorithm are superior to those of the previous representative methods. The proposed vertebra detection and segmentation system is proved to be robust and accurate so that it can be used for advanced research and application on spinal MR images.