基于德劳内三角剖分的彩色图像加权直方图表示及检索技术

经典的颜色直方图方法存在诸多缺陷，例如它不能表示图像中颜色的空间分布信息。为了进一步的提高图像检索能力，在分析图像特征的基础上，文章给出了一种基于角度图的直方图加权的图像表示方法。这种方法不仅保持了图像直方图简单方便的特点，同时又有效地将颜色的空间分布信息集成到直方图中。实验结果表明，对比经典直方图表示这种彩色图像的表示方法能获得更好的检索效果。     

Residential area extraction based on saliency analysis for high spatial resolution remote sensing images

Traditional residential area extraction methods for remote sensing image depend on classification, segmentation and prior knowledge which are time-consuming and difficult to build. In this paper, an efficient, saliency analysis-based residential area extraction method is proposed. In the proposed model, an adaptive directional prediction-based lifting wavelet transform (ADP-LWT) is introduced to obtain the orientation feature. A logarithm co-occurrence histogram is employed to compute the intensity feature. The color opponency and diagram objection based on the information are proposed to extract color feature from the contrast in the red–green opponent channel. The saliency map is obtained through a weighted combination based on the feature competition and the residential area is extracted by saliency map threshold segmentation. The experimental results reveal that the residential area extracted by our model has more demarcated boundaries and better performance in background subtraction.     

基于二维最大熵阈值分割的SIFT图像匹配算法

提出了一种基于二维灰度直方图最大熵阈值分割的SIFT图像特征匹配算法。与传统SIFT算法相比,该算法首先综合利用图像像素的灰度信息和邻域空间信息,生成图像二维灰度直方图,并基于此直方图的最大熵对图像进行阈值分割,然后检测分割后图像的DoG尺度空间局部极值,并以此作为特征点进行图像匹配。实验结果表明,基于所提出的匹配算法,可以有效降低图像背景噪声和边缘像素点对目标匹配的干扰,进而提高图像目标的匹配性能。     

一种新的道路描述子:对称边缘方向直方图

基于主要道路物方空间形状特征,本文提出了一种新的特征矢量——对称边缘方向直方图,作为较高分辨率航空影像中主要道路的特征描述.图像空间边缘像素的拓扑关系,该矢量较好地描述了图像的主要形状属性,并具有对于图像平移、旋转、尺度和光照变化的不变性.模糊C-均值聚类算法的分割实验表明,该特征矢量较好地解决了较高分辨率影像中主要道路的特征描述问题,能有效地从实际航空影像中提取主要道路种子点.     

基于双模态特征增强的目标检测算法研究与应用北大核心CSCD

为提升目标检测算法在复杂环境下的精确性和实用性,将多源信息和深度学习技术相结合,提出了一种基于双模态特征增强的目标检测方法。该方法以红外和可见光图像作为输入,利用颜色空间转换、边缘提取、直方图均衡化等传统图像处理方法丰富图像信息,达到数据增强效果;特征提取部分采用卷积神经网络结构分别提取目标红外及可见光信息,并设计混合注意力机制分别从通道和空间位置角度提升有效特征权重;同时,针对目标双模态信息,引入了自适应交叉融合结构,提高特征多样性;最后,利用交替上下采样将目标全局和局部特征充分融合,并以自主选择方式提取目标相关特征实现检测。通过在标准数据集以及实际场景数据集上的实验结果表明,所提方法有效融合并增强了目标多模态特征,提升了目标检测效果,并能较好的应用于电网场景中,辅助机器人完成目标设备检测。     

Generative image inpainting via edge structure and color aware fusion

Very recently, with the widespread research of deep learning, its achievements are increasingly evident in image inpainting tasks. However, many existing methods fail to effectively reconstruct vivid contents and refine structures. In order to solve this issue, in this paper, a novel two-stage generative adversarial network based on the fusion of edge structures and color aware maps is proposed. In the first-stage network, edges with missing regions are employed to train an edge structure generator. Meanwhile, the input image with missing regions is transformed into a global color feature map after the content aware fill algorithm and a large kernel size Gaussian filtering. In the second-stage network, the image fused from the edge map and the color map is used as a label to guide the network to reconstruct the refined image. Qualitative and quantitative experiments conducted on multiple public datasets demonstrate that the method proposed in this paper has superior performance.     

基于统计特征的彩色图像快速插值方法

本文首先阐述了基于统计特征的图像插值方法,该方法通过提取待插入像素所在区域的协方差矩阵和协方差向量,得出适应于边缘位置和方向的插值权重.为了把基于统计特征的图像插值方法应用于彩色图像插值领域,本文提出了以下措施以提高计算速度:仅对Y图像估计插值权重,并同时应用到R、G、B三个分量的插值;对边缘像素应用基于统计特征的图像插值方法,而对非边缘像素应用简单的双线性插值,即混合图像插值方法.这些措施提高了计算速度,并保证了图像质量.实验表明了该算法在计算速度和插值图像质量方面的有效性.     

方向相关与互信息加权组合多模图像配准方法

针对可见光与红外图像的配准问题,提出了一种基于边缘方向相关和局部优选区域互信息加权的配准方法。首先进行区域划分,建立区域优选测度,选取信息量丰富的局部区域;在优选区域的基础上,引入了图像的边缘方向信息,构造边缘方向图,以增加全局空间特征;然后,通过综合局部区域灰度信息和全局边缘方向信息,将互相关测度和互信息测度加权集成,构造了一种新的相似测度。实验结果表明,边缘方向相关测度的引入,提高了基于互信息的图像配准的精度,利用局部优选区域代替整幅图像提高了算法的速度。     

Semi-automatic segmentation of vascular network images using a rotating structuring element (ROSE) with mathematical morphology and dual feature thresholding

A method for measuring the spatial concentration of specific categories of vessels in a vascular network consisting of vessels of several diameters, lengths, and orientations is demonstrated. It is shown that a combination of the mathematical morphology operation, opening, with a linear rotating structuring element (ROSE) and dual feature thresholding can semi-automatically segment categories of vessels in a vascular network. Capillaries and larger vessels (arterioles and venules) are segmented here in order to assess their spatial concentrations. The ROSE algorithm generates the initial segmentation, and dual feature thresholding provides a means of eliminating the nonedge artifact pixels. The subsequent gray-scale histogram of only the edge pixels yields the correct segmentation threshold value. This image processing strategy is demonstrated on micrographs of vascular casts. By adjusting the structuring element and rotation angles, it could be applied to other network structures where a segmentation by network component categories is advantageous, but where the objects can have any orientation.     

基于图像分割的深度视频校正算法

在基于深度图的虚拟视点绘制过程中,由于通过深 度估计软件获取的深度视频存在大量的失真,从而导致绘制的虚拟视点中存在纹理失真和缺 失现象。本文围绕深度视频失真类型,提出一种基于分割的深度 视频校正算法。利用彩色深度一致性信息分区域校正深度失真,以解决由于深度块失真造成 的虚拟视点纹理 缺失问题。首先,提取彩色视频运动和边缘区域,得到彩色视频边缘和运动区域掩模图;其 次,在边缘和运 动信息的辅助下,对彩色图像进行Mean Shift聚类,并将不同类别区域赋以不同的标签;最 后,分别统计不 同类别连通区域对应的深度直方图,利用其峰值校正深度视频中深度彩色非一致区域。实验 结果表明,本文提 出的基于分割块的深度视频校正算法优于部分基于像素的滤波算法,可以有效地校正深度视 频块失真,解决 虚拟视点边缘失真和纹理缺失问题,同时虚拟视点质量平均提高了0.20dB。     

基于ILDP的噪声鲁棒人脸识别

针对局部方向模式(LDP)采样不充分和对噪声敏感的缺点,提出了一种改进的LDP(ILDP)人脸描述方法,利用局部井型邻域的梯度信息描述人脸特征。首先,将中心像素的井型邻域根据采样半径分成两个3×3的子邻域,每个子邻域包含按照原来相对位置排列的8个像素;然后,将两个子邻域与Kirsch模板卷积分别得到两组边缘梯度值,ILDP仅使用两组梯度值中各自最大值的方向编码成一个二位八进制数,产生ILDP码;最后,在人脸描述阶段将人脸图像进行分块并把每块转换成ILDP图,再对ILDP图进行直方图统计,将所有子块的直方图连接生成人脸特征。实验结果表明,ILDP比其它同类基于局部纹理特征的单一人脸描述器在对抗随机噪声方面更具鲁棒性。     

Study of single image dehazing algorithm based on propagated filtering and minimum color channels

To solve the challenging problem that the edge regions of image have some remained hazes and blackspots,a novel image dehazing algorithm was proposed based on the minimal color channel and propagated filtering.Firstly,an initial atmospheric transmission map was obtained by double-area filtering,then a minimal channel color was introduced as a reference image,and the propagated filtering was combined to optimize the initial atmospheric transmission map.Optimized transmission have the similar edge characteristics as the referenced image,so the deviation of transmission estimation can be effectively avoided for the edge pixels in the depth mutated regions,and the redundant texture information were removed in the initial transmission map.Finally,L-BFGS was used to restore atmospheric light,and the haze-free image can be recovered based on the atmospheric scattering model.Experimental results show that proposed algorithm has the more accurate transmission estimation for the depth mutated edge regions of image,so the recovered image effectively preserves the edges and details in the depth mutated regions,and has better spatial smoothness in the uniform depth regions.The recovered haze-free image with proposed method has a better sharpness and richer color degree.     

Robust object tracking based on adaptive templates matching via the fusion of multiple features

Moving object tracking under complex scenes remains to be a challenging problem because the appearance of a target object can be drastically changed due to several factors, such as occlusions, illumination, pose, scale change and deformation. This study proposes an adaptive multi–feature fusion strategy, in which the target appearance is modeled based on timed motion history image with HSV color histogram features and edge orientation histogram features. The variances based on the similarities between the candidate patches and the target templates are used for adaptively adjusting the weight of each feature. Double templates matching, including online and offline template matching, is adopted to locate the target object in the next frame. Experimental evaluations on challenging sequences demonstrate the accuracy and robustness of the proposed algorithm in comparison with several state-of-the-art algorithms.     

Sparse embedding visual attention system combined with edge information

Numerous computational models of visual attention have been suggested during the last two decades. But, there are still some challenges such as which of early visual features should be extracted and how to combine these different features into a unique “saliency” map. According to these challenges, we proposed a sparse embedding visual attention system combined with edge information, which is described as a hierarchical model in this paper. In the first stage, we extract edge information besides color, intensity and orientation as early visual features. In the second stage, we present a novel sparse embedding feature combination strategy. Results on different scene images show that our model outperforms other visual attention computational models.     

分层结构直方图及其应用

针对传统直方图特征存在的特征分辨能力不强的问题,提出了一种图像分层结构直方图.该特征首先将图像按照亮度幅值的大小进行分层,然后根据预先设计的结构图元对所有的分层图进行基于结构图元的直方图统计,最后将所得的直方图进行集成得到最终的分层结构直方图.以图像匹配与视觉跟踪为例,对分层结构直方图的应用进行了大量的仿真实验,结果表明该特征较参考特征具有更强的特征分辨性能和局部描述能力.利用分层结构直方图进行图像匹配得到的相似性度量图单峰特性更加明显,能够显著降低视觉跟踪算法的跟踪误差.     

Statistical Study of Edges in TV Pictures

The present study is devoted to the statistical analysis of edges in still monochrome TV pictures. The visual information carried by the edges is especially important both for image interpretation and for subjective image quality evaluation. Statistical knowledge on edges is helpful to improve image coding techniques significantly as well as processing techniques for scene analysis. After an introduction on nonstationary local statistical models, we describe the parameters of edges and the methods used to measure them. Statistical data collected on these parameters are then presented. The data concern orientation, edge length, edge width, runlength between edges and edge slope probability distributions as well as the measure of orientation continuity along an edge and the relative frequencies of edge pixels and contrasted isolated pixels.