人脸图像超分辨率非线性算法

研究单幅人脸图像的超分辨率重构算法。采用马尔可夫网络模型描述重构机制,对输入的低分辨率图像,以及训练用高分辨率图像和对应的低分辨率图像进行分块,并使图像基本对齐,构造训练图像集。针对简化马尔可夫网络计算的需要以及训练集人脸图像的差异,在块坐标限位操作的基础上,提出了一种非线性样本搜索算法,降低了搜索空间复杂度,提高了匹配效率和相关性。算法利用搜索到的高分辨率图像分块样本,直接输出超分辨率图像。分析和实验证实,与传统学习算法相比,该文方法具有输出质量好、效率高的特点。     

多分辨率图像序列的超分辨率重建

针对不同焦距下拍摄的多分辨率尺度的图像序列,本文提出了一种基于尺度不变特征转换(Scale invariant feature transform, SIFT)和图像配准的超分辨率(Super resolution, SR)图像盲重建算法.首先提取图像SIFT特征点,然后用向量夹角余弦进行特征描述符向量的初匹配,并用随机抽样一致性 (Random sample consensus, RANSAC)算法消除误匹配提高配准精度.计算变换参数后,将低分辨率图像(Low-resolution, LR)像素点映射到高分辨率(How-resolution, HR)网格,最后利用像素可信度加权算法填充缺失像素值,重建更高分辨率的图像.实验表明, 本文算法能精确估计图像序列的缩放因子,可以有效处理仿射变换模型,对配准误差也具有一定的鲁棒性.算法从实质上提高了多分辨率尺度图像序列的分辨率,尤其在低分辨率帧数较少可用于重建的信息量严重不足时也能获得比较满意的重建效果.     

增强的单幅图像自学习超分辨方法

针对图像超分辨率方法构建图像块的稀疏表示（SR）系数存在的主要问题,利用加权思想提出一种增强的单幅图像自学习超分辨方法。首先,通过自学习建立高低分辨率图像金字塔;然后,分别提取低分辨率图像的图像块特征和对应高分辨率图像块的中心像素,并给图像块中不同像素点赋予不同的权重,强调中心像素点在构建图像块稀疏系数时的作用;最后,结合SR理论和支持向量回归（SVR）技术建立超分辨率图像重建模型。实验结果表明,与单幅图像自学习超分辨率方法（SLSR）相比,所提方法的峰值信噪比（PSNR）平均提高了0.39 dB,无参考图像质量评价标准（BRISQUE）分数平均降低了9.7。从主观视角和客观数值证明了所提超分辨率方法更有效。     

一种基于学习的非线性人脸图像超分辨率算法

提出了一种单幅人脸图像的超分辨率重构算法。该算法采用马尔可夫网络模型描述重构机制,对输入的低分辨率图像,以及训练用高分辨率图像和对应的低分辨率图像进行分块,并使图像基本对齐,构造训练图像集。针对简化马尔可夫网络计算的需要以及训练集人脸图像的差异,在采用块坐标限位操作的基础上,使用了一种非线性样本搜索算法,降低了搜索空间复杂度,提高了匹配效率和相关性。算法利用搜索到的高分辨率图像分块样本,直接输出超分辨率图像。分析和实验表明,与传统学习算法相比,该方法具有输出质量好、效率高的特点。     

Face Super-resolution Reconstruction and Recognition Using Non-local Similarity Dictionary Learning Based Algorithm

One of the challenges of face recognition in surveillance is the low resolution of face region. Therefore many superresolution (SR) face reconstruction methods are proposed to produce a high-resolution face image from one or a set of low-resolution face images. However, existing dictionary learning based algorithms are sensitive to noise and very time-consuming. In this paper, we define and prove the multi-scale linear combination consistency. In order to improve the performance of SR, we propose a novel SR face reconstruction method based on nonlocal similarity and multi-scale linear combination consistency (NLS-MLC). We further proposed a new recognition approach for very low resolution face images based on resolution scale invariant feature (RSIF). A series of experiments are conducted on two public face image databases to test feasibility of our proposed methods. Experimental results show that the proposed SR method is more robust and computationally effective in face hallucination, and the recognition accuracy of RSIF is higher than some state-of-art algorithms.      

基于马尔可夫网络人脸图像超分辨率非线性算法*

研究单幅人脸图像的超分辨率重构算法。采用马尔可夫网络模型描述重构机制,对输入的低分辨率图像,以及训练用高分辨率图像和对应的低分辨率图像进行分块,并使图像基本对齐,构造训练图像集。针对简化马尔可夫网络计算的需要以及训练集人脸图像的差异,在采用块坐标限位操作的基础上,提出了一种非线性样本搜索算法,降低了搜索空间复杂度,提高了匹配效率和相关性。算法利用搜索到的高分辨率图像分块样本,直接输出超分辨率图像。分析和实验证实,与传统学习算法相比,本方法具有输出质量好、效率高的特点。     

小波域中双稀疏的单幅图像超分辨

目的 过去几年,基于稀疏表示的单幅图像超分辨获得了广泛的研究,提出了一种小波域中双稀疏的图像超分辨方法。方法 由小波域中高频图像的稀疏性及高频图像块在空间冗余字典下表示系数的稀疏性,建立了双稀疏的超分辨模型,恢复出高分辨率图像的细节系数;然后利用小波的多尺度性及低分辨率图像可作为高分辨率图像低频系数的逼近的假设,超分辨图像由低分辨率图像的小波分解和估计的高分辨率图像的高频系数经过二层逆小波变换来重构。结果 通过大量的实验发现,双稀疏的方法不仅较好地恢复了图像的局部纹理与边缘,且在噪声图像的超分辨上也获得了不错的效果。结论 与现在流行的使用稀疏表示的超分辨方法相比,双稀疏的方法对噪声图像的超分辨效果更好,且计算复杂度减小。     

Image super resolution by dilated dense progressive network

Image super-resolution (SR) is an interesting topic in computer vision. However, it remains challenging to achieve high-resolution image from the corresponding low-resolution version due to inherent variability, high dimensionality, and small ground targets images. In this paper, a new model based on dilated convolutional neural network is proposed to improve the image resolution. Recently, deep learning methods have led to significant improvements and completely outpace other models. However, these methods have not fully exploited all the features of the original low-resolution image, because of complex imaging conditions and the degradation process. To address this issue, we proposed an effective model based on dilated dense network operations to accelerate deep networks for image SR, which support the exponential growth of the receptive field parallel by increasing the filter size. In particular, residual network and skip connections are used for deep recovery. The experimental evaluations on several datasets prove the efficiency and stability of the proposed model. The proposed model not only achieves state-of-the-art performance but also has more efficient computation.     

Clustering based multiple branches deep networks for single image super-resolution

Since the limitation of optical sensors, it’s often hard to obtain an image with the ideal resolution. Image super-resolution (SR) technology can generate a high-resolution image from the corresponding low-resolution image. Recently, deep learning (DL) based SR methods draw much attention due to their satisfying reconstruction results. However, these methods often neglect the diversity of image patches. Therefore, the reconstruction effect is limited. To fully exploit the texture variability across different image patches, we propose a universal, flexible, and effective framework. The proposed framework can be adopted to any DL based methods. It can significantly improve the SR accuracy while maintaining the running time. In the proposed framework, K-means is employed to cluster image patches into different categories. Multiple CNN branches are designed for these different categories to reconstruct the SR image. Each branch is weighted in accordance with the Euclidean distance to the cluster centers. Experimental results demonstrate that by applying the proposed framework, performance of the DL based SR method can be significantly improved.

     

Hallucinating Compressed Face Images

A face hallucination algorithm is proposed to generate high-resolution images from JPEG compressed low-resolution inputs by decomposing a deblocked face image into structural regions such as facial components and non-structural regions like the background. For structural regions, landmarks are used to retrieve adequate high-resolution component exemplars in a large dataset based on the estimated head pose and illumination condition. For non-structural regions, an efficient generic super resolution algorithm is applied to generate high-resolution counterparts. Two sets of gradient maps extracted from these two regions are combined to guide an optimization process of generating the hallucination image. Numerous experimental results demonstrate that the proposed algorithm performs favorably against the state-of-the-art hallucination methods on JPEG compressed face images with different poses, expressions, and illumination conditions.     

Robust super resolution of compressed video

This paper presents a robust algorithm to recover high-frequency information from compressed low-resolution (LR) video sequences. Previous super-resolution (SR) approaches have succeeded in resolution enhancement when the motion in the LR sequence is simple. However, when the motion is complex, new artifacts will be introduced in the SR processing. To solve this problem, we develop a robust Bayesian SR algorithm with two steps. We first isolate the frames individually to get their corresponding initial SR solutions within the Bayesian framework. Secondly, with a robust cost function to reject outliers and noise, final SR images are achieved with multiple LR frames. In the mean time, we impose the constraint that the distribution of high-resolution (HR) image gradient should be equal to one of the corresponding decompressed LR images to sharpen the edges of the results. As a result of these steps, we are able to produce high-quality deblurred results, which show a suppressing of high-frequency artifacts and less ringing artifacts, with a higher peak signal-to-noise ratio (PSNR).     

Multi-sensor image super-resolution with fuzzy cluster by using multi-scale and multi-view sparse coding for infrared image

Super-resolution (SR) methods are effective for generating a high-resolution image from a single low-resolution image. However, four problems are observed in existing SR methods. (1) They cannot reconstruct many details from a low-resolution infrared image because infrared images always lack detailed information. (2) They cannot extract the desired information from images because they do not consider that images naturally come at different scales in many cases. (3) They fail to reveal different physical structures of low-resolution patch because they extract features from a single view. (4) They fail to extract all the different patterns because they use only one dictionary to represent all patterns. To overcome these problems, we propose a novel SR method for infrared images. First, we combine the information of high-resolution visible light images and low-resolution infrared images to improve the resolution of infrared images. Second, we use multiscale patches instead of fixed-size patches to represent infrared images more accurately. Third, we use different feature vectors rather than a single feature to represent infrared images. Finally, we divide training patches into several clusters, and multiple dictionaries are learned for each cluster to provide each patch with a more accurate dictionary. In the proposed method, clustering information for low-resolution patches is learnt by using fuzzy clustering theory. Experiments validate that the proposed method yields better results in terms of quantization and visual perception than the state-of-the-art algorithms.     

Locally affine patch mapping and global refinement for image super-resolution

This paper deals with the super-resolution (SR) problem based on a single low-resolution (LR) image. Inspired by the local tangent space alignment algorithm in [16] for nonlinear dimensionality reduction of manifolds, we propose a novel patch-learning method using locally affine patch mapping (LAPM) to solve the SR problem. This approach maps the patch manifold of low-resolution image to the patch manifold of the corresponding high-resolution (HR) image. This patch mapping is learned by a training set of pairs of LR/HR images, utilizing the affine equivalence between the local low-dimensional coordinates of the two manifolds. The latent HR image of the input (an LR image) is estimated by the HR patches which are generated by the proposed patch mapping on the LR patches of the input. We also give a simple analysis of the reconstruction errors of the algorithm LAPM. Furthermore we propose a global refinement technique to improve the estimated HR image. Numerical results are given to show the efficiency of our proposed methods by comparing these methods with other existing algorithms.     

Deep convolution network for surveillance records super-resolution

Multimedia Tools and Applications - The aim of image super resolution (SR) is to recover low resolution (LR) input image or video to a visually desirable high-resolution (HR) one. The task of...     

中文文本图像倒置快速检测算法

针对图像处理(如OCR技术)对图像方向要求十分严格,文本图像方向具有不确定性的问题,提出了中文文本图像倒置快速检测算法.利用投影技术定位出文本字符,结合中文字符及标点符号结构特征,筛选出文本图像中的标点符号,根据标点符号像素分布特点判断出类型,结合标点符号的使用习惯,采用统计的方法判断中文文本图像是否倒置.实验结果表明,投影方法可以不用基于内容达到高效快速的要求,利用统计方法可以保证判别率,该方法可用于OCR预处理过程.     

基于非线性最小二乘的图像自适应SR重建以及运动估计

图像超分辨率（SR）重建是利用数字信号处理技术由一系列低分辨率观测图像得到高分辨率图像。为了扩展SR技术的应用范围,提出了一种同时进行图像超分辨率重建和全局运动估计的方法。该方法首先基于最大后验概率(MAP)给出了图像SR重建和运动估计框架,该框架不仅考虑了前后两次迭代所得的HR图像差值对最终重建图像的影响,而且引入了不同LR图像对重建图像的重要性权值,使得算法具有自适应性;然后将总体框架转换为图像SR重建模型和运动估计模型;最后基于非线性最小二乘法对模型进行优化求解,得出了SR重建图像及其全局运动域。实验表明,该方法不仅图像重建效果良好,并有着良好的收敛性。     

A Variational Model for P+XS Image Fusion

We propose an algorithm to increase the resolution of multispectral satellite images knowing the panchromatic image at high resolution and the spectral channels at lower resolution. Our algorithm is based on the assumption that, to a large extent, the geometry of the spectral channels is contained in the topographic map of its panchromatic image. This assumption, together with the relation of the panchromatic image to the spectral channels, and the expression of the low-resolution pixel in terms of the high-resolution pixels given by some convolution kernel followed by subsampling, constitute the elements for constructing an energy functional (with several variants) whose minima will give the reconstructed spectral images at higher resolution. We discuss the validity of the above approach and describe our numerical procedure. Finally, some experiments on a set of multispectral satellite images are displayed.     

Robust reconstruction of low-resolution document images by exploiting repetitive character behaviour

In this paper, we present a new approach for reconstructing low-resolution document images. Unlike other conventional reconstruction methods, the unknown pixel values are not estimated based on their local surrounding neighbourhood, but on the whole image. In particular, we exploit the multiple occurrence of characters in the scanned document. In order to take advantage of this repetitive behaviour, we divide the image into character segments and match similar character segments to filter relevant information before the reconstruction. A great advantage of our proposed approach over conventional approaches is that we have more information at our disposal, which leads to a better reconstruction of the high-resolution (HR) image. Experimental results confirm the effectiveness of our proposed method, which is expressed in a better optical character recognition (OCR) accuracy and visual superiority to other traditional interpolation and restoration methods.     

基于多尺度结构自相似性的单幅图像超分辨率算法

多尺度结构自相似性是指同一幅图像中存在相同尺度或不同尺度的相似结构,这种多尺度图像结构自相似性广泛存在于遥感图像中.本文提出了一种基于多尺度结构自相似性的单幅图像超分辨率（Super resolution,SR）算法,该算法结合了压缩感知框架与图像结构自相似性,利用非局部方法和基于图像金字塔的K-SVD字典学习方法,将蕴含在相同尺度和不同尺度相似图像块中的附加信息在压缩感知的框架下加入到重构图像中.本文算法的优势在于,它仅借助于单幅低分辨率图像自身所蕴含的信息,实现了空间分辨率的提升.实验表明,与CSSS算法和ASDSAR算法相比,本文算法更有效地提升了遥感图像的空间分辨率.     

A new framework for remote sensing image super-resolution: Sparse representation-based method by processing dictionaries with multi-type features

Remote sensing images play an important role in many practical applications, however, due to the physical limitations of remote sensing devices, it is difficult to obtain images at an expecting high resolution level. Acquiring high-resolution(HR) images from the original low-resolution(LR) ones with super-resolution(SR) methods has always been an attractive proposition in embedded systems including various kinds of tablet PC and smart phone. SR methods based on sparse representation have been successfully used in processing remote sensing images, however, they have two major problems in common. First, they use only one type of image features to represent the low resolution(LR) images. However, one single type of features cannot accurately represent an image due to the diverse structures of the image, as a result, artifacts would be produced simultaneously. Second, many dictionary learning methods try to build a universal dictionary with only one single type of features. However, apparently, a dictionary with a single type of features is not enough to capture the different structures of a remote sensing image, without any doubt, the resultant image would turn out to be a poor one. To overcome the problems above, we propose a new framework for remote sensing image super resolution: sparse representation-based SR method by processing dictionaries with multi-type features. First, in order to represent the remote sensing image more accurately, different types of features are extracted from images. Second, to achieve a better performance, various dictionaries with multi-type features are learned to capture the essential structures of the image. Then, it’s proposed to adaptively control the weights of the high resolution(HR) patches obtained by different dictionaries. Numerous experiments validate that this proposed framework brings better results in terms of both objective quantitation and visual perception than other compared algorithms.