结构相似度在AVS帧间模式选择中的应用

传统的音视频编码标准(AVS)率失真优化(RDO)算法在帧间模式选择中使用偏差平方和(SSD)作为失真度量,不能很好符合人的主观视觉,而最近提出的结构相似度(SSIM)图像质量评价方法更符合人眼视觉系统(HVS)的特性.为了有效地提高编码效率,本文将SSIM引入拉格朗日代价函数,对失真度量的表示进行修正,并在大量实验的...     

一种基于局部方差和结构相似度的图像质量评价方法

针对结构相似度(SSIM)方法对图像不同失真类型的敏感程度不同的问题,提出了一种基于局部方差和结构相似度的图像质量评价方法.计算并比较了两图像整体局部方差的分布,分析了度量结果所表征的图像特征.局部方差较好地体现了图像的细节信息,因此对于模糊等失真类型较为敏感,但是对于噪声污染等失真类型的敏感程度较低.因此,本文提出的评价方法将局部方差与结构相似度方法相结合,平衡了二者对造成图像失真各种因素的不同敏感偏向,从而使评价结果更加接近人眼对图像质量的主观感觉.实验结果表明,该方法充分考虑了图像中人跟比较敏感的细节信息的完整程度对图像质量的影响,评价结果优于SSIM方法,与人的主观感觉的一致性较好.     

基于结构信息和像素失真的客观图像质量评价

为了度量多种失真类型的图像质量,根据人类视觉系统(HVS)对图像空域结构信息高度敏感和任一类型的失真都会产生像素失真理论,提出一种基于结构信息和像素失真的无参考的质量评价方法.该方法利用色彩信息提取能够表征图像结构信息的视觉内容结构图,并加权像素失真来度量图像质量,同时对部分失真类型进行修正.该方法不涉及任何参数设置也无需训练过程.实验结果表明,该方法能够较好地评价白噪声、JPEG压缩、高斯模糊、JPEG2000压缩和FastFading等失真图像的质量,并与主观评价方法有较好的一致性.     

基于梯度信息的图像质量评判方法的研究

图像质量客观评判标准广泛应用于图像处理中,基于人眼视觉系统的客观评判方法一直是图像处理领域的研究热点.最近,Zhou Wang等人提出了基于结构信息的评判方法—结构相似度(SSIM),它的理论基础是人眼视觉系统能高度自适应地提取场景中的结构信息.SSIM方法简单、评判性能优于PSNR(或MSE).但随着研究的深入,我们发现SSIM算法存在着一些问题,特别是不能很好地评判模糊失真类的图像.本文提出两种基于梯度信息的图像质量评判方法—基于梯度的结构相似度(GSSIM)和基于边缘的结构相似度(ESSIM).实验结果表明,GSSIM能更好地符合人眼视觉系统特性,而ESSIM对于模糊图像则取得了最好的评判效果.     

基于SSE和SSIM的H.264帧内预测模式选择改进算法

在H.264的帧内预测模式选择过程中,率失真优化(RDO)的失真测度用当前编码块和预测块之间的平方误差和(SSE)或绝对误差和(SAD)来度量,而这两种失真测度被证明不能很好地符合人眼视觉(HVS)。该文参考软件JM16.2,提出了联合SSE和结构相似度(SSIM)作为失真测度用于RDO的方法(CSSRDO)。算法首先找到SSIM和码率的近似关系, 然后综合以SSE作为失真测度的RDO函数,并结合人眼视觉特性,建立了联合SSE和SSIM作为失真测度的RDO模型。实验表明,将CSSRDO用于H.264帧内预测模式选择获得了比JM16.2更高的编码效率和更好的重建图像质量。     

基于三维特征和结构相似度的图像质量评价方法

分析了人眼视觉特性、双眼视差异信息等三维特征,将立体视觉与图像的结构相似度(SSIM)相结合,提出了一种新的立体图像质量评价方法。该方法考虑了立体图像的亮度、纹理细节和空间位置等因素对人感知立体效果的影响,利用加权平均结构相似性(WMSS)联合统计学方法得到评价初值,用包含三维景物深度信息的双眼视差信息进行修正,作为立体图像质量的评价结果。实验表明,该方法符合人眼视觉特性,与主观评价(MOS)的一致性较好。     

一种基于视觉特性的图像质量评价指标

在分析多通道结构、遮掩效应、敏感度带通特性等人类基本视觉特性（HVS）的基础上,提出了一种新的图像质量评价指标的构造方法。指标构造先借助多尺度几何分析（MGA）中的Contourlet变换对图像进行子带分解以此模拟视觉多通道结构特性,然后在各子带中使用一种遮掩效应模型获取失真图像和参考图像之间的视觉误差,最后通过对比度敏感函数（CSF）获取不同子带的视觉误差加权系数,从而获取图像质量评价值。本文在具有5种类型降质图像的LIVE图库进行性能比较实验,结果表明本文所设计指标比峰值信噪比PSNR、结构相似度SSIM算法具有更好的稳定性和主客观评价一致性。      

基于局部结构张量的SSIM图像质量评价

针对结构相似度(SSIM)评价模糊图像存在的局限性,提出一种基于局部结构张量的结构相似性图像质量评价方法(ST-SSIM).方法首先利用结构张量提取图像几何结构强度和方向角度信息,然后用局部结构方向相似度比较函数和结构强度相似度比较函数替换SSIM中原有的结构比较函数,最后在图像质量映射图上以参考图像的结构强度函数加权计算得出最终的图像质量评价值.实验结果表明,由于LST-SSIM更加全面考虑到对于人眼感知结构强度和方向的重要性,因此评价结果比SSIM更加符合人眼视觉感知特性.     

利用梯度奇异值分解的图像结构相似度评价

针对传统的图像质量评价方法中对图像结构信息的表征能力不足的问题,在研究了基于结构相似度和奇异值分解的两种图像评价方法的基础上,结合其不同特点提出了基于奇异值分解的结构相似度质量评价方法.该算法分别将参考图像和失真图像的梯度图像分成8×8大小的图像块,并对每一个图像块进行奇异值分解后计算对应图像块的奇异值相似性和各图像块局部方差分布的相似性,最后结合各图像块的奇异值相似性和图像的局部方差分布的相似来表征图像的畸变程度.对LIVE库中包括5种失真类型的982幅图像进行验证,其结果表明该评价方法能很好地对各种失真类型的图像进行评价,比峰值信噪比(PSNR)、结构相似度(SSIM)等算法的主客观一致性更好,更加符合人眼的视觉特性.     

基于结构相似度的自适应图像质量评价

考虑到在结构相似度(SSIM,structural similarity)模型中,亮度、对比度和结构度3个评价因子对不同失真类型图像质量评价(QA)的贡献程度不同,本文提出了根据图像失真类型分析的自适应SSIM(ASSIM)的IQA方法。首先,分析失真图像和参考图像的小波子带能量、傅里叶功率谱和幅度谱的数据特点,据此判定图像失真类型,包括高斯白噪声(WN)、JPEG压缩(JPEM)、高斯模糊(Gblur)及类JP2K4类失真;接着,通过优化算法确定SSIM在评价不同失真类型图像时最佳的评价因子权重;最后,将图像的失真类型判别和评价因子的调整相结合,实现对图像的自适应评价。实验结果表明,由于失真类型的判断和评价因子权值的优化,ASSIM对各类失真图像的评价效果都要优于SSIM,特别是对Gblur失真的图像进行评价时,Pearson系数(CC)值提高了0.05,Spearman等级相关系数(SROCC)值的提高超过0.039。     

基于小波第二级系数误差的图像质量评价模型

图像质量研究的目标是设计客观评价算法,它与主观评价有很强的相关性.本文根据人眼对图像高低频失真的敏感度不同,采用不同方法分别计算图像高频和低频失真量,然后将两种失真量直接相乘得到客观评价值.实验结果表明,这种客观评价模型能够一致评价各种失真类型、各种失真强度的图像质量,与LIVE图库上差异主观评价分(DMOS)的线性相关性优于PSNR、LMSE和SSIM算法.     

Structural similarity quality metrics in a coding context: exploring the space of realistic distortions

Perceptual image quality metrics have explicitly accounted for human visual system (HVS) sensitivity to subband noise by estimating just noticeable distortion (JND) thresholds. A recently proposed class of quality metrics, known as structural similarity metrics (SSIM), models perception implicitly by taking into account the fact that the HVS is adapted for extracting structural information from images. We evaluate SSIM metrics and compare their performance to traditional approaches in the context of realistic distortions that arise from compression and error concealment in video compression/transmission applications. In order to better explore this space of distortions, we propose models for simulating typical distortions encountered in such applications. We compare specific SSIM implementations both in the image space and the wavelet domain; these include the complex wavelet SSIM (CWSSIM), a translation-insensitive SSIM implementation. We also propose a perceptually weighted multiscale variant of CWSSIM, which introduces a viewing distance dependence and provides a natural way to unify the structural similarity approach with the traditional JND-based perceptual approaches.     

Perceptual image quality assessment based on structural similarity and visual masking

We propose an improved objective image quality assessment method based on the structural similarity and visual masking, called the Perceptual Image Quality Assessment (PIQA). The PIQA contains three similarity measures: the luminance comparison measure, the structure comparison measure, the contrast comparison measure as same as the Structure Similarity (SSIM) and its variants. Firstly, in order to improve the ability of distinguishing the structure information in blurred images and noisy images, we modify the structure comparison measure by using the improved structure tensor which is more efficient for describing the structure information in global areas. Secondly, based on the perceptual characters of Human Visual System (HVS) perceptual process, the contrast masking and neighborhood masking are integrated to the contrast comparison measure. Finally, three measures are pooled together to compute the PIQA metric. Comparing with the state-of-the-art methods including Multi-scale SSIM (MS-SSIM), Visual Signal to Noise Ratio (VSNR) and Visual Information Fidelity (VIF) criterion, simulation results show that our approach is highly consistent with HVS perceptual process, and also delivers better performance.     

Jensen–Shannon divergence for visual quality assessment

This paper focuses on some theoretical properties of the Jensen–Shannon divergence (JSD) that well match human visual system (HVS) features. In particular, it is firstly shown that JSD between the probability density function (pdf) of the reference (original) image and the test (distorted) one can be reformulated as a mathematical expansion, independently of the image subject and the distortion kind. Such expansion contains a component of the well-known structural similarity measure (SSIM), some powers of the Weber’s law, and an additional component tied to the skewness of the involved pdfs. This theoretical link with some HVS-based quantities is further stressed by some experimental results showing that JSD has a trend similar to other popular quality assessment measures like SSIM, VIF, and MSE on frequent degradation kinds like JPEG, Additive Gaussian Noise, Gaussian Blur, and JPEG2K. Experimental tests on several images from LIVE database show that the proposed approach can be a valid theoretical and objective support for modeling HVS behavior.     

基于非局部均值滤波的SAR图像去噪

该文提出一种基于结构相似性指数(SSIM)的非局部均值(Non Local means,NL-means)滤波的合成孔径雷达(SAR)图像相干斑噪声抑制新方法。该方法用SSIM改进NL-means算法中小块相似性的度量,能利用结构信息来进行相干斑抑制。通过在真实SAR图像上的实验表明,与GammaMAP滤波、CHMT算法、BLS-GSM算法、NL-means滤波相比,此方法在有效去除相干斑噪声的同时能更好地保持边缘结构信息。     

Image quality assessment using a SVD-based structural projection

The development of objective image quality assessment (IQA) metrics aligned with human perception is of fundamental importance to numerous image-processing applications. Recently, human visual system (HVS)-based engineering algorithms have received widespread attention for their low computational complexity and good performance. In this paper, we propose a new IQA model by incorporating these available engineering principles. A local singular value decomposition (SVD) is first utilised as a structural projection tool to select local image distortion features, and then, both perceptual spatial pooling and neural networks (NN) are employed to combine feature vectors to predict a single perceptual quality score. Extensive experiments and cross-validations conducted with three publicly available IQA databases demonstrate the accuracy, consistency, robustness, and stability of the proposed approach compared to state-of-the-art IQA methods, such as Visual Information Fidelity (VIF), Visual Signal to Noise Ratio (VSNR), and Structural Similarity Index (SSIM).     

A new image quality assessment based on HVS

This letter proposes a new kind of image quality philosophy Modulate Quality based on Fixation Points (MQFP) based on Human Visual System (HVS) model. Dissimilar to the former HVS-based quality assessment, the new measure emphasizes particularly on modeling the jumping phenomenon of human sight instead of modeling the visual perception of human.In other words, to model the HVS using fixation points and stay-frequency instead of Contrast Sensitive Function (CSF) etc. which models the visual perception of HVS. The experiment on various frequency-distortion images indicates that the new measure is correlated with the subjective judgment more than the former HVS-based measure and is a robust measure.