基于亮度统计的无参考图像质量评价

基于亮度均值减损对比归一化(MSCN) 系数统计特性及其8方 向邻域系数间的相关性,提出了一种通用无参考图像质量评价方法.首先,分别利用非 对称广义高斯分布(AGGD)模型拟合MSCN系数及其8方 向邻域系数,并估计 相应AGGD 模型参数作为亮度统计特征;其次,计算8方向邻域MSCN系数间的互信息(MI),作为描述方向相 关性的统计特征;进而,分别利用支持向量回归机(SVR)和支 持向量分类机(SVC)构建无参考图像质量评价模型和图像失真类型识别模型; 最后, 在LIVE 等图像质量 评价数据库上进行了算法与DMOS的相关性、失真类型识别、模型 鲁棒性及计算复杂性等方面的实验。实 验结果表明,本文方法的评价结果与人类主观评价具有高度的一致性,在LIVE图像质量评 价数据库上的斯 皮尔曼等级相关系数(SROCC)和皮尔逊线性相关系数 (PLCC)均在0.945以上;而且,图像失真 类型识别模型的识别准确率也高达到92.95%,明显高于 当今主流无参考图像质量评价方法。     

No-reference image quality assessment based on neighborhood co-occurrence matrix

No-reference image quality assessment (NR-IQA) aims to develop models that can predict the quality of distorted image automatically and accurately in the absent of reference image. Previous NR-IQA methods based on natural scene statistics (NSS) always focus on the luminance contrast of image but attach limited attention to pixel-wise relationship. However, human visual system (HVS) is highly adaptive to extract spatial correlation according to relative position within visual field. In this paper, a new approach is proposed for NR-IQA, in which the neighborhood co-occurrence matrix (NCM) is introduced to describe spatial correlation of pixels for quality assessment. The NCM is constructed based on spatial correlation of every pixel and its neighborhood through a mapping to highlight the one-to-many pixel-wise relationship. Moreover, a series of tailored statistical metrics are designed to quantify the unnaturalness extent of NCM effectively, which is combined with others natural scene statistics to predict image quality. Extensive experiments demonstrate the proposed method has superior performance against compared methods, and achieves significant improvements on distortions associated with color or locality.     

基于深层特征学习的无参考立体图像质量评价

提出了一种基于深层特征学习的无参考(NR)立体图 像质量评价方 法。与传统人工提取图像特征不同,采用卷积神经网络(CNN)自动提取图像特征,评价过程 分为训练和 测试两阶段。在训练阶段,将图像分块训练CNN网络,利用CNN提取图像块特征,并结合不同 的整合方式 得到图像的全局特征,通过支持向量回归(SVR)建立主观质量与全局特征的回归模型;在测 试阶段,由已训练的CNN网 络和回归模型,得到左右图像和独眼图的质量。最后,根据人眼双目视觉特性融合左图像、 右图像和独眼 图的质量,得到立体图像质量。本文方法在LIVE-I和LIVE-II数据库上的Spearman等级系 数(SROCC)分别达 到了0.94,评价结果准确,与人眼的主 观感受一致。     

基于引导调制的彩色点云无参考质量评价方法

彩色点云(color point cloud, CPC)作为三维场景和对象的有效描述形式,在虚拟现实、增强现实等许多领域得到重要应用。CPC在其采集、压缩、传输、重建等过程中会引入相应的失真,需要设计有效的评价方法对失真CPC质量进行评测。本文提出一种基于引导调制的CPC无参考质量评价方法。考虑到几何信息与彩色纹理信息的联合失真,利用引导调制的方法联立两者,以综合考虑几何失真、彩色纹理失真、联合失真。结合人眼的多通道性,利用剪切波变换提取特征。最后,将所有特征构成的特征向量输入到支持向量回归模型(support vector regression, SVR)学习预测点云质量。实验结果表明,所提出的方法与人类主观感知具有很好的一致性。     

基于人工神经网络的长江水质评价模型

为了能够客观地对长江水质进行评价,在分析人工神经网络原理的基础上,通过对水质污染指标浓度生成样本的方法,生成了适用于人工神经网络模型训练的样本,并应用基于误差反向传播原理的前向多层神经网络,建立了用于长江水质评价的人工神经网络模型。将该模型用于长江水环境评价,通过模型的计算,得到长江水质类别。评价结果表明该模型设计合理、泛化能力强,对长江水质评价具有较好的客观性、通用性和实用性。     

Unsupervised blind image quality assessment based on joint structure and natural scene statistics features

Compared with the widely used supervised blind image quality assessment (BIQA) models, unsupervised BIQA models require little prior knowledge for calculating the objective quality scores of distorted images. In this paper, we propose an unsupervised BIQA method that aims to achieve both good performance and generalization capability with low computational complexity. Carefully selected and extensive structure and natural scene statistics (NSS) features can better represent image quality. First, we employ phase congruency (PC) and finely selected gradient magnitude map and Laplacian of Gaussian response (GM-LOG) features to represent image structure information. Second, we calculate the local mean-subtracted and contrast-normalized (MSCN) coefficients and the Karhunen–Loéve transform (KLT) coefficients to represent the naturalness of the distorted images. Last, multivariate Gaussian (MVG) model with joint features extracted from both the pristine images and the distorted images is adopted to calculate the objective image quality. Extensive experiments conducted on nine IQA databases demonstrate that the proposed method achieves better performance than the state-of-the-art BIQA methods.     

C-DIIVINE: No-reference image quality assessment based on local magnitude and phase statistics of natural scenes

It is widely known that the wavelet coefficients of natural scenes possess certain statistical regularities which can be affected by the presence of distortions. The DIIVINE (Distortion Identification-based Image Verity and Integrity Evaluation) algorithm is a successful no-reference image quality assessment (NR IQA) algorithm, which estimates quality based on changes in these regularities. However, DIIVINE operates based on real-valued wavelet coefficients, whereas the visual appearance of an image can be strongly determined by both the magnitude and phase information.In this paper, we present a complex extension of the DIIVINE algorithm (called C-DIIVINE), which blindly assesses image quality based on the complex Gaussian scale mixture model corresponding to the complex version of the steerable pyramid wavelet transform. Specifically, we applied three commonly used distribution models to fit the statistics of the wavelet coefficients: (1) the complex generalized Gaussian distribution is used to model the wavelet coefficient magnitudes, (2) the generalized Gaussian distribution is used to model the coefficients׳ relative magnitudes, and (3) the wrapped Cauchy distribution is used to model the coefficients׳ relative phases. All these distributions have characteristic shapes that are consistent across different natural images but change significantly in the presence of distortions. We also employ the complex wavelet structural similarity index to measure degradation of the correlations across image scales, which serves as an important indicator of the subbands׳ energy distribution and the loss of alignment of local spectral components contributing to image structure. Experimental results show that these complex extensions allow C-DIIVINE to yield a substantial improvement in predictive performance as compared to its predecessor, and highly competitive performance relative to other recent no-reference algorithms.     

基于运动和视差信息的立体视频质量客观评价

在研究人类 立体视觉特性及现有立体图像/视频质量评价算法的基础上,提出了一种基于运动信息和视 差信息的立 体视频质量的客观评价方法。方法包括视频质量评价(VQA)和视频立体感评价(VSSA)两个指 标,其中VQA的估计基于梯度的结构相似度(GSSIM) 算法,并充分考虑了帧内的亮度信息和结构信息、帧间运动信息以及人眼的感知特性对视频 质量的影响, 特别是根据人类的视觉特性,对左右视点的质量赋予了不同的权重;VSSA的估计 是通过计算参考 视频的绝对差值图和降质视频的绝对差值图之间的峰值信噪比(PSNR)而得到。实验结果表明,本文方法对基于H.264 编码的失真视频的评价结果与主观测试有较高的一致性,很好地体现人眼的视觉特性。