采用灰度共生矩阵进行深度预判的3D-HEVC深度图帧内快速编码算法

针对3D视频的3D-HEVC编码标准以多视点纹理视频和深度视频格式进行编码,其深度图编码仍延续纹理视频编码的模式和编码尺寸遍历选择,使得3D-HEVC的编码复杂度居高不下。本文针对深度图帧内预测编码,采用灰度共生矩阵对深度图中的CTU进行计算,统计并分析其矩阵中非零值个数与CTU分割深度的关系,根据非零值个数分布规律,设定阈值,使得帧内编码时可以预判编码模块的分割深度,从而选择性跳过部分不同深度CU的帧内预测过程。经过HTM16.0测试平台的检验,本算法在全帧内编码模式下,测试序列合成视点比特率仅增加0.08%的同时,平均节省了16.8%的编码时间,与其他同类较新算法在HTM16.0平台上的性能比较也有一定的优势。      

基于决策树的HEVC SCC帧内编码快速算法

为减少HEVC屏幕内容编码的编码时间,提高编码 效率,本文提出了一种基于决策树的HEVC屏幕内容帧内编码快速 CU划分和简单PU模式选择的算法。对视频序列特性分析,提取有效的特征值,生成决策树模 型。使用方差、梯度信息熵和 像素种类数用于生成CU划分决策树,使用平均非零梯度、像素信息熵等用于生成PU模式分类 决策树。在一定深度的决策 树模型中,通过对相应深度的CU的特征值的计算快速决策当前CU的划分与PU模式的类型。这 种利用决策树做判决的算法 通过减少CU深度和PU的模式遍历而降低编码复杂度,达到快速帧内编码的效果。实验结果表 明,与HEVC屏幕内容的标 准算法相比,该算法在峰值信噪比(PSNR)平均下降0. 05 dB和码率 平均增加1.15%的情况下,能平均减少30.81% 的编码时间。     

Fast algorithm based on the sole- and multi-depth texture measurements for HEVC intra coding

In High Efficiency Video Coding (HEVC), intra coding plays an important role, but also involves huge computational complexity due to a flexible coding unit (CU) structure and a large number of prediction modes. This paper presents a fast algorithm based on the sole- and multi-depth texture measurements to reduce the complexity from CU size and prediction mode decisions. For the CU size decision, evaluation results in the CU coding with one and multiple depths are utilized to classify CUs into heterogeneous, homogeneous, depth-prominent and other ones. Fast CU size decisions are made for different kinds of CUs. For the prediction mode decision, the tendencies for different CU sizes are detected based on multiple depths. The number of searching modes is decreased adaptively for the CU size with fewer tendencies. Experimental results show the proposed algorithm by off-line training reduces 53.32% computational complexity, with 1.47% bit-rate increasing.     

Self-learning residual model for fast intra CU size decision in 3D-HEVC

As an extension of the High Efficiency Video Coding (HEVC) standard, 3D-HEVC requires to encode multiple texture views and depth maps, which inherits the same quad-tree coding structure as HEVC. Due to the distinct properties of texture views and depth maps, existing fast intra prediction approaches were presented for the coding of texture views and depth maps, respectively. To further reduce the coding complexity of 3D-HEVC, a self-learning residual model-based fast coding unit (CU) size decision approach is proposed for the intra coding of both texture views and depth maps. Residual signal, which is defined as the difference between the original luminance pixel and the optimal prediction luminance pixel, is firstly extracted from each CU. Since residue signal is strongly correlated with the optimal CU partition, it is used as the feature of each CU. Then, a self-learning residual model is established by intra feature learning, which iteratively learns the features of the previously encoded coding tree unit (CTU) generated by itself. Finally, a binary classifier is developed with the self-learning residual model to early terminate CU size decision of both texture views and depth maps. Experimental results show the proposed fast intra CU size decision approach achieves 33.3% and 49.3% encoding time reduction on average for texture views and depth maps with negligible loss of overall video quality, respectively.     

一种屏幕内容编码帧间模式快速选择算法

屏幕内容编码(SCC)作为高效视频编码(HEVC )的扩展,在压缩屏幕内容方面有着显著的效果, 但也导致了编码器计算复杂度较高的问题。为此,本文提出一种屏幕内容编码帧间模式快速 选择算法。首 先,根据像素点亮度值的变化情况,提前判断出静止区域并使用Skip模式;其次,根据屏幕 内容多包含有 水平及竖直边缘的特点,利用编码单元(CU)的水平及竖直活动性确定相应的预测单元(PU )划分模式, 减少帧间预测时需要遍历的PU个数;最后,根据时空域相邻CU的深度信息预测当前CU的深度 范围,跳 过不必要的深度遍历。实验结果表明,与SCM-8.0相比,在随机接入与低延时两种编码模式 下,本文所提 算法分别节省43.6%和49.09%的编码时间,码 率分别上升3.06%和3.43%,视频质量几乎不变 。     

一种HEVC帧内快速编码算法

高效视频编码(HEVC)采用编码单元(CU)四叉树的 分割结构,相比H.264/AVC显著地提升了编码效 率,但却使编码复杂度急剧增加。为此,本文提出一种帧内快速编码算法。首先,根据视 频图像纹理复 杂度,提前判断是否进行最大编码单元(LCU)分割。然后,根据空域相邻CU的深度预测当前C U的深度范围, 跳过不必要的计算;最后,根据预测模式被选为最优预测模式的统计特性,去掉可能性小的 帧内预测模式。本文算法在HM14.0的基础上实现。 仿真结果表明,本文算法在全I帧模式下与HM14.0相比,帧内编码时 间平均减少38%,码率(BR)只增加1.41%,峰值信噪比(PSNR)只降低0.29dB,在保证编码性能和视频质量几乎不变的 情况下,本文算法降低了编码的计算复杂度。     

Rough mode cost–based fast intra coding for high-efficiency video coding

The quadtree-based coding unit (CU) and transform unit (TU) structure, as well as various prediction units (PUs) of HEVC, considerably increase encoding complexity in intra coding and inter coding. This paper proposes a rough mode cost (RMC)-based algorithm for accelerating CU/TU depth decisions and PU mode decisions in HEVC intra coding. For CU depth decisions, RMC values are used for the fast determination of CU partition. In the case of PU mode decisions, modes with higher RMCs are removed from the candidate list to reduce the number of test modes. For TU depth decisions, the TU partition of the mode with the least RMC is used to determine the TU partitions of remaining modes. The proposed TU partitioning method demonstrates superior performance to the default method in reference software. The proposed algorithm can reduce encoding time by approximately 51% on average, with a 0.69% increase in the Bjøntegaard-Delta (BD) rate.     

采用联合特征的H.266/VVC屏幕内容快速模式选择算法

新一代视频编码标准H.266/VCC针对屏幕内容编码引入帧内块复制、调色板等预测模式,在提高编码效率的同时也带来了巨大的计算复杂度。本文采用角点、水平/垂直活动度和平均颜色亮度差联合特征对屏幕内容视频帧和当前编码单元（Coding Unit, CU）进行分类,将视频帧分为低对比度屏幕视频帧和高对比度屏幕视频帧,将CU细分为自然内容背景CU、屏幕内容背景CU和屏幕内容前景CU,进而对CU模式进行选择性跳过,减少模式选择代价。实验结果显示,在全帧内的条件下,该算法与开启IBC和PLT的H.266/VVC VTM-7.3标准相比,在码率仅增加1.21%的情况下节省了26.41%的编码时间,降低了编码复杂度。      

Fast coding unit partitioning algorithms for versatile video coding intra coding

Versatile video coding (VVC) is the newest video compression standard. It adopts quadtree with nested multi-type tree (QT-MTT) to encode square or rectangular coding units (CUs). The QT-MTT coding structure is more flexible for encoding video texture, but it is also accompanied by many time-consuming algorithms. So, this work proposes fast algorithms to determine horizontal or vertical split for binary or ternary partition of a 32 × 32 CU in the VVC intra coding to replace the rate-distortion optimization (RDO) process, which is time-consuming. The proposed fast algorithms are actually a two-step algorithm, including feature analysis method and deep learning method. The feature analysis method is based on variances of pixels, and the deep learning method applies the convolution neural networks (CNNs) for classification. Experimental results show that the proposed method can reduce encoding time by 28.94% on average but increase Bjontegaard delta bit rate (BDBR) by about 0.83%.     

结合内容特性与纹理类型的HEVC-SCC帧内预测快速算法

本文提出了一种结合内容特性与纹理类型的HEVC-SCC帧内预测快速算法。利用自然内容和屏幕内容视频DCT变换后系数能量分布不同的特点,结合当前预测单元（Prediction Unit, PU）梯度信息,将编码树单元（Coding Tree Unit, CTU）分成自然内容CTU,简单屏幕内容CTU和复杂屏幕内容CTU。对于自然内容CTU,选择35种传统帧内模式作为候选模式,跳过帧内块复制（Intra Block Copy, IBC）和调色板（Palette mode, PLT）模式;对于简单屏幕内容CTU,选择DC,PLANAR,水平和垂直模式作为候选模式,跳过IBC和PLT模式;对于复杂屏幕内容CTU,选择IBC和PLT模式,跳过其他候选模式。实验结果表明,在全I帧条件下,该算法相较于SCM-8.3可以节省38.55%的编码时间,大幅度降低了编码复杂度的同时只增加了1.82%的码率。      

基于灰度差值的HEVC快速帧间编码研究

针对新一代视频压缩编码标准HEVC计算复杂度较高的特点,利用视频序列间时域上的相关性,提出了一种基于灰度差值的编码单元快速划分策略.该策略根据当前编码块与参考块之间的灰度差值进行运动条件判决,在进行编码之前提前确定当前编码单元的编码深度信息,减少帧间预测编码的次数,从而有效地降低了编码端的计算复杂度.实验结果表明,该算法在编码效率和峰值信噪比(PSNR)损失都很小的情况下,和HM标准中的帧间预测算法相比,平均降低了50.18％的编码时间.     

基于时空相关性的HEVC帧间模式决策快速算法

新一代的高效率视频编码标准HEVC采用编码树单元（CTU）四叉树划分技术和多达10种的帧间预测单元（PU）模式,有效地提高了编码压缩效率,但也极大地增加了编码计算复杂度。为了减少编码单元（CU）的划分次数和候选帧间PU模式个数,提出了一种基于时空相关性的帧间模式决策快速算法。首先,利用当前CTU与参考帧中相同位置CTU、当前帧中相邻CTU的深度信息时空相关性,有效预测当前CTU的深度范围。然后,通过分析当前CU与其父CU之间的最佳PU模式空间相关性,以及利用当前CU已估计PU模式的率失真代价,跳过当前CU的冗余帧间PU模式。实验结果表明,提出的算法与HEVC测试模型（HM）相比,在不同编码配置下降低了52%左右的编码时间,同时保持了良好的编码率失真性能;与打开快速算法选项的HM相比,所提算法进一步降低了30%左右的编码时间。     

Multi-class support vector machine-based fast algorithm for 3D-HEVC depth video intra coding

The recursive splitting process of largest coding unit (LCU) and the mode search process of coding unit imposed enormous computational complexity on encoder. A multi-class support vector machine-based (MSVM) fast coding unit (CU) size decision algorithm for 3D-HEVC depth video intra-coding was proposed. The algorithm included two steps: off-line training and fast CU size and mode decision. In the process of off-line training, a MSVM model was constructed, where the texture complexity of current LCU, the optimal partition depth of its spatial neighboring LCU and co-located LCU in texture video were treated as feature vectors, and the optimal partition depth of LCU was utilized as corresponding class label. In the process of fast CU size and mode decision, features of LCU were extracted before cod-ing a LCU, then, a MSVM model was used to predict the class label. Finally, the class label that represents the largest parti-tion depth of the current LCU was employed to terminate the CU recursive splitting process and CU mode search process. Experimental results show that the proposed algorithm saves the encoding time of 3D-HEVC by 35.91% on average, and the encoding time of depth video by 40.04% on average, with negligible rendered virtual view image degradation.     

Fast CU size and prediction mode decision method for HEVC encoder based on spatial features

In the high-efficiency video coding (HEVC) standard, intra prediction has higher computational complexity compared with H.264/AVC (advanced video coding) because of increasing the number of intra prediction modes and also higher number of coding unit (CU) sizes. The HEVC encoder evaluates 35 prediction modes on five possible prediction unit (PU) sizes to find the one with the minimum rate–distortion cost. Although this approach improves coding efficiency, it is very time-consuming. In this paper, we propose a fast intra prediction method to reduce the complexity of I-frame coding. The proposed method consists of three stages which is based on smoothness spatial feature. In the first stage, a measure is introduced to estimate CU smoothness by using sum of absolute differences (SAD) among CU pixels in four directions. By considering that a smooth region can be predicted with larger CUs, when the measured smoothness parameter is lower than a predefined threshold, only the prediction modes in the current CU are evaluated. In the second stage, the number of intra prediction modes is reduced based on the calculated SADs in the previous stage. In the last stage, if the first three candidate modes resulted from rough mode decision stage in the previous PU and the current PU are similar, then the best mode prediction of the previous PU is selected as the best candidate mode. Experimental results indicate that the proposed method can reduce the coding time on average to 43 % and maintain coding video quality, whereas bitrate increases negligibly (0.5 %).     

x265的低复杂度帧内编码快速算法

为了降低x265的帧内编码复杂度,减少编码所需时间,本文针对新一 代高效视频编码标准(HEVC)帧内编码单元(CU)划分以 及预测单元(PU)模式选择的快速算法进行研究。采用经典的差分矩阵计算纹理复杂度,提出 了一种根据当前编码单元子块的纹理复杂 相似度与其编码所需要的总比特数以及量化参数之间的关系作为提前终止CU划分的判决 条件,通过增加SATD的计算进一 步减少PU模式选择的RDO候选列表的个数从而减少率失真代价计算的快速算法。实验结果 表明,与x265的标准算法相比, 该算法在平均峰值信噪比(PSNR)仅减少0.028dB和码率平均增加1.27%的情况下,能够平均减少32.34%的帧内编 码时间。     

3D-HEVC深度图帧内编码快速算法

编码3D视频的3D-HEVC编码标准采用多视点加深度图的编码格式,新增的深度信息使编码复杂度剧增。本文针对编码块(Coding Unit,CU)的四叉树分割模型和帧内预测模式,提出了深度图帧内编码的快速算法。用Otsu’s算子计算当前CU的最大类间方差值,判断当前CU是否平坦,对平坦CU终止四叉树分割和减少帧内模式的遍历数目。根据子CU与上一层CU的相似性,利用已编码的上一层CU对提前终止CU分割算法做优化。本算法与原始3D-HEVC算法相比减少40.1%的编码时间,而合成视点的质量几乎无变化。      

基于Gabor和灰度共生矩阵混合特征叶片泵装配质量检测

本文提出一种Gabor和灰度共生矩阵相结合的特征来检测叶片泵中叶片装配质量的方法。首先构建叶片图像数据集,用5种尺度的和4种方向的Gabor滤波器对图像滤波,根据滤波后的图像计算得到幅值特征图,然后提取幅值特征图的灰度共生矩阵特征,最后融合归一化各个幅值特征图提取到的特征,利用主成分分析法降维,并用这些特征向量训练支持向量机(SVM)分类器,实现对叶片装配质量的评估。将本文提出的混合特征与LBP特征、灰度共生矩阵分别进行了比较得到的分类效果约提高了约10%。基于Gabor和灰度共生矩阵混合特征的叶片装配质量检测准确率提升到了93%。实验结果表明Gabor特征和灰度共生矩阵结合后能够很好从多尺度、多方向上提取图像的纹理特征,并应用于图像分类取得了良好的效果,在一些图像识别上有很宽广的应用前景。     

一种HEVC帧内预测编码CU结构快速选择算法

为了提升高效视频编码(HEVC) 帧内预测编码部分的编码效率,提出了一种HEVC帧内预测编码编码单元(CU)结构快速选择算 法。算法通过 对CTU(coding tree unit)四叉树结构的遍历过程进行优化,设计了两种不同的最优CU结 构快速决策算 法,分别从最大划分深度和最小划分深度开始遍历,并在每一步遍历之前,判断是否提前终 止遍历操作。 同时,在对每个CTU进行求解时,依据其纹理复杂度和当前编码状态,从两种算法中选择出 最优快速决策 算法对其进行求解。在HM 15.0的基础上实现了提出的快速选择算法 。实验结果表明,本文算法能够在 保证编码性能的同时,降低31.14%的编码时间,提高了HEVC的编码效 率。     

基于运动特征的HEVC快速帧间预测编码研究

为了降低高效视频编码(HEVC,high efficiency v ideo coding)的帧间预测复杂度,提出了一种基于运动特征的HEVC快速帧间预测新方 法。首先利用视频相邻帧的时域相关性,通过计算 每个待编码单元(CU)及其子块的帧差离散度(FDD)确定该CU的最佳编码深度d ;再依据该深度下CU的区 域运动特征(RMF_d)将待编码CU划分为3类运动区域,进而确 定该CU的候选帧间预测模式,减少 不必要的帧间预测模式遍历过程。试验结果表明,本算法可以在保证编码性能损失不大的前 提下显著提高编码效率;与标准算法相比,在低延时和随机访问两种编码结构下,同等客观 质量下码率(BDBR)分别增加0.89% 和0.83%,同时节省了51.6%和48.5%的编码时间。     

基于纹理方向和空域相关的HEVC帧内快速编码算法

为了降低高效视频编码(HEVC)的复杂度,提出了一种基于纹理方向和空域相关性的帧内快速编码算法。一方面,利用相邻编码单元(CU,coding unit)的最佳分割尺寸确定相关性的权重,并根据已编码CU的率失真代价值定义了CU分割尺寸的相关性因子,通过比较该因子提前终止CU分割;另一方面,利用Sobel算子求取预测单元(PU,prediction unit)子块的纹理方向,通过判定其纹理方向显著性确定相应的候选模式集,然后根据PU大小对所得的预测模式修正处理,最后遍历这些候选模式选取最优模式。实验结果表明:本文算法相对于原始HEVC编码方法,在全I帧模式下编码时间平均减少36.84%,BDBR(Bjntegaard delta bit rate)上升约0.81%,BDPSNR(Bjntegaard delta peak signal-to-noise rate)降低了0.047dB。