一种改进的H.264自适应空域错误掩盖算法

对H.264视频码流的帧内编码帧(I帧)进行空域错误掩盖时，单纯使用加权像素平均插值算法或方向插值算法不能得到满意的效果。因此，使用一种基于方向熵的自适应选择算法，根据丢失宏块周围的边缘信息自适应地选择加权像素平均插值算法或者该文提出的一种方向插值算法进行空域掩盖。该文提出方向插值算法，使用“双圈法”精确估计丢失宏块内的边缘方向，计算周围8个宏块中此方向上的边缘强度，根据边缘强度将丢失宏块划分成不同的区域分别进行方向插值。实验结果表明，该算法不仅提高了方向插值的精确性，也避免了虚假边缘的产生，有效地提高了错误图像的掩盖效果。     

一种改进的多纹理方向空域错误隐藏算法

为了提高视频压缩码流传输过程中抗误码性能,提出一种改进的多纹理方向插值算法.该算法将丢失宏块多纹理区域自适应划分为若干子块,分别进行插值恢复;并结合一些现有算法的特点,对宏块不同纹理类型切换隐藏算法.实验结果表明,该算法不仅提高了方向插值的精确性,也避免了虚假边缘的产生,有效地提高了错误图像的掩盖效果.     

基于边缘检测及方向加权的H.264帧内错误隐藏算法*

针对H.264帧内错误隐藏忽略边缘纹理信息的问题,提出了一种改进算法。首先对丢失块的相邻块的像素作边缘检测,统计相关像素的个数,确定相邻块的边缘方向;然后通过距离和相关像素进行加权,以估计出丢失块每个像素的插值方向;最后,通过对宏块状态标志进行检测,选择插值方法,完成插值运算。在H.264标准测试平台JM86上对该算法进行验证,结果表明：在像素丢失块达50%的恶劣情况下,该算法的PSNR值比空间像素加权算法提高了211 dB。     

基于几何结构的自适应空域错误隐藏算法

针对视频传输时容易发生损坏或丢失数据的问题,提出一种基于几何结构的自适应空域错误隐藏算法,以提高恢复图像质量。利用受损宏块的相邻2层像素提取几何结构,依据受损块相邻像素区分平滑块和边缘块。对平滑块采用双线插值,对边缘块根据内外两层的转折点寻找边缘方向,从而划分区域插值运算。实验结果表明,对于不同宏块丢失率和不同的视频序列,该算法所恢复的视频序列的峰值信噪比比双线插值、方向插值算法提高了0.5 dB~3 dB,不仅避免了虚假边缘,而且也提高了方向插值的准确性,改善了恢复图像的主观效果。     

H.264高清视频解码实时错误掩盖算法

针对IP网络丢包条件下的H.264高清视频实时解码问题,分析高清视频码流的特点,提出一种实时错误掩盖算法。该算法利用丢失片的边缘宏块信息,以垂直距离为权值加权平均预测得到错误宏块的运动矢量,进而完成错误掩盖。实验表明,与Joint模型中的错误掩盖算法相比,该算法提升了重建图像的主观质量和客观质量,计算复杂度较低,错误掩盖效果较好,适用于高清实时解码。     

基于多模式叠加的H.264时域隐藏算法

为在高误码环境下提高视频通信中重建图像的质量,根据最新H.264标准的特点,提出了一种基于多模式叠加的时域错误隐藏算法。该算法以不同的模式对丢失宏块进行4次掩盖,得到4个隐藏块,以各隐藏块的加权和作为丢失宏块的最终替代块。仿真结果表明,由于利用了宏块模式信息,该算法在不同测试序列及丢包率下的性能均优于传统叠加算法,显著提高了掩盖效果。     

一种宏块的MPEG2高效自适应空间掩盖方法

针对压缩视频流的误码，提出一种高效基于宏块的自适应空间掩盖方法。分析了双线性插值空间误码掩盖方法的原理；在此基础上比较了3类不同方向空间插值方法的优缺点，并根据最小边界加权差值提出自适应空间误码掩盖方法，使得不同的情况下选择最佳的方向空间插值方法。试验结果表明，该方法可以较多地恢复宏块内的细节信息，并使边缘尽可能的保持连续，然而对于细节较多区域，该方法会引入一定模糊。     

一种新的图像分场描述编码错误掩盖算法

针对信道中数据丢失导致图像恢复质量严重受损问题,提出将方向插值引入到基于图像分场描述编码的错误掩盖算法。每帧图像分为两场独立编码传输,丢失一场数据时,通过改进Sobel算子计算正确接收的另一场图像内部边缘,沿边缘方向插值恢复出丢失的场。实验结果表明,应用这种基于像素行交织的错误掩盖算法后,图像主观恢复质量和峰值信噪比均较现有方法有显著提高。算法计算复杂度低,与H.264编码标准兼容,适于实际工程应用。     

基于DCT系数的自适应误码掩盖算法

提出一种改进的误码掩盖算法,即自适应地选择加权插值和区域匹配方法恢复丢失块.不同于以往只利用平滑性的误码掩盖算法,该算法利用平滑信息和纹理信息,在可用的相邻宏块中基于DCT系数计算能量函数总和,自动分析图像的平滑性和纹理性,然后自适应地选择加权插值或区域匹配的结果恢复丢失块.该算法已在H.264的参考软件JM86上进行实验.实验结果表明,与H.264中只采用加权插值或只采用区域匹配相比,该算法能取得较好的峰值信噪比(PSNR)和主观质量.     

基于SVC的空域增强层帧级错误掩盖算法

基于SVC空域增强层宏块编码模式的特点,提出一种增强层帧级错误掩盖算法,综合利用层间预测信息和时域直接模式TD下的运动信息,预测丢失帧中的宏块是否采用TD模式编码运动信息。对于符合判决条件的宏块,使用TD模式来产生其运动矢量,以提高运动矢量恢复的精确度,从而提升丢失帧的错误掩盖效果。实验结果表明,与原JSVM算法相比,该算法以很小的运算复杂度,使增强层序列的解码PSNR平均提高了0.23 dB。     

Region-based error concealment of right-view frames for stereoscopic video transmission

Transmission of stereoscopic video stream through error-prone wireless channels results in the loss of blocks. In this paper, we propose a region-based error concealment method that exploits encoding modes, inter-view and intra-view correlations of stereoscopic video sequences. Based on the statistical analysis of the encoding modes of the surrounding macroblocks (MBs) and of the spatially corresponding MB in the neighboring frame, the lost MBs are classified into three types: (1) smooth MBs, (2) regular motion MBs and (3) irregular motion MBs. Following the classification, corresponding operations, including direct replacement, quarter-pixel motion and disparity compensation, and bilateral error concealment with adjustable weights, are applied to reconstruct the smooth MBs, regular motion MBs and irregular motion MBs, respectively. Experimental results show that the proposed method outperforms other existing error concealment methods for stereoscopic video transmission in terms of both objective and subjective evaluations.     

Recovering Connected Error Region Based on Adaptive Error Concealment Order Determination

Parts of compressed video streams may be lost or corrupted when being transmitted over bandwidth limited networks and wireless communication networks with error-prone channels. Error concealment (EC) techniques are often adopted at the decoder side to improve the quality of the reconstructed video. Under the conditions of a high rate of data packets that arrives at the decoder corrupted, it is likely that the incorrectly decoded macro-blocks (MBs) are concentrated in a connected region, where important spatial reference information is lost. The conventional EC methods usually carry out the block concealment following a lexicographic scan (from top to bottom and from left to right of the image), which would make the methods ineffective for the case that the corrupted blocks are grouped in a connected region. In this paper, a temporal error concealment method, adaptive error concealment order determination (AECOD), is proposed to recover connected corrupted regions. The processing order of an MB in a connected corrupted region is adaptively determined by analyzing the external boundary patterns of the MBs in its neighborhood. The performances, on several video sequences, of the proposed EC scheme have been compared with those obtained by using other error concealment methods reported in the literature. Experimental results show that the AECOD algorithm can improve the recovery performance with respect to the other considered EC methods.      

Motion characteristic differentiated error concealment

In this paper, we propose a brand-new motion characteristic differentiated error concealment (MDEC) method based on motion field transfer. Firstly, the FMO checkerboard pattern is used at the encoder, so as to prevent MBs of a large area getting lost. Then at the decoder, Greedy Spread Motion Region Extraction (GSMRE) method is used to distinguish low-motion region from high-motion region in each frame based on different motion characteristic, and apply different strategies to recover regions with different characteristics respectively. Simulation results show that the proposed algorithm reconstructs the lost frame with both a better visual quality and a higher PSNR, comparing to error concealment methods including Joint Model, boundary matching, inpainting, and block motion vector extrapolation as well. For example, the PSNR gain of our approach over boundary matching algorithm reached about 0.6 dB, and 1.4 dB when the packet loss rate is 3 and 7%, respectively, which demonstrates that our method has an good application within a wide scope of packet loss rate.     

Error resilient video coding with priority data classification using H.264 flexible macroblock ordering

Flexible macroblock ordering (FMO) is a new error resilience feature in the H.264 (MPEG-4 part 10) video coding standard. The paper exploits FMO to offer a new classification algorithm for prioritised video transmission. Instead of using the default mapping structures of FMO, an optimisation algorithm in which the more important macroblocks (MBs) are categorised in a separate slice group (SG), which corresponds to high-priority packets for transmission, is proposed. The importance of each MB is determined based on its eventual influence on picture quality. This is assessed by considering the fact that the successful transmission of an MB not only enhances the quality of the associated pixels, but also improves the quality of its adjacent lost MBs by improving the efficiency of error concealment. It is assumed that the network can offer a prioritised service for successful transmission of the high-priority SG. Based on this, a vulnerability factor for each MB is determined, and a certain proportion of high-vulnerability MBs at each frame to limit the impact of temporal error propagation is intra-updated. It is shown, where the proposed mapping algorithm outperforms the default mappings of the H.264 codec, that this prioritised transmission will improve the subjective and objective video quality in situations with a high probability of transmission errors.     

基于纹理检测的视频序列误差掩盖

文章提出了一种新的误差掩盖(ErrorConcealment)算法,作为在解码器端的后处理工具去解决视频序列在传输过程中产生的块及其运动矢量同时丢失的问题。笔者利用LOG算子去对丢失块周围的块进行纹理检测,取所有属于纹理块的运动矢量的平均值,作为丢失运动矢量的估计。仿真结果表明对不同块丢失率或不同视频序列,此算法都能比传统的方法恢复出质量更高的图像。     

基于块运动变形的时域差错掩盖

传统的时域差错掩盖技术通常将宏块作为整体考虑,没有具体分析受损宏块的运动特征,当受损宏块具有复杂剧烈的运动时掩盖效果不理想.通过对受损宏块的运动特征认真研究,提出了基于块变形的时域差错掩盖算法.算法充分利用受损宏块的周围信息将宏块运动划分成多种运动情况,针对不同运动情况采取不同的掩盖策略.在确定某受损块存在块变形运动时实施块变形掩盖,并通过合理的变形区域选择保证块变形的合理性.基于H.263 的GOB交织打包仿真实验表明,提出算法对存在复杂剧烈运动的宏块掩盖效果良好,与BM和MFI-BM掩盖相比,掩盖后的主客观视频质量有显著的改善.     

Hybrid error concealments based on block content

We present a novel error-concealment method for MPEG-2 video decoders. Imperfect transmission of block-based compressed images may result in the loss of blocks, degrading the quality of the received video signal. Since an I-picture is used as a reference picture for forward and backward predictions of neighbouring pictures, transmission errors in an I-picture are propagated both spatially in the I-picture and temporally to P-/B-pictures, and thus may severely degrade the video signal, compared with the errors in P-/B-pictures. To minimise the quality degradation of the video signal, error concealment has been performed in I-pictures through adaptive spatial and temporal interpolations in the respective domains. Using edge information extracted from the neighbourhoods of the erroneous macroblocks, we categorise each erroneous macroblock (MB) based on the characteristics of neighbouring MBs. The categorised MB is reconstructed by the spatial or temporal error concealment methods selected by the category-dependent criteria reflecting the properties of the block content. The proposed technique solves blocky artefacts and blurring problems of existing error concealment methods and thus effectively conceals the lost blocks in an error video signal. Through computer simulations on damaged images, we show that the proposed method is robust to image characteristics and obtains better subjective quality than other error concealment methods.     

高效率视频编码中基于块整合的错误隐藏算法

针对新一代视频编码标准高效率视频编码(HEVC)编码单元(CU)尺寸较大所导致的丢包后错误隐藏恢复效果不佳的问题,提出了对CU下的分割块进行块融合的错误隐藏方法。首先,分析了残差能量与块分割的相关性;然后,通过参考帧残差能量与所设阈值进行比较判决,对当前丢失CU分割块进行融合,得到丢失CU的块分割方式;其次,对矢量外推法进行权值优化,保证了算法在HEVC错误隐藏的适用性;最后,对融合块采用优化后的矢量外推法进行错误隐藏。实验结果表明,与经典错误隐藏方法如拷贝法、运动补偿法等相比,基于块融合的错误隐藏在保证解码视频结构相似性(SSIM)的同时提高了不同运动性的解码视频峰值信噪比(PSNR),验证了算法的可行性。