关于MPEG-2空域时域自适应错误隐藏算法

MPEG-2的压缩算法,由于采用可变字长编码使得其对信道错误十分敏感,即使单比特错误都有可能导致图像质量的严重下降,使部分或整条信息丢失。在解码端的错误隐藏技术是解决这个问题的有效方法之一。该文基于图像像素间的最大光滑连接,利用丢失宏块的邻域宏块的全部信息,导出了加权内插的错误隐藏公式。提出了一种自适应的错误隐藏方法,序列中的第一帧使用空域信息重构丢失的区域,其它帧使用本文建议的空域时域自适应错误隐藏方法。仿真实验的结果表明本文建议的算法优于一些传统算法。     

Error concealment techniques for digital TV

Compressed video bitstreams are intended for real-time transmission over communication networks. Most of the video coding standards employ the temporal and spatial prediction structure to reduce the transmitted video data. Therefore, the coded video bitstreams are highly sensitive to information loss and channel errors. Even a single bit error can lead to disastrous quality degradation in both time and space. This quality deterioration is exacerbated when no error resilient coding mechanism is employed to protect coded video data against the error prone environments. Error concealment is a data recovery technique that enables the decoder to conceal effects of transmission errors by predicting the lost or corrupted video data from the previously reconstructed error-free information. Motion vector recovery and motion compensation with the estimated motion vector is a good approach to conceal the corrupted macroblock data. In this paper, we develop various error concealment algorithms based on motion vector recovery, and compare their performances to those of conventional error concealment methods.     

An integrated temporal error concealment for H.264/AVC based on spatial evaluation criteria

Owing to error-prone transmission networks, the compressed video bit stream is prone to packet loss in the transmission channel. This loss causes serious distortion and the distortion will propagate to successive frames, especially in highly compressed video coding standard. Therefore, it is very important to efficiently enhance the restored result. In this paper, an integrated temporal error concealment technique for H.264/AVC is proposed. The technique could effectively restore the corrupted data by adaptively integrating error concealment approaches with the adaptive weight-based switching algorithm. The integrated mechanism is based on spatial evaluation criteria, judged by boundary distortion estimation and texture intensity. Experimental results show that the technique could effectively enhance the performance of error concealment.     

基于多方向边界匹配的视频误码掩盖算法

视频压缩码流对于信道误码十分敏感,可能导致重建图像质量严重下降.误码掩盖技术利用图像在时间和空间上的相关性,可以有效地降低误码对视频图像的影响.文中提出了一种基于多方向边界匹配的时域误码掩盖算法.该算法能更精确地恢复错误宏块的运动矢量,从而获得比传统的时域掩盖算法更好的视频质量.     

Frame Error Concealment Using Pixel Correlation in Overlapped Motion Compensation Regions

In low bit‐rate video transmission, the payload of a single packet can often contain a whole coded frame due to the high compression ratio in both spatial and temporal domains of most modern video coders. Thus, the loss of a single packet not only causes the loss of a whole frame, but also produces error propagation into subsequent frames. In this paper, we propose a novel whole frame error concealment algorithm which reconstructs the first of the subsequent frames instead of the current lost frame to suppress the effects of error propagation. In the proposed algorithm, we impose a constraint which uses side match distortion (SMD) and overlapped region difference (ORD) to estimate motion vectors between the target reconstructed frame and its reference frame. SMD measures the spatial smoothness connection between a block and its neighboring blocks. ORD is defined as the difference between the correlated pixels which are predicted from one reference pixel. Experimental results show that the proposed algorithm effectively suppresses error propagation and significantly outperforms other conventional techniques in terms of both peak signal‐to‐noise ratio performance and subjective visual quality.     

Proposed dynamic error control techniques for QoS improvement of wireless 3D video transmission

Error control techniques like error resilience (ER) and error concealment (EC) are efficient techniques to ameliorate the lost macroblocks (MBs) in the 3D video (3DV) communication system. In this paper, we propose efficient and adaptive hybrid ER‐EC algorithms for 3DV transmission over error‐prone wireless channels. At the encoder, adaptive preprocessing ER mechanisms are proposed through using the context adaptive variable length coding entropy, slice structured coding modes, and explicit flexible macroblock ordering mapping. They are used to assist the suggested EC techniques at the decoder to accurately reconstruct the erroneous MBs and frames. At the decoder, an efficient postprocessing EC technique with multiproposition methods is proposed to dynamically select the convenient EC hypothesis method based on the size of the lost MBs, the faulty view, and the frame type. It conceals the received erroneous MBs of intra‐encoded and inter‐encoded frames of the transmitted 3DV by exploiting the temporal, spatial, and inter‐view correlations among frames and views. To further improve the decoded 3DV quality, a weighted overlapping block motion and disparity compensation technique is used to reinforce the performance of the suggested ER‐EC techniques. Experimental results on various 3DV streams prove that the suggested techniques have considerably acceptable subjective and objective 3DV performance. They achieve an improved average peak signal‐to‐noise ratio gain by almost 2.85 dB compared to the conventional error control algorithms at a packet loss rate = 40%.     

用于多视视频加深度的错误隐藏算法

提出了一种针对多视视频加深度(MVD)的错误隐藏( EC)算法。算法充分利用MVD特有的深度 信息及当前丢失宏块周围正确解码的宏块信息,将丢失宏块分为3类不同属性的宏块。针对3类宏块的特 点,分别提出了基于候选运动矢量修正(CMVR)、基于深度的外边界匹配(DOBMA)以及自适应 权 值的EC(AWEC)等模式。实验表明,本文提出的算法在保证相同的视频主客观质量情况下, 能够快速有效地实现EC。     

一种低复杂度立体视频错误隐藏新方法

针对立体视频流传输中右视 点整帧丢失,提出 了一种低复杂度的错误隐藏算法。首先,为了高效地感知立体视频的时域质量和视点间质量 ,定义了时域相似尺度(TSM)、 视间相似尺度(ISM)的概念;将前一时刻右视点图像进行时域和视点间匹配,分别求取 其以像素为单位的TSM和 ISM映射图;然后,计算前一时刻右视点图像当前宏块的TSM和ISM值,通过比较得 到当前宏块的预测模式;最后,根据视频序列的时域一致性,将前一时刻右视点图像宏块 的预测模式作为丢失图像宏 块的预测模式,从而使用运动补偿预测(MCP)或者视差补偿预测(DCP )的方法恢复丢失信息。研究结果表明,与已有错误隐藏 算法相比,本文算法获得更好主客观视觉效果;同时与基于图像结构相似度(SSIM)的错误隐藏算法相比,在保持主观视觉质量情况下,错误隐藏时间节省20%左右。     

一种基于H.264\AVC的差错隐藏方法

为提高在视频通信中重建图像的质量,针对H.264＼AVC视频编码标准的新特性,提出了一种新的基于H.264＼AVC的差错隐藏方法.受损的帧或者宏块导致的解码错误会在时间上和空间上扩散,该算法充分利用了基于模型的编码和宏块的空间、时间相关性来对受损帧或者宏块进行恢复.仿真结果表明这种方法在不增加比特率的情况下,使峰值信噪比值得到了提高.     

基于MV自适应选取的帧间隐藏算法

数字视频通信在多媒体通信系统中占据重要的地位,但视频帧传输错误将导致接收视频质量的下降.视频帧传输错误不仅会破坏当前的解码帧,还会在时间上扩散造成对后续帧的预测错误.为减少视频帧传输错误对视频质量的影响,设计了一种基于运动矢量自适应选取的错误隐藏算法,算法充分利用相邻宏块间运动矢量的空间相关性来自适应地恢复受损宏块的运动矢量.仿真实验结果表明,相对于典型的错误隐藏算法,所述算法在主观视觉质量和客观评价指标上都有一定的提高.     

Mode selection algorithms for enhanced spatiotemporal error concealment

Mode selection algorithms for spatiotemporal concealment of missing macroblocks (MBs) in a corrupted video stream are presented. The proposed algorithms employ the motion compensated temporal activity in the neighbourhood of each missing MB for switching between concealment methods. Results show gains of up to 4.6 dB for a 10% packet error rate relative to other mode selection methods     

基于人脸特征的自适应空域差错掩盖算法

针对在视频通信中,高压缩视频码流对通信信道中由于信道带宽、环境等影响出现的丢包和误码极为敏感,本文提出一种在解码端基于人脸检测的自适应空域差错掩盖算法,根据正确接收帧的人脸位置及人脸运动的趋势预测受损帧人脸的位置,对于受损帧人脸内五官区域的宏块采用水平双线性插值,对于背景区域宏块采用自适应多方向插值算法。实验结果表明与现有算法相比主客观质量都有所提高。     

基于区域划分的立体视频整帧丢失错误隐藏新算法

针对立体视频传输中右视点整帧丢失,提出了一种基于区域划分的立体视频整帧丢失错误隐藏新算法。首先通过丢失帧视点内和视点间相邻帧的运动信息,估计丢失帧的运动区域与静止区域;然后利用视点间的全局视差,将丢失帧运动区域进一步划分为遮挡边界区域和非遮挡边界区域,并对遮挡边界区域和非遮挡边界区域分别采用运动补偿预测和视差补偿预测进行恢复,而对静止区域则直接采用帧拷贝的方法恢复丢失信息。实验结果表明,本文算法有效提高了所恢复的立体视频丢失帧图像的主客观质量。     

H.263编码视频流的混合错误掩盖

当H．263编码视频流在因特网上传输时，易受错误的影响，错误不但会影响当前帧还会继续扩散到以后的解码帧，从而导致图像质量的严重恶化，目前消除错误影响的常用算法是空域掩盖和时域掩盖算法，但是单纯地使用空域算法会造成图像的钝化，而时域算法则无法处理大运动的图像区域，因此，建议了一种时域和空域混合掩盖算法，同时使用两类算法对发生错误的图像帧进行掩盖。模拟结果显示该算法能够达到可以接受的图像质量，适应于视频会议、远程教育等应用的要求。     

一种整帧丢失时的视频差错掩盖算法

压缩视频对于信道误码十分敏感,可导致重组视频的质量严重下降。在低码率的情况下,当网络传输中数据包丢失时,通常对应于一整帧图像内容的丢失。为了恢复丢失帧,提出了一种针对整帧图像丢失时的基于运动向量外推法的空时域相结合的差错掩盖算法。试验结果表明,该算法不仅能够恢复整个丢失帧,而且在主观上与客观上其掩盖效果均优于传统的掩盖算法。     

Performance evaluation of enhanced error correction algorithms for efficient wireless 3D video communication systems

In the Three‐Dimensional Multi‐View Video (3D MVV) coding prediction structure, the coded bit‐streams may be dropped down due to error transmissions. So, it is compulsory to recover the corrupted Macro‐Blocks (MBs) at the decoder utilizing efficient Error Concealment (EC) post‐processing techniques. The EC methods exploit the temporal, inter‐view, and spatial matching among 3D MVV views and frames without any alterations in the encoder software or hardware or in the transmission rate. They retrieve the Disparity Vectors (DVs) and Motion Vectors (MVs) of the erroneous MBs. To enhance the received 3D MVV quality, we suggest several optimized schemes to reconstruct the lost and erroneous MBs of inter‐encoded and intra‐encoded frames. A hybrid method combining the Circular Scan Order Interpolation Algorithm (CSOIA) and Partitioning Motion Compensation Algorithm (PMCA) is proposed for intra‐frame EC. For inter‐corrupted MBs, a hybrid method comprising Directional Textural Motion Coherence Algorithm (DTMCA) and Directional Interpolation Error Concealment Algorithm (DIECA) is suggested. Experimental outcomes on several 3D MVV frames demonstrate that the suggested EC algorithms have more robustness to both heavily random and slice losses. They objectively and subjectively work better than the state‐of‐the‐art EC techniques. The proposed work achieves high 3D MVV quality with an improved average Peak Signal‐to‐Noise Ratio (PSNR) gain up to 2.45 to 4.55 dB compared with traditional EC algorithms at Packet Loss Rates (PLRs) of 40%.     

一种用于多视视频加深度联合编码的错误隐藏算法

ATM(AVC-based test model)测试模型实现了多视视频加深度(MVD)格式的联合编码,使得数据的压缩效率更高。然而,较高的压缩效率使得码流对传输错误非常敏感,极易产生错误扩散现象。针对ATM测试模型的编码顺序,提出一种用于MVD联合编码的错误隐藏算法。算法充分利用视点内、视点间及纹理视频与深度视频间的相关性,针对每个视点的不同特征提出了适应其视频特性的不同隐藏算法。实验表明,本文提出的算法可以在不增加算法复杂度的情况下,有效提高视频的主客观质量。     

整帧丢失时基于多帧参考的差错掩盖算法

压缩视频对于信道误码十分敏感,可导致重组视频的质量严重下降。在低码率的情况下,当网络传输中出现数据包丢失的情况时,通常对应于一整帧图像内容的丢失。为此本文提出了两种针对整帧图像丢失的差错掩盖算法一基于多帧参考的差错掩盖算法。研究结果表明,该算法不仅能够恢复整个丢失帧,而且其掩盖效果比传统的掩盖算法更好。     

Motion field interpolation for temporal error concealment

When transmitted over practical communication channels, compressed video can suffer severe degradation. One approach to combat the effect of channel errors is error concealment. It is an attractive choice because it does not increase the bit rate, it does not require any modifications to the encoder, it does not introduce any delays and it can be applied in almost any application. Conventional temporal concealment techniques estimate one concealment displacement for the whole damaged block and then use translational displacement compensation to conceal the block from a reference frame. The main problem with such techniques is that incorrect estimation of the concealment displacement can lead to poor concealment of the whole or most of the block. Two novel temporal concealment techniques are presented. In the first technique, motion field interpolation is used to estimate one concealment displacement per pel of the damaged block and then each pel is concealed individually. In this case, incorrect estimation of a concealment displacement will only affect the corresponding pel. On a block level this may affect few pels rather than the entire block. In the second technique, multi-hypothesis motion compensation is used to combine the first technique with a boundary matching temporal concealment technique to obtain a more robust performance. Simulation results, within both an isolated error propagation environment and an H.263 codec, show the superior subjective and objective performance of the proposed techniques when compared with conventional temporal concealment techniques     

Reference picture selection with decreased temporal dependency for HEVC error resilience

The high level of compression efficiency achieved by the High-Efficiency Video Coding standard (HEVC) decreases the robustness of the encoded bitstreams. This increased susceptibility to network errors leads to end video quality degradation. Moreover, due to the high computational complexity of HEVC, high-resolution video transmission with time constraints over hostile channels such as wireless networks becomes more challenging. This paper proposes a reference picture selection-based error-resilient method to reduce the temporal error propagation due to high-trip delay and frame-copy concealment error. First, the encoder selects the reference pictures based on the error status received from the feedback channel, taking into consideration the Rate-Distortion-Optimization (RDO). Second, the temporal information mismatch prediction resulting from the error concealment is reduced by decreasing the temporal dependency between adjacent frames based on new motion-estimation tools. Results show a PSNR gain of about 6.13 dB, 5.20 dB and 4.72 dB for 1080p, 720p and 480p resolutions respectively.