Phase-based side information generation in distributed video coding

Multimedia Tools and Applications - In distributed video coding, the quality of side information (SI) directly affects the final compression efficiency and rate-distortion performance. In the...     

Decoder driven side information generation using ensemble of MLP networks for distributed video coding

Multimedia Tools and Applications - This paper proposes an ensemble of multi-layer perceptron (MLP) networks for side information (SI) generation in distributed video coding (DVC). In the proposed...     

Successive refinement of side information for multi-view distributed video coding

Inter-camera registration in multi-view systems with overlapped views has a particularly long and sophisticated research history within the computer vision community. Moreover, when applied to Distributed Video Coding, in systems with at least one moving camera it represents a real challenge due to the necessary data at decoder for generating the side information without any a priori knowledge of each instant camera position. This paper proposes a solution to this problem based on successive multi-view registration and motion compensated extrapolation for on-the-fly re-correlation of two views at decoder. This novel technique for side information generation is codec-independent, robust and flexible with regard to any free motion of the cameras. Furthermore, it doesn’t require any additional information from encoders nor communication between cameras or offline training stage. We also propose a metric for an objective assessment of the multi-view correlation performance.     

Successive refinement of side information frames in distributed video coding

Multimedia Tools and Applications - In distributed video coding, generation of high-quality side information is required for reliable soft-input information for decoding each DCT band of a...     

Multi-resolution extreme learning machine-based side information estimation in distributed video coding

Multimedia Tools and Applications - Context: Encoding of video frames in a traditional video coding architecture involves exhaustive computations due to the motion estimation (ME) task. Hence, it...     

Decoder side information generation techniques in Wyner-Ziv video coding: a review

Multimedia Tools and Applications - In Wyner-Ziv (WZ) video coding, decoder side information (SI) takes a key role in a WZ video codec among other building blocks. In this paper, we review the...     

Distributed video coding with adaptive two-step side information generation for smart and interactive media

Conventional video coding standards, such as MPEGx and H.26x, use a hybrid architecture of block-based motion compensation and discrete cosine transform (DCT) within the structure of a complex encoder and a simple decoder. Contrary to conventional video codecs, Wyner-Ziv (WZ) video coding, which is a practical application of distributed video coding (DVC) based on the Slepian-Wolf and WZ theorems, exploits the source correlation at the decoder, thereby allowing for the development of simpler encoders. However, the current WZ video coding algorithms cannot match the coding performance of conventional video coding. In order to improve the coding performance of transform-domain WZ video coding, an adaptive two-step side-information generation method is thus proposed for evaluation and analysis in this study. The proposed method uses decoded WZ frames in the down-sampled spatial resolution along with already decoded coefficients to successively improve rate-distortion (RD) performance as the decoding progresses. The experimental results show that the proposed method, compared to previous WZ video coding method, shows improved coding performance, particularly under critical conditions, such as cases with high motion content.     

Wyner-Ziv视频编码中边信息估计算法改进*

与传统视频编码方法相比,DVC（distributed video coding）在编码性能方面还存在着较大差距。边信息估计是其中的关键技术之一,在很大程度上决定着编码效率。为缩短性能差距,改善边信息估计效率,提出一种针对像素域Wyner-Ziv视频编码系统的改进算法,在解码端改善了关键帧之间的运动矢量获取以及采用重叠块运动补偿来生成边信息。通过对大量测试序列的实验,验证了改进算法的率失真性能得到改善。     

Wyner-Ziv视频编码中边信息估计改进算法

首先简要介绍了分布式编码基本原理和一种典型的分布式编码方案——Wyner-Ziv视频编码。然后在Wyner-Ziv视频编码中提出了一种改进边信息估计算法,该算法中运动估计采用加权MAD准则。实验仿真结果表明,采用该文算法得到的运动矢量场更为准确,同时在相同输出码率时PSNR比原始算法平均提高0.7 dB。     

一种多目分布式视频编码的边信息生成算法

针对多目视频传感器网络,提出了一种新的空间边信息生成算法,该算法将体现图像空间信息的三焦点张量引入边信息的计算.三焦点张量的匹配点计算采用了改进的基于SIFT(Scale Invariable Feature Transform)特征描述符的匹配算法,在保持对匹配有旋转、尺度缩放、亮度变化不变性的优点同时,大大提高了计算速度.仿真结果表明.无论从率失真表现还是主观质量表现角度进行比较,该算法明显优于常用的边信息生成算法、基于运动的外推法MC-E和基于运动的内插法MC-I.     

适用于分布式视频编码框架的整数离散余弦变换算法

鉴于H.264的整数离散余弦变换(DCT)算法及其量化方法复杂度高,难以直接应用于分布式视频编码(DVC)框架的现状,提出了一种基于大跨度定长(步长为2的正整数次方)量化的整数DCT算法及变换基生成方法。该算法充分地利用整数DCT基的可伸缩特性寻找最迎合硬件工作原理的变换基,在保证“小”变换基的同时将编码器的伸缩量化阶段“转移”到解码器一端以降低编码器复杂度。在“转移”过程中,该算法利用DCT系数饱和放大保证图像质量,利用DCT系数的溢出上限保证算法的可靠性,通过减小基偏差提高压缩性能。实验结果表明,与H.264对应模块相比,该算法的量化方式便于位平面提取,在图像质量达到准无损压缩的前提下将编码器的伸缩量化阶段的运算量缩减至16次整型常量加法运算,图像质量与压缩率的性价比提升了23.9%,适用于分布式编码框架。     

Wyner-Ziv视频编码中边信息估计研究

Wyner-Ziv视频编码是一种典型的分布式视频编码。为了产生较为精确的边信息,提出了一种基于运动估计双向预测边信息的方法,构造了运动补偿内插框架以及改进了算法。Matlab仿真结果表明,改进方法的率失真性能比H.264帧内编码高出0.1~9.0 dB,比基于Turbo码的Discover软件高出0.01~0.90 dB。     

A computation-distortion optimized framework for efficientDCT-based video coding

The rapidly expanding field of multimedia communications has fueled significant research and development work in the area of real-time video encoding. Dedicated hardware solutions have reached maturity and cost-efficient hardware encoders are being developed by several manufacturers. However, software solutions based on a general purpose processor or a programmable digital signal processor (DSP) have significant merits. Toward this objective, we have developed a flexible framework for video encoding that yields very good computation-performance tradeoffs. The proposed framework consists of a set of optimized core components: motion estimation (ME), the discrete cosine transform (DCT), quantization, and mode selection. Each of the components can be configured to achieve a desired computation-performance tradeoff. The components can be assembled to obtain encoders with varying degrees of computational complexity. Computation control has been implemented within the proposed framework to allow the resulting algorithms to adapt to the available computational resources. The proposed framework was applied to MPEG-2 and H.263 encoding using Intel's Pentium/MMX desktop processor. Excellent speed-performance tradeoffs were obtained     

A component-driven distributed framework for real-time video dehazing

Traditional dehazing techniques, as a well studied topic in image processing, are now widely used to eliminate the haze effects from individual images. However, the state-of-the-art dehazing algorithms may not provide sufficient support to video analytics, as a crucial pre-processing step for video-based decision making systems (e.g., robot navigation), due to poor coherence and low processing efficiency of the present algorithms. This paper presents a new framework, particularly designed for video dehazing, to output coherent results in real time, with two novel techniques. Firstly, we decompose the dehazing algorithms into three generic components, namely transmission map estimator, atmospheric light estimator and haze-free image generator. They can be simultaneously processed by multiple threads in the distributed system, such that the processing efficiency is optimized by automatic CPU resource allocation based on the workloads. Secondly, a cross-frame normalization scheme is proposed to enhance the coherence among consecutive frames, by sharing the parameters of atmospheric light from consecutive frames in the distributed computation platform. The combination of the above three components enables our framework to generate highly consistent and accurate dehazing results in real-time, by using only 5 PCs connected by Ethernet.

     

分布式视频编码的关键帧提取算法

分布式视频编码方案中,目前常用固定周期的方法选取关键帧.该方法忽略了视频序列的帧间相关性、运动变化情况.针对这些缺陷,研究了基于聚类的自适应关键帧提取算法,在此基础上,提出基于互信息量的改进算法.最后,针对以上2种算法中的时延问题给出了解决方案.实验证明,对于不同的测试序列,基于互信息量改进算法相比固定选取关键帧算法,边信息PSNR均值有0.67～1.4dB的提高.此外,解决时延的算法比改进算法在效率上有很大提高.     

分布式视频编码技术研究进展

介绍了分布式视频编码与传统视频编码方法思路的不同及各自适用的应用场景,阐述了分布式视频编码的理论基础和目前普遍采用的编解码框架,分析了分布式视频编码中的Wyner-Ziv编解码器设计、辅助边信息生成、虚拟相关信道建模等几项关键技术存在的问题及各自解决方案的最新研究进展,最后总结了分布式视频编码的发展与研究方向,并介绍了分布式编码在视频领域的其它应用.     

分布式视频编码关键技术及研究进展

系统地阐述了分布式视频编码(distributed video coding,DVC)技术框架的基本原理和近五年的发展历程;列举了国内外多个研究小组的基本思想研究现状;分析了分布式视频编码技术的发展趋势;揭示了技术的关键和研究热点;展望了该技术在信息安全、可伸缩编码、多描述编码以及光场编码中的应用前景.     

Distributed video coding based on part intracoding and soft side information estimation

Recently, distributed source coding (DSC) has been proposed to implement source compression by exploiting source statistics at the decoder only, which enables low-complexity video coding. However, to date, the video codecs based on DSC have been unable to compress as efficiently as traditional predictive video codecs, such as H.264. So, new techniques have to be investigated to improve the performance of the distributed video coding scheme for practical applications. In this paper, I propose a novel distributed video coding scheme based on part intracoding and soft side information estimation. Firstly, at the encoder side, to improve the compression performance of distributed video coding system, we divide the video data into strongly correlative data encoded by Slepian–Wolf codec and weakly correlative data encoded by Intracoding codec. Secondly, at the decoder side, to improve the accuracy of side information estimation, a soft side information estimation method is proposed, which is more suitable for video coding due to the non-stationary feature of video data. Our experimental results show that the performance of our coding system is better than that of the traditional distributed video coding system while keeping the simple encoding property. Also the concept of soft side information is a new idea in distributed video coding and will significantly influence the side information estimation method.

Enhanced reconstruction algorithm for unidirectional distributed video coding

Distributed video coding (DVC) is an emerging video coding technology that utilises the distributed source coding principles to build very low cost video encoders, yet with remarkable error resilience. In the most common DVC framework, the reconstruction function plays a vital role that has a direct impact on the output video quality. In this study, a novel algorithm is proposed for the reconstruction function, particularly focusing on a unidirectional DVC architecture. The proposed technique exploits the variations of the bit error rate of the Wyner-Ziv decoded bit stream and the assumed noise model in the side information stream. The simulation results show that the proposed algorithm yields a significant improvement of the objective and subjective video quality at no additional bit rate cost.