Delay-Constrained and R-D Optimized Transrating for High-Definition Video Streaming Over WLANs

In this study, we propose bit-rate adaptation techniques for compressed high-definition video transmission over wireless home networks. Application-layer methods are developed to minimize quality impairments caused by wireless channel degradations. A transrater located at a home video server adjusts the transmission rate of the video stream based on bandwidth measurements. We consider delay constraints of multiple video frames across various time scales, and dynamically select an appropriate time scale for bit-rate adjustments. This novel feature prevents playout buffer underflows and avoids unnecessary rate reductions. Furthermore, distortion due to transrating is minimized by coding type-dependent rate allocation among the frames to be transmitted in the projected time scale. Using a realistic simulation setup, we demonstrated that the proposed technique significantly reduces video glitches. Up to 3.12 dB average PSNR improvement is achieved, compared to a non-delay constrained rate adaptation method, which also utilizes bandwidth measurements. Our approach maintains compliance with existing wireless local area (WLAN) devices and standards, as well as consumer video standards and applications.      

基于失真估计和码率控制的视频传输新方案

针对差错信道上的实时视频编码和传输问题,提出一种基于逐帧失真估计和码率控制的新型时域不等差错保护方案。该方案给出一种低复杂度逐帧传输失真估计模型,估计差错信道下的视频传输失真,结合码率控制算法,通过对编码量化参数的简单搜索,逐帧求出最优的压缩编码和信道保护策略。仿真结果表明,与现有方案相比,该方案不但延迟小、复杂度适中,而且能提高重建视频序列的平均质量,减少逐帧之间的质量波动。     

低复杂度的H.264帧间编码的模式判决算法

H.264是最新的国际视频编码标准，它能够提供更高的编码效率，但其编码实现也非常复杂，三叉树结构的多编码模式和多帧参考技术是复杂度增加的两个重要因素．针对这两个因素提出一种用于帧间编码的快速模式判决算法FIMDA，它利用编码过程中获得的模式、码率开销等编码信息来减少那些对编码性能影响不大的参考帧和模式的搜索过程，从而降低编码复杂度．实验结果表明，对常用的5帧参考，与全搜索相比，FIMDA可将编码复杂度降低平均85％以上，而PSNR下降仅在0．07dB左右．     

A novel Modified Chaotic Simplified Advanced Encryption System (MCS-AES): mixed reality for a secure surgical tele-presence

Mixed Reality (MR) surgery has not been effectively implemented in telemedicine due to strict requirements of security and delay minimization during real-time video transmission. Hence, this paper aims to propose a novel solution for Surgical Telepresence with highly secured and faster real-time video transmission. The proposed system consists of three components: Authentication (Pre-surgery), Data transmission (During-Surgery), and Storage (Post-Surgery). For Authentication, Pass-Matrix technique is used at both ends to provide graphical passwords. During the surgery, a hybrid system is used to provide highly secured and faster real-time video transmission. This system includes a Feistel Encryption System (FES), Modified Scaled Zhongtang Chaotic System (M-SCZS), and Modified Advanced Encryption System (M-AES) algorithm. After Surgery, the transmitted data are stored using the Information Accountability Framework (IAF) for future purposes. The results are obtained from the during-surgery stage for jaw, breast, and bowel surgery. Both solutions are simulated in MATLAB on a personal computer with average processing capability. The proposed solution improves the entropy from 7.733~7.782 to 7.798–7.996 and reduces the processing time from 8.642~9.911 s/frames to 5.071~6.563 s/frames. The proposed focus on reducing the total processing time for the encryption and decryption process with improving security during the surgery process. Finally, this solution provides a fast security system for surgical telepresence that helps both local and remote surgeons for secure real-time communication. The complexity for this work need to know the used chaotic method, the values of the chaotic parameters and for which this method was used, in addition to the complexity of state of the art.

     

一种面向视频应用的有效实时码率控制算法

为提供实时视频传输服务,同时保证一定的视频质量,提出了一种基于JVT-G012的动态码率控制算法。在编码过程中,根据图像内容的运动特性,动态决定GOP长度,同时防止输出缓冲器的上溢和下溢;为复杂度较高的宏块（MB）分配较多的比特。实验结果表明,该算法对于场景变化较大的实际视频序列有较好的编码效果。     

802.11e中失真驱动的视频传输跨层优化

针对H.264视频在802.11e无线网络中传输时,由丢包和编码量化引起的接收端失真问题,提出了一种以失真为驱动的跨层优化算法,以减少接收端的失真。通过率失真模型得到量化参数(QP)和量化失真之间的关系后,根据不同视频数据分区的丢包率,估计出接收端的传输失真和总体失真;然后,以这个总体失真为依据,提出一个求最优量化参数的选择算法。实验结果表明,所提方法相比只针对H.264视频不同数据分区赋予不同传输优先级的由上向下跨层架构,或者只考虑根据传输丢包率调整编码器量化参数的由下到上的跨层架构,平均峰值信噪比(PSNR)提高了1~2dB,具有更小的接收端失真。     

低延时无线视频传输中的H.264码率控制算法

针对基于ARQ机制下的低延时无线视频传输,提出了一种有效的信道信源联合码率控制方案。该方案首先利用Markov模型作为无线信道模型来预测估计信道的状态和带宽,并以基于Cauchy分布的率失真模型作为信源模型;然后在帧层设计了一种基于PID控制器的缓存控制算法,即根据预测信道带宽和缓存器状态来分配每帧目标比特数,以提高缓存的控制能力;对于宏块层则在监控缓存器状态的同时,利用基于Cauchy分布的率失真模型,最后通过Lagrange方法来优化分配目标比特数。实验结果证明,该算法不仅能显著提高平均峰值信噪比,并能大幅减少跳帧数目。     

基于无线噪声信道的编码端码率控制算法研究

针对分布式视频编码系统的关键帧在无线信道中传输受到噪声污染的情况,提出一种基于无线噪声信道的编码端码率控制算法。首先对解码端边信息携带的无线信道噪声进行了理论和实验分析,建立了边信息中无线信道噪声的分布模型;然后结合相关噪声模型推导出编码端的噪声联合模型,并根据分布式视频编码的率失真理论,提出了在无线信道下WZ帧不同系数带的码率控制算法,同时将新的码率控制算法引入基于无线噪声信道的Wyner-Ziv编码器中。实验表明,与现有的编码端码率控制算法相比,所提出的算法在不同无线信道噪声下可使解码重构视频的PSNR值平均提高约0.1～1.8 dB,且未增加复杂度。     

Optimal adaptive channel scheduling for scalable video broadcasting over MIMO wireless networks

Video broadcasting is an efficient way to deliver video content to multiple receivers. However, due to heterogeneous channel conditions in MIMO wireless networks, it is challenging for video broadcasting to map scalable video layers to proper MIMO transmit antennas to minimize the average overall video transmission distortion. In this paper, we investigate the channel scheduling problem for broadcasting scalable video content over MIMO wireless networks. An adaptive channel scheduling based unequal error protection (UEP) video broadcasting scheme is proposed. In the scheme, video layers are protected unequally by being mapped to appropriate antennas, and the average overall distortion of all receivers is minimized. We formulate this scheme into a non-linear combinatorial optimization problem. It is not practical to solve the problem by an exhaustive search method with heavy computational complexity. Instead, an efficient branch-and-bound based channel scheduling algorithm, named TBCS, is developed. TBCS finds the global optimal solution with much lower complexity. The complexity is further reduced by relaxing the termination condition of TBCS, which produces a (1 − ε)-optimal solution. Experimental results demonstrate both the effectiveness and efficiency of our proposed scheme and algorithm. As compared with some existing channel scheduling methods, TBCS improves the quality of video broadcasting across all receivers significantly.     

基于GM(1,1)模型的自适应链路层ARQ控制策略

提出了一种用于无线实时流媒体传输的自适应链路层ARQ控制策略,用以提高接收方的播放质量。该策略采用跨层设计的方法,基于GM（1,1）模型预测当前的网络状态,考虑GOP可解码帧数的特性,自适应地调整ARQ参数Nmax;另一方面,在应用层采用自适应FEC策略,在视频源数据和冗余数据之间动态分配网络带宽。数学分析和仿真验证均表明,该策略能使接收方获得最大的可播放帧率,有效地提高了流媒体传输的可靠性和实时性。     

Genuine reversible data hiding technology using compensation for H.264 bitstreams

Reversible data hiding technologies have been considered largely impractical because those are, in most cases, applicable to raw video data rather than prevailing compressed data. Even though, many algorithms have been recently developed in the compressed video domain, most of them cannot guarantee the reversibility of cover video due to the lossy characteristics of video compression standards. We suggest completely practical data hiding scheme for H.264 baseline bitstream by achieving genuine reversibility for both I and P frames. Regardless of the data hiding algorithm, the proposed scheme can increase embedding payload by 66.9% and reduce computational complexity by 93%. Also, a novel compensation based difference expansion method with clever coefficient pairing strategy is proposed as a data hiding algorithm and achieved superior embedding payload vs. image quality performance. The proposed algorithm improves payload by 48.9% on average at almost the same video quality distortion.     

一种适合实时视频传输的混合ARQ加条件跳帧算法研究

论文讨论视频数据在无线局域网(WLAN)中的实时传输问题。采用IEEE802.11b协议,WLAN可提供高达11Mbps的传输速率,在没有干扰和没有拥塞的情况下,其环境完全满足实时视频传输的需要。但在干扰和拥塞严重的情况下,视频帧的延时很大,无法满足实时播放的要求。文献犤1犦提出了一种混合ARQ算法,可较好地解决视频帧的传输延迟问题,但在网络负载很重时,丢包率很高,视频序列的重构质量很差。因而在深入研究IEEE802.11b协议的核心MAC层的基础上,参考文献犤1犦,提出了一种新的适合实时视频传输的混合ARQ算法,结合高层的基于反馈信息的条件跳帧技术,可很好地解决视频帧的延时问题,同时传输的可靠性也很高。     

A novel H.264 rate control algorithm with consideration of visual attention

In video coding, a well-designed rate control scheme should be concerned with both the objective and subjective quality. However, the existing H.264 rate control algorithms mainly aim at improving the objective quality without considering the human visual system. In this paper, we propose a novel rate control algorithm that takes into account visual attention. In a group of pictures, bits allocated to each frame are related to the local motion attention in it, and more bits are allocated to the frames with strong local motion attention. Similarly, in each frame, more bits are assigned to visually significant macroblocks (MBs), and fewer to visually insignificant MBs. Experiment results show that the proposed algorithm improves the coding quality in frames with strong local motion, and reduces PSNR fluctuation across frames by up to 22.15%. In addition, PSNR in visually important regions is increased by up to 1.45 dB as compared to the standard H.264 rate control scheme that improves the subjective quality. Increased computation complexity of the proposed algorithm is less than 4%, which is negligible.     

A frame-level encoder rate control scheme for transform domain Wyner-Ziv video coding

Available distributed video coding codecs are mostly based on decoder rate control scheme where the parity bits for decoding can be achieved over a feedback channel. Meanwhile, the frequent requests over feedback channel increase the transmission delay. The feedback-free distributed video coding, relying on encoder rate control in literatures, has overcome the aforementioned shortcoming. However, when performing parity bitrate estimation and other operations, the feedback-free distributed video coding systems based on bit-plane usually require high precision of bitrate estimation and high quality of side information at the encoder. In this paper, we propose a frame-level distributed video coding system based on encoder rate control. The innovations include three parts: 1) an adaptive coding mode selection algorithm is proposed, which utilizes both temporal and spatial correlation and reduces the complexity of encoder; 2) a bit-plane rearrangement method is adopted, which makes the coding rate on each bit-plane homogeneous and effectively reduces the accuracy requirement of the parity bitrate prediction and improves the efficiency of rate estimation; 3) a frame-level parity bitrate estimation scheme is presented to enhance the efficiency of rate estimation on the basis of a look-up table. Numerical results verify that the proposed scheme remarkably improves the rate distortion performance of distributed video coding at low bitrate.     

利用时空相关性的HEVC帧内编码块快速划分

目的 为了提升高效视频编码（HEVC）的编码效率,使之满足高分辨率、高帧率视频实时编码传输的需求。由分析可知帧内编码单元（CU）的划分对HEVC的编码效率有决定性的影响,通过提高HEVC的CU划分效率,可以大大提升HEVC编码的实时性。方法 通过对视频数据分析发现,视频数据具有较强的时间、空间相关性,帧内CU的划分结果也同样具有较强的时间和空间相关性,可以利用前一帧以及当前帧CU的划分结果进行预判以提升帧内CU划分的效率。据此,本文给出一种帧内CU快速划分算法,先根据视频相邻帧数据的时间相关性和帧内数据空间相关性初步确定当前编码块的编码树单元（CTU）形状,再利用前一帧同位CTU平均深度、当前帧已编码CTU深度以及对应的率失真代价值决定当前编码块CTU的最终形状。算法每间隔指定帧数设置一刷新帧,该帧采用HM16.7模型标准CU划分以避免快速CU划分算法带来的误差累积影响。结果 利用本文算法对不同分辨率、不同帧率的视频进行测试,与HEVC的参考模型HM16.7相比,本文算法在视频编码质量基本不变,视频码率稍有增加的情况下平均可以节省约40%的编码时间,且高分辨率高帧率的视频码率增加幅度普遍小于低分辨率低帧率的视频码率。结论 本文算法在HEVC的框架内,利用视频数据的时间和空间相关性,通过优化帧内CU划分方法,对提升HEVC编码,特别是提高高分辨率高帧率视频HEVC编码的实时性具有重要作用。     

一种新型的H.264码率控制初始化方法

良好的码率控制对视频信号的编码与传输有重要的影响;基于待编码帧的复杂度和缓冲区状态,提出了一种新型的H.264码率控制初始化方法;第一个I帧和P帧首先进行预编码,以修正第一个I帧的比特分配;根据I帧的图像复杂度建立新型I帧码率-量化参数(R-Q)模型,根据该模型,第一编码帧的量化参数得以确定;仿真结果证明,该初始化方法可以有效提高重建视频的峰值信噪比(PSNR),对实验所用QCIF序列,平均PSNR提高了0.86dB,同时大幅减少了跳帧情况的发生。     

High-speed implementation of fractal image compression in low cost FPGA

Fractal image compression (FIC) is a very popular coding technique use in image/video applications due to its simplicity and superior performance. The major drawback with FIC is that it is very time consuming algorithm, especially when a full search is attempted. Hence, it is very challenging to achieve a real-time operation if this algorithm is implemented on general processors. In this paper, a new parallel architecture with bit-width reduction scheme is implemented. The hardware is synthesized on Altera Cyclone II FPGA whose architecture is optimized at circuit level in order to achieve a real-time operation. The performance of the proposed architecture is evaluated in terms of runtime, peak-signal-to-noise-ratio (PSNR) and compression efficiency. On average the speedup of 3 was attainable through a bit-width reduction while the PSNR was maintained at acceptable level. Empirical results demonstrate that this firmware is competitive when compared to other existing hardware with PSNR averaging at 29.9 dB, 5.82% compression efficiency and a runtime equivalent to video speed of 101 frames per second (fps).     

针对H.264码率控制的初始量化参数选择算法

针对JVT-H017提案码率控制算法初始量化参数选择与视频内容无关的问题,在总结现有改进算法基础上,提出一种快速有效的初始量化参数选择算法。该算法只需第一个P帧的平均绝对误差（MAD）值及每像素平均比特率信息即可快速给出初始量化参数。实验结果表明,在恒定比特率下,所提算法与JVT-H017算法相比,预测的初始量化参数更加准确,ΔPSNR最大能提高1.1dB,并且算法对含B帧编码结构同样有效。     

结合恰可察觉编码失真模型的HEVC大容量信息隐藏方法

目的 数字视频通常经过压缩后传输,结合视频编码标准嵌入秘密信息是视频信息隐藏的主流技术。然而,现有基于HEVC（high-efficiency video coding）的视频信息隐藏技术存在码率增长过快、视频质量下降等问题。针对以上问题,提出结合恰可察觉编码失真模型（JNCD）的HEVC大容量信息隐藏方法。方法 JNCD模型是一种面向HEVC视频编码的视觉感知模型。该模型充分考虑编码过程的模糊和块效应,有效去除视频感知冗余,在相同码率下可获得更高的主观感知质量。结合JNCD模型,调节I帧中编码单元（CU）的最优量化参数（QP）值,并利用基于方向调整（EMD）算法嵌入秘密信息,进一步增加信息隐藏容量。为了提高信息的安全性,用密钥对秘密信息进行置乱加密处理,在解码端只有持有该密钥的用户才能正确解密,获得秘密信息。结果 实验使用HEVC参考软件HM16.0,选取分辨率不同的序列进行测试。结果表明,秘密信息嵌入后,视频测试序列的PSNR平均值为41.16 dB,与现有的信息隐藏方法相比,不仅保持较好的主观和客观视频质量,而且信息隐藏容量平均提升2倍左右。结论 采用本方法在保证原视频图像的质量的情况下,能够有效增加信息隐藏的容量,并能够一定程度阻止码率增长,符合信息隐藏的不可见性、安全性和实时性要求。