Rate-distortion optimized hybrid error control for real-time packetized video transmission.

The problem of application-layer error control for real-time video transmission over packet lossy networks is commonly addressed via joint source-channel coding (JSCC), where source coding and forward error correction (FEC) are jointly designed to compensate for packet losses. In this paper, we consider hybrid application-layer error correction consisting of FEC and retransmissions. The study is carried out in an integrated joint source-channel coding (IJSCC) framework, where error resilient source coding, channel coding, and error concealment are jointly considered in order to achieve the best video delivery quality. We first show the advantage of the proposed IJSCC framework as compared to a sequential JSCC approach, where error resilient source coding and channel coding are not fully integrated. In the USCC framework, we also study the performance of different error control scenarios, such as pure FEC, pure retransmission, and their combination. Pure FEC and application layer retransmissions are shown to each achieve optimal results depending on the packet loss rates and the round-trip time. A hybrid of FEC and retransmissions is shown to outperform each component individually due to its greater flexibility.     

Interleaved coding and sequential transmission scheme for packet‐level forward error correction over burst loss channels

Burst packet loss is a common problem over wired and wireless networks and leads to a significant reduction in the performance of packet‐level forward error correction (FEC) schemes used to recover packet losses during transmission. Traditional FEC interleaving methods adopt the sequential coding‐interleaved transmission (SCIT) process to encode the FEC packets sequentially and reorder the packet transmission sequence. Consequently, the burst loss effect can be mitigated at the expense of an increased end‐to‐end delay. Alternatively, the reversed interleaving scheme, namely, interleaved coding‐sequential transmission (ICST), performs FEC coding in an interleaved manner and transmits the packets sequentially based on their generation order in the application. In this study, the analytical FEC model is constructed to evaluate the performance of the SCIT and ICST schemes. From the analysis results, it can be observed that the interleaving delay of ICST FEC is reduced by transmitting the source packets immediately as they arrive from the application. Accordingly, an Enhanced ICST scheme is further proposed to trade the saved interleaving time for a greater interleaving capacity, and the corresponding packet loss rate can be minimized under a given delay constraint. The simulation results show that the Enhanced ICST scheme achieves a lower packet loss rate and a higher peak signal‐to‐noise‐ratio than the traditional SCIT and ICST schemes for video streaming applications.     

Performance of truncated type-II hybrid ARQ schemes with noisyfeedback over block fading channels

This paper considers truncated type-II hybrid automatic repeat-request (ARQ) schemes with noisy feedback over block fading channels. With these ARQ techniques, the number of retransmissions is limited, and, similar to forward error correction (FEC), error-free delivery of data packets cannot be guaranteed. Bounds on the average number of transmissions, the average coding rate as well as the reliability of the schemes are derived using random coding techniques, and the performance is compared with FEC. The random coding bounds reveal the achievable performance with block codes and maximum-likelihood soft-decision decoding. Union upper bounds and simulation results show that over block fading channels, these bounds can be closely approached with simple terminated convolutional codes and soft-decision Viterbi decoding. Truncated type-II hybrid ARQ and the corresponding FEC schemes have the same probability of packet erasure; however, the truncated ARQ schemes offer a trade-off between the average coding rate and the probability of undetected error. Truncated ARQ schemes have significantly higher average coding rates than FEC at high and medium signal-to-noise ratio even with noisy feedback. Truncated ARQ can be viewed as adaptive FEC that adapts to the instantaneous channel conditions     

基于H.264 SVC无线视频传输的自适应差错保护方法

提出了一种针对H.264可分级编码(H.264 SVC)的自适应前向纠错编码保护方案.通过比较不同的纠错方案,提出了划分丢包率区间的概念,并根据不同区间的丢包率自适应地选择最佳的纠错方案.仿真结果表明,与单一保护方法相比,所提自适应方法能够取得更好的保护效果,更适于在无线信道中进行视频传输.     

A low-complexity rate allocation algorithm for joint source-channel video coding

The problem of enabling robust video transmission over lossy networks has become increasingly important because of the growing interest in video delivery over unreliable channels such as wireless networks. The more the coding process relies on an intensive use of prediction to improve the coding gain, the more the reconstructed sequence proves to be sensitive to information losses. As a matter of fact, it is necessary to introduce some redundant data in order to increase the robustness of the coded bit stream. A possible solution can be found filling a matrix structure with RTP packets and applying a Forward Error Correction (FEC) code on its rows. However, the matrix size and the chosen FEC code affect the performance of the coding system. The paper proposes a novel adaptation technique that tunes the amount of redundant information included in the packet stream and differs from previously proposed solutions since it relies on the percentage of null quantized transform coefficients in place of the activity or the Mean Square Error (MSE). This strategy is then integrated in a joint source-channel coder rate allocation algorithm that shares the available bits between the H.264/AVC coder and the channel coder according to the significance of the frame in the decoding process. Experimental results show that the presented approach significantly improves the quality of the reconstructed sequences at the decoder with respect to activity-based strategies and requires a low computational complexity.     

Combined source-channel coding schemes for video transmission overan additive white Gaussian noise channel

There has been an increased interest in the transmission of digital video over real-world transmission media, such as the direct broadcast satellite (DBS) channel. Video transmitted over such a channel is subject to degradation due, in part, to additive white Gaussian noise (AWGN). Some form of forward error-control (FEC) coding may be applied in order to reduce the effect of the noise on the transmitted bitstream; however, determination of the appropriate level of FEC coding is generally an unwieldy and computationally intensive problem, as it may depend upon a variety of parameters such as the type of video, the available bandwidth, and the channel SNR. More specifically, a combined source-channel coding approach is necessary in optimally allocating rate between source and channel coding subject to a fixed constraint on overall transmission bandwidth. In this paper we develop a method of optimal bit allocation under the assumption that the distortion is additive and independent on a frame-by-frame basis. A set of universal operational distortion-rate characteristics is developed which balances the tradeoff between source coding accuracy and channel error protection for a fixed overall transmission rate and provides the basis for the optimal bit allocation approach. The results for specific source and channel coding schemes show marked improvement over suboptimum choices of channel error protection. In addition, we show that our results approach information-theoretic performance bounds which are developed in this work     

Adaptive two-stage FEC scheme for scalable video transmission over wireless networks

In this paper, we present a two-stage forward error correction (FEC) scheme with an enhanced link-layer protocol especially for multimedia data transmission over wireless LANs. At the application layer, packet-level FEC (stage-one) is added across packets to correct packet losses due to congestion and route disruption. Bit-level FEC (stage-two) is then added to both application packets and stage-one FEC packets to recover bit errors from the link layer. Then at the link layer, header-CRC/FEC is used to enhance protection and to cooperate with the two-stage FEC scheme. The proposed scheme thus provides joint protection across the protocol stack. We explore both its bandwidth efficiency and video performance for the highly efficient and scalable MC-EZBC video codec using the network simulator ns-2. Our results show that the proposed scheme can effectively increase application-layer throughput, reduce both end-to-end transmission delay and application bandwidth fluctuation, and significantly improve video performance.     

无线视频的一种码率控制方法

无线信道的高误码率对视频图像质量有很大的影响,前向纠错(FEC)和自动重发请求(ARQ)对于降低无线信道的误码率,提高图像质量有很好的效果。通过对FEC和ARQ方法的有效性分析,在TMN8的基础上提出一种简单的混合FEC/ARQ自适应模式选择码率控制方法。该方法首先预测报文丢失数量和纠错报文传输时延,从而选择合适的纠错编码模式,并为纠错编码分配比特数。实验结果表明该方法有效降低无线信道下报文丢失率,显著提高了图像质量。     

A self-governing rate buffer control strategy for pseudoconstantbit rate video coding

Video coding is a key to successful visual communications. An interframe video coding algorithm using hybrid motion-compensated prediction and interpolation is considered for coding studio quality video at a bit rate of over 5 Mb/s. Interframe coding without a buffer control strategy usually results in variable bit rates. Although packet networks may be capable of handling variable bit rates, in some applications, a constant bit rate is more desirable either for a simpler network configuration or for channels with fixed bandwidth. A self-governing rate buffer control strategy that can automatically steer the coder to a pseudoconstant bit rate is considered. This self-governing rate buffer control strategy employs more progressive quantization parameters, and constrains quantizer adjustments so that a smoother quality transition can be attained. Simulation results illustrate the performance of the pseudoconstant bit rate coder with this buffer control strategy.     

Modeling Best-Effort and FEC Streaming of Scalable Video in Lossy Network Channels

Video applications that transport delay-sensitive multimedia over best-effort networks usually require special mechanisms that can overcome packet loss without using retransmission. In response to this demand, forward-error correction (FEC) is often used in streaming applications to protect video and audio data in lossy network paths; however, studies in the literature report conflicting results on the benefits of FEC over best-effort streaming. To address this uncertainty, we start with a baseline case that examines the impact of packet loss on scalable (FGS-like) video in best-effort networks and derive a closed-form expression for the loss penalty imposed on embedded coding schemes under several simple loss models. Through this analysis, we find that the utility (i.e., usefulness to the user) of unprotected video converges to zero as streaming rates become high. We then study FEC-protected video streaming, re-derive the same utility metric, and show that for all values of loss rate inclusion of FEC overhead substantially improves the utility of video compared to the best-effort case. We finish the paper by constructing a dynamic controller on the amount of FEC that maximizes the utility of scalable video and show that the resulting system achieves a significantly better PSNR quality than alternative fixed-overhead methods     

Sliding‐window forward error correction using Reed‐Solomon code and unequal error protection for real‐time streaming video

Forward error correction (FEC) techniques are widely used to recover packet losses over unreliable networks in real‐time video streaming applications. Traditional frame‐level FEC encodes 1 video frame in each FEC coding window. By contrast, in the expanding‐window FEC scheme, high‐priority frames are included in the FEC processing of the following frames, so as to construct a larger coding window. In general, expanding‐window FEC improves the recovery performance of FEC, because the high‐priority frame can be protected by multiple windows and the use of a larger coding window increases the efficiency. However, the larger window size also increases the complexity of the coding and the memory space requirements. Consequently, expanding‐window FEC is limited in terms of practical applications. Sliding‐window FEC adopts a fixed window size in order to approximate the performance of the expanding‐window FEC method, but with a reduced complexity. Previous studies on sliding‐window FEC have generally adopted an equal error protection (EEP) mechanism to simplify the analysis. This paper considers the more practical case of an unequal error protection (UEP) strategy. An analytical model is derived for estimating the playable frame rate (PFR) of the proposed sliding‐window FEC scheme with a Reed‐Solomon erasure code for real‐time non‐scalable streaming applications. The analytical model is used to determine the optimal FEC configuration which maximizes the PFR value under given transmission rate constraints. The simulation results show that the proposed sliding‐window scheme achieves almost the same performance as the expanding‐window scheme, but with a significantly lower computational complexity.     

An Adaptive Packet and Block Length Forward Error Correction for Video Streaming Over Wireless Networks

Video streaming over wireless networks is a challenging task due to its high error rate. Forward error correction (FEC) is a popular mechanism to recover lost packets for video streaming. Conventional FEC mechanisms use a whole redundant packet to recover the error source packet, when the packet error occurs with only a few bit errors inside. In this paper, we propose an Adaptive packet and block length FEC (APB-FEC) control mechanism. In order to overcome the high bit error rate, a small packet length reduces the packet error rate and a large FEC block length will enhance the recovery performance. Our proposed APB-FEC can obtain better recovery performance than conventional FEC mechanisms. Hence, APB-FEC can also reduce retransmission overhead. Using extensive emulations, we validate the efficiency of APB-FEC mechanism for video streaming over wireless networks.     

Loss Tolerant Bandwidth Aggregation for Multihomed Video Streaming over Heterogeneous Wireless Networks

Bandwidth aggregation is a key research issue in integrating heterogeneous wireless networks, since it can substantially increase the throughput and reliability for enhancing streaming video quality. However, the burst loss in the unreliable wireless channels is a severely challenging problem which significantly degrades the effectiveness of bandwidth aggregation. Previous studies mainly address the critical problem by reactively increasing the forward error correction (FEC) redundancy. In this paper, we propose a loss tolerant bandwidth aggregation approach (LTBA), which proactively leverages the channel diversity in heterogeneous wireless networks to overcome the burst loss. First, we allocate the FEC packets according to the ‘loss-free’ bandwidth of each wireless network to the multihomed client. Second, we deliberately insert intervals between the FEC packets’ departures while still respecting the delay constraint. The proposed LTBA is able to reduce the consecutive packet loss under burst loss assumption. We carry out analysis to prove that the proposed LTBA outperforms the existing ‘back-to-back’ transmission schemes based on Gilbert loss model and continuous time Markov chain. We conduct the performance evaluation in Exata and emulation results show that LTBA outperforms the existing approaches in improving the video quality in terms of PSNR (Peak Signal-to-Noise Ratio).     

Performance modeling of FEC‐based unequal error protection for H.264/AVC video streaming over burst‐loss channels

Unequal error protection systems are a popular technique for video streaming. Forward error correction (FEC) is one of error control techniques to improve the quality of video streaming over lossy channels. Moreover, frame‐level FEC techniques have been proposed for video streaming because of different priority video frames within the transmission rate constraint on a Bernoulli channel. However, various communication and storage systems are likely corrupted by bursts of noise in the current wireless behavior. If the burst losses go beyond the protection capacity of FEC, the efficacy of FEC can be degraded. Therefore, our proposed model allows an assessment of the perceived quality of H.264/AVC video streaming over bursty channels, and is validated by simulation experiments on the NS‐2 network simulator at a given estimate of the packet loss ratio and average burst length. The results suggest a useful reference in designing the FEC scheme for video applications, and as the video coding and channel parameters are given, the proposed model can provide a more accurate evaluation tool for video streaming over bursty channels and help to evaluate the impact of FEC performance on different burst‐loss parameters. Copyright © 2014 John Wiley & Sons, Ltd.     

Hierarchical Optimization of Cascading Error Protection Scheme for H.264 Scalable Video Streaming

Forward error correction (FEC) coding has been shown to offer a feasible solution to fulfill the need for Quality of Service for multimedia streaming over the fluctuant channels, especially in terms of the reduction of end-to-end delay. In this paper, we propose the Dynamic FEC-Distortion Optimization Algorithm to efficiently utilize the network bandwidth for better visual quality by means of hierarchical coding structure with the cascading error protection scheme. The optimization criteria are based on the unequal error protection by taking account of the error drifting problems from both temporal motion compensation and inter-layer prediction of the H.264/MPEG-4 AVC scalable video coding so that the priorities of each video components can be differentiated for the calculation of the distribution of parity packets. It is shown that the cascading error protection scheme makes the hierarchical structure of error erasure code more efficient. Also, the proposed algorithm works particularly well for fast motion videos and the performance does not depend on accurate estimation of packet loss rate.     

Robust Packet Video Transport Over Wireless Fading Channels Using a Joint Source-channel Coding Approach

In this paper, we address the problem of robust video transmission over wireless networks. Specifically, we consider packet video transmission over wireless IP networks based on the RTP/UDP/IP protocol stack. Digital video delivered over wireless networks is expected to suffer quality degradation from both packet loss and bit errors in the payload. In this paper, both packet loss and bit errors in the payload are considered and the performance of a joint source-channel coding (JSCC) approach employing forward error-correction (FEC) coding schemes for H.263 +  video transmission is studied. Results indicate that with an appropriate JSCC approach, FEC-based error-control techniques can significantly improve the packetization efficiency for a given end-to-end quality requirement and lead to more acceptable video delivery quality over time-varying wireless networks. Another important observation is that with a JSCC approach the fading effects of wireless links upon end-to-end video quality are substantially decreased compared to a system without using channel coding, resulting in attractive robust performance characteristics.

Estimation of accurate effective loss rate for FEC video transmission

We propose an algorithm for adjusting data transmission parameters, such as the packet size and the code rate of forward error correction (FEC), to obtain maximum video quality under dynamic channel conditions. When determining transmission parameters, it is essential to calculate an accurate effective loss rate that reflects FEC recovery failures and over-deadline packets. To this end, we analyze the delays caused by FEC coding and the potential packet size variations. In our analysis, we consider the effect of delayed transmission of video packets incurred by the parity packets as well as the encoder and decoder buffers. With the analysis reflecting the delay effect, we are able to accurately estimate the delay patterns of all video packets. Based on the analysis results, we establish an accurate model for estimating the effective loss rate. Simulations show that the proposed effective loss rate model accurately estimates the effective loss rate and significantly improves the reconstructed video quality at the receiver.     

Small‐block interleaving for low‐delay cross‐packet forward error correction over burst‐loss channels

By adding the redundant packets into source packet block, cross‐packet forward error correction (FEC) scheme performs error correction across packets and can recover both congestion packet loss and wireless bit errors accordingly. Because cross‐packet FEC typically trades the additional latency to combat burst losses in the wireless channel, this paper presents a FEC enhancement scheme using the small‐block interleaving technique to enhance cross‐packet FEC with the decreased delay and improved good‐put. Specifically, adopting short block size is effective in reducing FEC processing delay, whereas the corresponding effect of lower burst‐error correction capacity can be compensated by deliberately controlling the interleaving degree. The main features include (i) the proposed scheme that operates in the post‐processing manner to be compatible with the existing FEC control schemes and (ii) to maximize the data good‐put in lossy networks; an analytical FEC model is built on the interleaved Gilbert‐Elliott channel to determine the optimal FEC parameters. The simulation results show that the small‐block interleaved FEC scheme significantly improves the video streaming quality in lossy channels for delay‐sensitive video. Copyright © 2013 John Wiley & Sons, Ltd.