Joint Source-Channel Distortion Modeling for MPEG-4 Video

Multimedia communication has become one of the main applications in commercial wireless systems. Multimedia sources, mainly consisting of digital images and videos, have high bandwidth requirements. Since bandwidth is a valuable resource, it is important that its use should be optimized for image and video communication. Therefore, interest in developing new joint source-channel coding (JSCC) methods for image and video communication is increasing. Design of any JSCC scheme requires an estimate of the distortion at different source coding rates and under different channel conditions. The common approach to obtain this estimate is via simulations or operational rate-distortion curves. These approaches, however, are computationally intensive and, hence, not feasible for real-time coding and transmission applications. A more feasible approach to estimate distortion is to develop models that predict distortion at different source coding rates and under different channel conditions. Based on this idea, we present a distortion model for estimating the distortion due to quantization and channel errors in MPEG-4 compressed video streams at different source coding rates and channel bit error rates. This model takes into account important aspects of video compression such as transform coding, motion compensation, and variable length coding. Results show that our model estimates distortion within 1.5 dB of actual simulation values in terms of peak-signal-to-noise ratio.      

Progressive image transmission over differentially space‐time coded OFDM systems

In this paper, we consider progressive image transmission over differentially space‐time coded orthogonal frequency‐division multiplexing (OFDM) systems and treat the problem as one of optimal joint source‐channel coding (JSCC) in the form of unequal error protection (UEP), as necessitated by embedded source coding (e.g., SPIHT and JPEG 2000). We adopt a product channel code structure that is proven to provide powerful error protection and employ low‐complexity decision‐feedback decoding for differentially space‐time coded OFDM without assuming channel state information. For a given SNR, the BER performance of the differentially space‐time coded OFDM system is treated as the channel condition in the JSCC/UEP design via a fast product code optimization algorithm so that the end‐to‐end quality of reconstructed images is optimized in the average minimum MSE sense. Extensive image transmission experiments show that SNR/BER improvements can be translated into quality gains in reconstructed images. Moreover, compared to another non‐coherent detection algorithm, i.e., the iterative receiver based on expectation‐maximization algorithm for the space‐time coded OFDM systems, differentially space‐time coded OFDM systems suffer some quality loss in reconstructed images. With the efficiency and simplicity of decision‐feedback differential decoding, differentially space‐time coded OFDM is thus a feasible modulation scheme for applications such as wireless image over mobile devices (e.g., cell phones). Copyright © 2006 John Wiley & Sons, Ltd.     

MPEG-4 image transmission using MAP source-controlled channeldecoding

In this paper, we develop an error resilient variant of the MPEG-4 embedded zerotree wavelet coder, suitable for mobile fading channels. The residual redundancy in the compressed bit stream provides implicit error protection through the use of source-controlled channel decoding; no explicit channel coding is used. We propose two slight modifications to the MPEG-4 coder. The first removes the arithmetic coding in the lowest frequency subband so that hidden Markov model-based MAP estimation of both the source index and the channel state can be easily applied. The change in bit rate is negligible, while performance during severe channel fading conditions can be greatly increased. The second modification adds variable length packetization to the compressed bit stream created from the higher frequency subbands. The individual packets are independently decodable. An optional rearrangement of the bits in each packet allows MAP estimation to be applied to these subbands as well. Simulation results show a significant performance improvement for the overall system     

A robust joint source channel coding scheme for image transmission over the ionospheric channel

In this paper, we propose a joint source channel coding (JSCC) scheme to the transmission of fixed images for wireless communication applications. The ionospheric channel which presents some characteristics identical to those found on mobile radio channels, like fading, multipath and Doppler effect is our test channel. As this method based on a wavelet transform, a self-organising map (SOM) vector quantization (VQ) optimally mapped on a QAM digital modulation and an unequal error protection (UEP) strategy, this method is particularly well adapted to low bit-rate applications. The compression process consists in applying a SOM VQ on the discrete wavelet transform coefficients and computing several codebooks depending on the sub-images preserved. An UEP is achieved with a correcting code applied on the most significant data. The JSCC consists of an optimal mapping of the VQ codebook vectors on a high spectral efficiency digital modulation. This feature allows preserving the topological organization of the codebook along the transmission chain while keeping a reduced complexity system. This method applied on grey level images can be used for colour images as well. Several tests of transmission for different images have shown the robustness of this method even for high bit error rate (BER>10⁻²). In order to qualify the quality of the image after transmission, we use a PSNR% (peak signal-to-noise ratio) parameter which is the value of the difference of the PSNR after compression at the transmitter and after reception at the receiver. This parameter clearly shows that 95% of the PSNR is preserved when the BER is less than 10⁻².     

Unequal error protection by modulation with unequal power allocation

In digital communication systems for speech, audio or video signals the individual bits of the transmitted parameters u exhibit different bit error sensitivities. Usually channel coding with unequal error protection (UEP) is applied. However, some transmission systems do not include channel coding for several reasons. For this situation, a novel concept is proposed which achieves UEP by allocating different transmission power to individual bits according to their bit error sensitivities. The optimization criterion for unequal power allocation is the mean square of the error between the original parameter-u and the decoded parameter u which has a strong correlation with subjective perception.     

Multiview coding and error correction coding for 3D video over noisy channels

We consider the joint source–channel coding problem of stereo video transmitted over AWGN and flat Rayleigh fading channels. Multiview coding (MVC) is used to encode the source, as well as a type of spatial scalable MVC. Our goal is to minimize the total number of bits, which is the sum of the number of source bits and the number of forward error correction bits, under the constraints that the quality of the left and right views must each be greater than predetermined PSNR thresholds at the receiver. We first consider symmetric coding, for which the quality thresholds are equal. Following binocular suppression theory, we also consider asymmetric coding, for which the quality thresholds are unequal. The optimization problem is solved using both equal error protection (EEP) and a proposed unequal error protection (UEP) scheme. An estimate of the expected end-to-end distortion of the two views is formulated for a packetized MVC bitstream over a noisy channel. The UEP algorithm uses these estimates for packet rate allocation. Results for various scenarios, including non-scalable/scalable MVC, symmetric/asymmetric coding, and UEP/EEP, are provided for both AWGN and flat Rayleigh fading channels. The UEP bit savings compared to EEP are given, and the performances of different scenarios are compared for a set of stereo video sequences.     

OFDM-based turbo-coded hierarchical and non-hierarchicalterrestrial mobile digital video broadcasting

The feasibility of terrestrial digital video broadcast (DVB) to mobile receivers is studied and turbo coded performance enhancements are proposed. Initially, the MPEG-2 codec is subjected to a rigorous bit error sensitivity investigation, in order to assist in designing various error protection schemes for wireless DVB transmission. The turbo codec is shown to provide signal-to-noise ratio (SNR) performance advantages in excess of 5-6 dB over conventional convolutional coding both in terms of bit error rate and video quality. Our experiments suggested that-despite our expectations-multi-class data partitioning did not result in error resilience improvements, since a high proportion of relatively sensitive video bits had to be relegated to the lower integrity subchannel, when invoking a powerful low-rate channel codec in the high-integrity protection class. Nonetheless, DVB transmission to mobile receivers is feasible, when using turbo-coded OFDM transceivers at realistic power-budget requirements under the investigated highly dispersive fading channel conditions. It is interesting to note furthermore that the 5-6 dB SNR improvement due to turbo coding allows us to invoke for example the double-throughput 16-level quadrature amplitude modulation (16-QAM) mode instead of the standard convolutional-coded 4-QAM mode. This facilitates doubling the bit rate and hence improving the video quality     

Optimized error protection of scalable image bit streams [advances in joint source-channel coding for images]

This article focuses on FEC for scalable image coders. For various channel models, we survey recent progress made in system design and discuss efficient source-channel bit allocation techniques, with emphasis on unequal error protection. This article considered JSCC (joint source-channel coding) at the application layer only. Recent research has studied cross-layer optimization where JSCC is applied to both the application layer and the physical layer. The basic task here is to minimize the average distortion by allocating available power, subcarriers, and bandwidth among users at the physical layer and source-channel symbols at the application layer subject to a total resource constraint. Most of the JSCC systems covered in this article can be readily extended to transmit scalable compressed bit streams of video sequences and 3-D meshes. Due to the stringent delay constraints in video communications and the fact that MPEG is currently exploring a scalable video coding standard, fast JSCC algorithms are expected to play a bigger role and bring more performance gains. This article is also expected to stimulate further research efforts into JSCC and more importantly, prompt the industry to adopt some of these JSCC algorithms in their system designs, thus closing the cycle from algorithm development to implementation.     

Error Protection and Interleaving for Wireless Transmission of JPEG 2000 Images and Video

The transmission of JPEG 2000 images or video over wireless channels has to cope with the high probability and burstyness of errors introduced by Gaussian noise, linear distortions, and fading. At the receiver side, there is distortion due to the compression performed at the sender side, and to the errors introduced in the data stream by the channel. Progressive source coding can also be successfully exploited to protect different portions of the data stream with different channel code rates, based upon the relative importance that each portion has on the reconstructed image. Unequal error protection (UEP) schemes are generally adopted, which offer a close to the optimal solution. In this paper, we present a dichotomic technique for searching the optimal UEP strategy, which lends ideas from existing algorithms, for the transmission of JPEG 2000 images and video over a wireless channel. Moreover, we also adopt a method of virtual interleaving to be used for the transmission of high bit rate streams over packet loss channels, guaranteeing a large PSNR advantage over a plain transmission scheme. These two protection strategies can also be combined to maximize the error correction capabilities.     

基于不等差错保护的信源信道联合编码技术的研究

文中首先对与信源信道联合编码技术相关的一些必要背景知识作了简要介绍.接着提出了一种无线信道中基于小波SPIHT算法的联合信源信道编码方法.主要思想是信源部分采用基于小波SPIHT的编码方法,而信道部分采用RCPC编码对SPIHT输出码流按重要性进行不等错误保护,并加入交织以增强对突发错误的抗击能力.实验表明本方法能够提高系统的性能和编码效率,可以应用于信噪比波动较大的信道.     

基于MPEG-4的视频联合信源信道编码

该文提出了一种用于提高MPEG-4码流在噪声信道下的抗误码性能的联合信源信道编码方法。该方法将MPEG-4基本层按重要性进行码流重排后进行交织打包,并根据率失真函数将基本层纹理信息进一步划分为多个子层。编码器根据反映信道状态的反馈信息动态地调整传输的子层数目和每个子层的纠错强度(信道编码速率),使得系统失真最小。仿真结果表明,该方法明显优于未保护的MPEG-4方法,在相同信道带宽及丢包率条件下比等纠错保护的MPEG-4编码方法获得更加稳定的性能。同时由于该方法根据反馈的出错分组数进行传输子层数和纠错强度的联合优化,与Puri等人提出的按照确定信道条件设计目标函数进行优化的MDFEC方法相比,更能够适应信道条件的变化,从而获得更高的性能。     

Speech transmission using rate-compatible trellis codes andembedded source coding

This paper presents bandwidth-efficient speech transmission systems using rate-compatible channel coders and variable bitrate embedded source coders. Rate-compatible punctured convolutional codes (RCPC) are often used to provide unequal error protection (UEP) via progressive bit puncturing. RCPC codes are well suited for constellations for which Euclidean and Hamming distances are equivalent (BPSK and 4-PSK). This paper introduces rate-compatible punctured trellis codes (RCPT) where rate compatibility and UEP are provided via progressive puncturing of symbols in a trellis. RCPT codes constitute a special class of codes designed to maximize residual Euclidean distances (RED) after symbol puncturing. They can be designed for any constellation, allowing for higher throughput than when restricted to using 4-PSK. We apply RCPC and RCPT to two embedded source coders: a perceptual subband coder and the ITU embedded ADPCM G.727 standard. Different operating modes with distinct source/channel bit allocation and UEP are defined. Each mode is optimal for a certain range of AWGN channel SNRs. Performance results using an 8-PSK constellation clearly illustrate the wide range of channel conditions at which the adaptive scheme using RCPT can operate. For an 8-PSK constellation, RCPT codes are compared to RCPC with bit interleaved coded modulation codes (RCPC-BICM). We also compare performance to RCPC codes used with a 4-PSK constellation     

Robust adaptive transmission of images and video over multiple channels

Reliable transmission of images and video over wireless networks must address both potentially limited bandwidths and the possibilities of loss. When bandwidth sufficient to transmit the bit stream is unavailable on a single channel, the data can be partitioned over multiple channels with possibly unequal bandwidths and error characteristics at the expense of more complex channel coding (i.e., error correction). This paper addresses the problem of efficiently channel coding and partitioning pre-encoded image and video bit streams into substreams for transmission over multiple channels with unequal and time-varying characteristics. Within channels, error protection is unequally applied based on both data decoding priority and channel packet loss rates, while cross-channel coding addresses channel failures. In comparison with conventional product codes, the resulting product code does not restrict the total encoded data to a rectangular structure; rather, the data in each channel is adaptively coded according to the channel's varying conditions. The coding and partitioning are optimized to achieve two performance criteria: maximum bandwidth efficiency and minimum delay. Simulation results demonstrate that this approach is effective under a variety of channel conditions and for a broad range of source material.     

一种综合源编码和信道编码的图像编码方案

提出了一新的综合源编码和信道编码的图像编码传输方案，对子波变换后各个子带采用基于统计特性的变系数定长（VCFL）编码后选择不同码率的RCPC（码率兼容的删除卷积码，Rate Compatible Punctured Convolutional code)信道编码以提供不同程度的差错保护（UEP）并进行传输。在给定传输的总比特数的情况下，通过一种优化算法使方案的总体失真最小。模拟结果表明新方案压缩比高，在较高的传输误码率情况下，表现出良好的抗误码能力。     

On Joint Source and Channel Coding Using Trellis Coded CPM: Analytical Bounds on the Channel Distortion

Joint source and channel coding (JSCC) using trellis coded quantization (TCQ) in conjunction with trellis coded continuous phase modulation (CPM) is studied. The channel is assumed to be the additive white gaussian noise (AWGN) channel. Analytical bounds on the channel distortion for the investigated systems with maximum-likelihood sequence detection (MLSD) are developed. The bounds are based on the transfer function technique, which was modified and generalized to include continuous-amplitude discrete-time signals. For a memoryless uniform source, the constructed bounds for the investigated systems are shown to be asymptotically tight for increasing channel signal-to-noise ratio (SNR) values. For a memoryless nonuniform source, the constructed bounds are not as tight as the one for the uniform source, however, it still can be used as an indication to how the system performs. It is concluded that the minimum Euclidean distance of the system alone is not enough to evaluate the performance of the considered systems. The number of error events having minimum Euclidean distance and the total distortion caused by those error events also affect the asymptotic performance. This work provides an analysis tool for the investigated systems. The analysis method is very general. It may be applied to any trellis based JSCC schemes.     

Forward error control for MPEG-2 video transport in a wireless ATM LAN

The possibility of providing multimedia services to mobile users has led to interest in designing broadband wireless networks that can guarantee quality of service for traffic flows. However, a fundamental problem in these networks is that severe losses may occur due to the random fading characteristics of the wireless channel. Error control algorithms which compensate for these losses are required in order to achieve reasonable loss rates. In this paper, the performance of error control based on forward error correction (FEC) for MPEG-2 video transmission in an indoor wireless ATM LAN is studied. A random bit error model and a multipath fading model are used to investigate the effect of errors on video transport. Combined source and channel coding techniques that employ single-layer and scalable MPEG-2 coding to combat channel errors are compared. Simulation results indicate that FEC-based error control in combination with 2-layer video coding techniques can lead to acceptable quality for indoor wireless ATM video.Work performed while the author was at AT&T Bell Laboratories on a D.O.E. fellowship program.     

Toward a unified framework for modeling and analysis of diversity in joint source-channel coding

The study of joint source-channel coding (JSCC) systems faces one major challenge in obtaining an analytical expression for the function that links end-to-end distortion with channel signal-to-noise ratio, the D-SNR curve. In this paper, for certain multimedia systems using practical source and channel codes in a JSCC bit rate allocation design, the D-SNR curve is shown to be well approximated by a set of carefully selected points where the relative contribution of channel errors to end-to-end distortion is small. This approach has the potential advantage that it could be applied to represent performance of many practical systems using JSCC bit rate allocation for which it is shown that the D-SNR function is approximately linear in log-log scales. A unified framework for the modeling, analysis and performance measurement of these systems is proposed by considering a view of diversity more general than its usual interpretation. This view extends that of diversity to include redundant information so coding and diversity gain are still used to characterize performance. Furthermore, the proposed approach is applied to study issues arising from using practical source and channel codes, including the effects on performance of channel codes of different strength or source codes with different compression efficiency.     

Rate-distortion optimized hybrid error control for real-time packetized video transmission.

The problem of application-layer error control for real-time video transmission over packet lossy networks is commonly addressed via joint source-channel coding (JSCC), where source coding and forward error correction (FEC) are jointly designed to compensate for packet losses. In this paper, we consider hybrid application-layer error correction consisting of FEC and retransmissions. The study is carried out in an integrated joint source-channel coding (IJSCC) framework, where error resilient source coding, channel coding, and error concealment are jointly considered in order to achieve the best video delivery quality. We first show the advantage of the proposed IJSCC framework as compared to a sequential JSCC approach, where error resilient source coding and channel coding are not fully integrated. In the USCC framework, we also study the performance of different error control scenarios, such as pure FEC, pure retransmission, and their combination. Pure FEC and application layer retransmissions are shown to each achieve optimal results depending on the packet loss rates and the round-trip time. A hybrid of FEC and retransmissions is shown to outperform each component individually due to its greater flexibility.