Soft multiuser decoding for vector quantization over a CDMA channel

An approach to optimal soft decoding for vector quantization (VQ) over a code-division multiple-access (CDMA) channel is presented. The decoder of the system is soft in the sense that the unquantized outputs of the matched filters are utilized directly for decoding (no decisions are taken), and optimal according to the minimum mean-squared error (MMSE) criterion. The derived decoder utilizes a priori source information and knowledge of the channel characteristics to combat channel noise and multiuser interference in an optimal fashion. Hadamard transform representations for the user VQs are employed in the derivation and for the implementation of the decoder. The advantages of this approach are emphasized. Suboptimal versions of the optimal decoder are also considered. Simulations show the soft decoders to outperform decoding based on maximum-likelihood (ML) multiuser detection. Furthermore, the suboptimal versions are demonstrated to perform close to the optimal, at a significantly lower complexity in the number of users. The introduced decoders are, moreover, shown to exhibit near-far resistance. Simulations also demonstrate that combined source-channel encoding, with joint source-channel and multiuser decoding, can significantly outperform a tandem source-channel coding scheme employing multiuser detection plus table lookup source decoding     

信源-信道联合编码／调制中映射方式的优化

在信源-信道联合编码/调制中,通过优化信源和信道调制符号间的映射关系,在端到端均方误差的失真度量标准下,可以得到比传统级联编码系统更好的性能。且通过类似BSA的交换算法求得局部最优映射方式,有更高的重建信噪比,系统复杂度低。     

Joint source-channel coding and guessing with application tosequential decoding

We extend our earlier work on guessing subject to distortion to the joint source-channel coding context. We consider a system in which there is a source connected to a destination via a channel and the goal is to reconstruct the source output at the destination within a prescribed distortion level with respect to (w.r.t.) some distortion measure. The decoder is a guessing decoder in the sense that it is allowed to generate successive estimates of the source output until the distortion criterion is met. The problem is to design the encoder and the decoder so as to minimize the average number of estimates until successful reconstruction. We derive estimates on nonnegative moments of the number of guesses, which are asymptotically tight as the length of the source block goes to infinity. Using the close relationship between guessing and sequential decoding, we give a tight lower bound to the complexity of sequential decoding in joint source-channel coding systems, complementing earlier works by Koshelev (1973) and Hellman (1975). Another topic explored here is the probability of error for list decoders with exponential list sizes for joint source-channel coding systems, for which we obtain tight bounds as well. It is noteworthy that optimal performance w.r.t. the performance measures considered here can be achieved in a manner that separates source coding and channel coding     

基于深度学习的信源信道联合编码方法综述

信息论的经典结果表明,信源信道分离编码是渐进最优的。但现代通信系统对时延、带宽等愈发敏感,分离设计对解码具有无限计算能力这一假设难以成立。带宽有限时,相对于信源信道联合编码,分离编码已被证明是次优的。传统的联合信源信道编码需要复杂的编码方案,相较之下,数据驱动的深度学习技术则带来了新的设计思路。适时地对相关研究成果进行总结,有助于进一步明确深度学习方法解决信源信道联合编码问题的方式,为研究新的研究方向提供依据。首先介绍了基于深度学习的信源压缩方案和端对端收发信机模型,随后分析不同信源类型下的两种联合编码设计思路,最后探讨了基于深度学习的信源信道联合编码的潜在问题和未来的工作方向。     

信源反馈条件下Raptor码的一种解码算法

在Raptor码普通译码方法的基础上,结合信源信道联合译码方法,提出一种利用信源解码器反馈信息作为输入的改进译码的算法,并对此算法进行试验仿真以及参数研究。测试结果显示,在信源信道联合编码条件下,使用这种双信息来源的译码的算法,可以使得信道解码的成功率大幅提高,残留误码率大幅降低。最后,将这种算法与JPEG2000信源编码结合测试,图像的PSNR值比普通译码方法最高提高了6dB。在信道条件恶劣的无线传输中具有重要意义。     

基于滑窗置信传播算法的联合信源信道编码

针对联合信源信道编码中信源统计特性和信道噪声参数未知情况下,解码算法性能急剧下降的问题,提出一种基于滑窗置信传播算法(SWBP)的联合信源信道编码,简称滑窗算法.研究采用不规则重复累积(IRA)码来实现基于滑窗置信传播算法的联合信源信道编码,IRA码可以取得与低密度奇偶校验(LDPC)码同样优越的性能,但编码复杂度远远低于LDPC码.在解码端引入滑动窗口,通过实时地估计不断变化的信源统计特性和信道噪声参数,从而提高解码速率.实验结果表明该算法具有接近相关参数已知情况下的理想性能、不依赖于初始参数、复杂度低且易于实现等优点.     

Joint Source–Channel Turbo Techniques for Discrete-Valued Sources: From Theory to Practice

The principles which have been prevailing so far for designing communication systems rely on Shannon's source and channel coding separation theorem. This theorem states that source and channel optimum performance bounds can be approached as close as desired by designing independently the source and channel coding strategies. However, this theorem holds only under asymptotic conditions, where both codes are allowed infinite length and complexity. If the design of the system is constrained in terms of delay and complexity, if the sources are not stationary, or if the channels are nonergodic, separate design and optimization of the source and channel coders can be largely suboptimal. For practical systems, joint source-channel (de)coding may reduce the end-to-end distortion. It is one of the aspects covered by the term cross-layer design, meaning a rethinking of the layer separation principle. This article focuses on recent developments of joint source-channel turbo coding and decoding techniques, which are described in the framework of normal factor graphs. The scope is restricted to lossless compression and discrete-valued sources. The presented techniques can be applied to the quantized values of a lossy source codec but the quantizer itself and its impact are not considered.     

Joint source-channel and multiuser decoding for Rayleigh fadingCDMA channels

We consider joint source-channel and multiuser decoding for frequency selective Rayleigh fading code-division multiple-access channels. The block source-channel encoder is defined by a vector quantizer. We investigate optimal (minimum mean-square error) decoding and “user-separated” decoding of lower complexity. The studied decoders are soft in the sense that they utilize all soft information available at the receiver. Simulations indicate significant performance gains of the introduced decoders compared with a tandem approach that uses maximum-likelihood multiuser detection plus table-lookup decoding     

小波编码图像联合信源信道解码算法的研究

为提高图像在噪声信道中传输的可靠性,该文提出了一种图像联合信源信道解码方案。信源图像首先经离散小波变换,压缩编码。编码数据经RCPC(率兼容删余卷积码)信道编码保护,通过噪声信道传输。在接收端的改进的APRI-SOVA (先验信息软输出维特比算法)在信道解码时,不仅利用了信道输出的软判决,而且进一步利用了信源解码器提供的当前解码的比特的可靠性信息。仿真结果显示,有效利用信源数据中遗留的相关性,能够实现图像解码质量的提高。     

Scalable image and video transmission using irregular repeat-accumulate codes with fast algorithm for optimal unequal error protection

This paper considers designing and applying punctured irregular repeat-accumulate (IRA) codes for scalable image and video transmission over binary symmetric channels. IRA codes of different rates are obtained by puncturing the parity bits of a mother IRA code, which uses a systematic encoder. One of the main ideas presented here is the design of the mother code such that the entire set of higher rate codes obtained by puncturing are good. To find a good unequal error protection for embedded bit streams, we employ the fast joint source-channel coding algorithm in Hamzaoui et al. to minimize the expected end-to-end distortion. We test with two scalable image coders (SPIHT and JPEG-2000) and two scalable video coders (3-D SPIHT and H.26L-based PFGS). Simulations show better results with IRA codes than those reported in Banister et al. with JPEG-2000 and turbo codes. The IRA codes proposed here also have lower decoding complexity than the turbo codes used by Banister et al.     

Hybrid symbol- and bit-based source-controlled channel decoding for MELP speech parameters

A joint source channel coding (JSCC) scheme which exploits bit-level correlation as well as symbol-level correlation efficiently in a source-controlled channel decoding (SCCD) process is proposed and applied to the mixed-excitation linear prediction (MELP) parameters of speech. A modified BCJR algorithm is also proposed for use in the SCCD algorithm. Simulation results show that our proposed scheme performs better than other redundancy-based JSCC schemes such as bit-based SCCD, soft-bit speech decoding (SBSD) and iterative source-channel decoding.     

Joint source-channel coding using real BCH codes for robust image transmission.

In this paper, a new still image coding scheme is presented. In contrast with standard tandem coding schemes, where the redundancy is introduced after source coding, it is introduced before source coding using real BCH codes. A joint channel model is first presented. The model corresponds to a memoryless mixture of Gaussian and Bernoulli-Gaussian noise. It may represent the source coder, the channel coder, the physical channel, and their corresponding decoder. Decoding algorithms are derived from this channel model and compared to a state-of-art real BCH decoding scheme. A further comparison with two reference tandem coding schemes and the proposed joint coding scheme for the robust transmission of still images has been presented. When the tandem scheme is not accurately tuned, the joint coding scheme outperforms the tandem scheme in all situations. Compared to a tandem scheme well tuned for a given channel situation, the joint coding scheme shows an increased robustness as the channel conditions worsen. The soft performance degradation observed when the channel worsens gives an additional advantage to the joint source-channel coding scheme for fading channels, since a reconstruction with moderate quality may be still possible, even if the channel is in a deep fade.     

Joint source-channel decoding of predictively and nonpredictively encoded sources: a two-stage estimation approach

A common joint source-channel (JSC) decoder structure for predictively encoded sources involves first forming a JSC decoding estimate of the prediction residual and then feeding this estimate to a standard predictive decoding (synthesis) filter. In this paper, we demonstrate that in a JSC decoding context, use of this standard filter is suboptimal. In place of the standard filter, we choose the synthesis filter coefficients to give a least-squares (LS) estimate of the original source, based on given training data. For first-order differential pulse-code modulation, this yields as much as 0.65-dB gain in reconstructing first-order Gauss-Markov sources. More gains are achieved with modest additional complexity by increasing the filter order. While performance can also be enhanced by increasing the source's Markov model order and/or the decoder's lookup table memory, complexity grows exponentially in these parameters. For both predictive and nonpredictive coding, our LS approach offers a strategy for increasing the estimation accuracy of JSC decoders while retaining manageable complexity.     

Successively Structured Gaussian Two-terminal Source Coding

Multiterminal source coding refers to separate encoding and joint decoding of multiple correlated sources. Joint decoding requires all the messages to be decoded simultaneously which is exponentially more complex than a sequence of single-message decodings. Inspired by previous work on successive coding, we apply the successive Wyner-Ziv coding, which is inherently a low complexity approach of obtaining a prescribed distortion, to the two-terminal source coding scheme. First, we consider 1-helper problem where one source provides partial side information to the decoder to help the reconstruction of the main source. Our results show that the successive coding strategy is an optimal strategy in the sense of achieving the rate-distortion function. By developing connections between source encoding and data fusion steps, it is shown that the whole rate-distortion region for the 2-terminal source coding problem is achievable using the successive coding strategy. Comparing the performance of the sequential coding with the performance of the successive coding, we show that there is no sum-rate loss when the side information is not available at the encoder. This result is of special interest in some applications such as video coding where there are processing and storage constraints at the encoder. Finally, we provide an achievable rate-distortion region for the m-terminal source coding.

Soft decoding and synchronization of arithmetic codes: application to image transmission over noisy channels

The paper addresses the issue of robust and joint source-channel decoding of arithmetic codes. We first analyze dependencies between the variables involved in arithmetic coding by means of the Bayesian formalism. This provides a suitable framework for designing a soft decoding algorithm that provides high error-resilience. It also provides a natural setting for "soft synchronization", i.e., to introduce anchors favoring the likelihood of "synchronized" paths. In order to maintain the complexity of the estimation within a realistic range, a simple, yet efficient, pruning method is described. The algorithm can be placed in an iterative source-channel decoding structure, in the spirit of serial turbo codes. Models and algorithms are then applied to context-based arithmetic coding widely used in practical systems (e.g., JPEG-2000). Experimentation results with both theoretical sources and with real images coded with JPEG-2000 reveal very good error resilience performances.     

A unified approach to tree-structured and multistage vectorquantization for noisy channels

The large encoding complexity and sensitivity to channel errors of vector quantization (VQ) are discussed. The performance of two low-complexity VQs-the tree-structured VQ (TSVQ) and the multistage VQ (MSVQ)-when used over noisy channels are analyzed. An algorithm is developed for the design of channel-matched TSVQ (CM-TSVQ) and channel-matched MSVQ (CM-MSVQ) under the squared-error criterion. Extensive numerical results are given for the correlation coefficient 0.9. Comparisons with the ordinary TSVQ and MSVQ designed for the noiseless channel show substantial improvements when the channel is very noisy. The CM-MSVQ, which can be regarded as a block-structured combined source-channel coding scheme, is compared with a block-structured tandem source-channel coding scheme (with the same block length as the CM-MSVQ). For the Gauss-Markov source, the CM-MSVQ outperforms the tandem scheme in all cases that the authors have considered. It is demonstrated that the CM-MSVQ is fairly robust to channel mismatch     

Hybrid digital-analog (HDA) joint source-channel codes forbroadcasting and robust communications

We consider the problem of transmitting a band-limited Gaussian source on an additive band-limited Gaussian noise channel. The well-known "threshold effect" dictates that the more powerful a code is, the more sensitive it is to the exact knowledge of the channel noise. A code is said to be robust if it is asymptotically optimal for a wide range of channel noise. Thus, robust codes have a "graceful degradation" characteristic and are free of the threshold effect. It is demonstrated that robust codes exist whenever the source and channel bandwidths are equal. In the unequal-bandwidth case, a collection of nearly robust joint source-channel codes is constructed using a hybrid digital-analog (HDA) coding technique. For designing nearly robust codes, a matched tandem code whose channel encoder's output is partially/fully matched to its input is proposed and the existence of an asymptotically optimal matched tandem code is shown. The nearly robust codes achieve the Shannon limit (theoretically optimum distortion) and have a less severe threshold effect. Finally, for the case of two different noise conditions, the distortion regions of these codes are determined     

Joint source-channel turbo coding for binary Markov sources

We investigate the construction of joint source-channel (JSC) turbo codes for the reliable communication of binary Markov sources over additive white Gaussian noise and Rayleigh fading channels. To exploit the source Markovian redundancy, the first constituent turbo decoder is designed according to a modified version of Berrou's original decoding algorithm that employs the Gaussian assumption for the extrinsic information. Due to interleaving, the second constituent decoder is unable to adopt the same decoding method; so its extrinsic information is appropriately adjusted via a weighted correction term. The turbo encoder is also optimized according to the Markovian source statistics and by allowing different or asymmetric constituent encoders. Simulation results demonstrate substantial gains over the original (unoptimized) Turbo codes, hence significantly reducing the performance gap to the Shannon limit. Finally, we show that our JSC coding system considerably outperforms tandem coding schemes for bit error rates smaller than 10/sup -4/, while enjoying a lower system complexity.     

结合残留冗余信息与MMSE估计的信源信道联合编解码

文中提出一种利用残留冗余的RDPCM信源信道联合编码系统与最小均方误差估计结合的方法.首先,本文针对联合编码系统修正了SOVA算法,在接收端获得利用残留冗余后的比特似然度;然后利用这些后验信息,对信源预测编码器的输出符号值进行最小均方误差重建后再进行信源译码,从而减小了由于硬判决得到符号值所带来的失真.仿真结果显示这种算法在信噪比的低端最大得到了约2dB的增益.