Concatenated multilevel block coded modulation

Encoding and decoding schemes for concatenated multilevel block codes are presented. By one of these structures, a real coding gain of 5.6-7.4 dB for the bit error range of 10^-6 to 10^-9 is achieved for transmission through the additive white Gaussian noise channel. Also, a rather large asymptotic coding gain is obtained. The new coding schemes have very low decoding complexity and increased coding gain in comparison with the conventional block and trellis coded modulation structures. A few design rules for concatenated (single and) multilevel block codes with large coding gain are also provided     

Graph-based iterative decoding algorithms for parity-concatenatedtrellis codes

We construct parity-concatenated trellis codes in which a trellis code is used as the inner code and a simple parity-check code is used as the outer code. From the Tanner-Wiberg-Loeliger (1981, 1996) graph representation, several iterative decoding algorithms can be derived. However, since the graph of the parity-concatenated code contains many short cycles, the conventional min-sum and sum-product algorithms cannot achieve near-optimal decoding. After some simple modifications, we obtain near-optimal iterative decoders. The modifications include either (a) introducing a normalization operation in the min-sum and sum-product algorithms or (b) cutting the short cycles which arise in the iterative Viterbi algorithm (IVA). After modification, all three algorithms can achieve near-optimal performance, but the IVA has the least average complexity. We also show that asymptotically maximum-likelihood (ML) decoding and a posteriori probability (APP) decoding can be achieved using iterative decoders with only two iterations. Unfortunately, this asymptotic behavior is only exhibited when the bit-energy-to-noise ratio is above the cutoff rate. Simulation results show that with trellis shaping, iterative decoding can perform within 1.2 dB of the Shannon limit at a bit error rate (BER) of 4×10^-5 for a block size of 20000 symbols. For a block size of 200 symbols, iterative decoding can perform within 2.1 dB of the Shannon limit     

Iterative Viterbi decoding, trellis shaping, and multilevelstructure for high-rate parity-concatenated TCM

We define and apply a new algorithm called the iterative Viterbi decoding algorithm (IVA) to decode a high-rate parity-concatenated TCM system in which a trellis code is used as the inner code and a simple parity-check code is used as the outer code. With trellis shaping, the IVA can achieve a performance 1.25 dB away from the Shannon limit at a BER of 3×10^-5 with low complexity. By augmenting the system with a binary BCH code, the error floor can be reduced to 10^-9 with very little additional cost     

Iterative decoding for partial response (PR), equalized,magneto-optical (MO) data storage channels

Turbo codes and low-density parity check (LDPC) codes with iterative decoding have received significant research attention because of their remarkable near-capacity performance for additive white Gaussian noise (AWGN) channels. Previously, turbo code and LDPC code variants are being investigated as potential candidates for high-density magnetic recording channels suffering from low signal-to-noise ratios (SNR). We address the application of turbo codes and LDPC codes to magneto-optical (MO) recording channels. Our results focus on a variety of practical MO storage channel aspects, including storage density, partial response targets, the type of precoder used, and mark edge jitter. Instead of focusing just on bit error rates (BER), we also study the block error statistics. Our results for MO storage channels indicate that turbo codes of rate 16/17 can achieve coding gains of 3-5 dB over partial response maximum likelihood (PRML) methods for a 10^-4 target BER. Simulations also show that the performance of LDPC codes for MO channels is comparable to that of turbo codes, while requiring less computational complexity. Both LDPC codes and turbo codes with iterative decoding are seen to be robust to mark edge jitter     

Bidirectional breadth-first algorithms for the decoding ofconvolutional codes

Bidirectional multiple-path tree searching algorithms for the decoding of convolutional codes are presented. These suboptimal coding algorithms use a multiple-path breadth-first bidirectional tree exploration procedure and long-memory convolution codes. It is shown that, compared to the usual M-algorithm, the bidirectional exploration considerably reduces the bit error propagation due to correct path loss. Computer simulations using rate-1/2 codes over binary symmetric channels are used to analyze the effect of the number of path extensions, code memory, and frame length on the bit error probability. The results show that with a bit error probability of 10^-5, coding gains on the order of 2 dB over the M-algorithm and 1 dB over a Viterbi decoder of equivalent complexity can be achieved     

Source-channel optimized trellis codes for bitonal imagetransmission over AWGN channels

We consider the design of trellis codes for transmission of binary images over additive white Gaussian noise (AWGN) channels. We first model the image as a binary asymmetric Markov source (BAMS) and then design source-channel optimized (SCO) trellis codes for the BAMS and AWGN channel. The SCO codes are shown to be superior to Ungerboeck's codes by approximately 1.1 dB (64-state code, 10^-5 bit error probability), We also show that a simple “mapping conversion” method can be used to improve the performance of Ungerboeck's codes by approximately 0.4 dB (also 64-state code and 10 ^-5 bit error probability). We compare the proposed SCO system with a traditional tandem system consisting of a Huffman code, a convolutional code, an interleaver, and an Ungerboeck trellis code. The SCO system significantly outperforms the tandem system. Finally, using a facsimile image, we compare the image quality of an SCO code, an Ungerboeck code, and the tandem code, The SCO code yields the best reconstructed image quality at 4-5 dB channel SNR     

Performance of interleaved trellis-coded differential 8-PSKmodulation over fading channels

The performance of trellis-coded differential octal phase-shift keying (coded 8-DPSK) with differentially coherent detection and soft-decision Viterbi decoding is investigated. A suitable receiver is presented whose signal processing is based on Nyquist signaling, requiring only one complex sample per modulation interval. Symbol synchronization and automatic frequency control are performed in a decision-directed way. Bit-error-rate (BER) performance over Gaussian, Rayleigh, and Rician channels is determined by means of computer simulations. The performance of coded 8-DPSK on the Gaussian channel is shown for a four-state convolutional trellis code. The unquantized outputs of up to three symbol detectors with delays of 1, 2, and 3 symbol periods are used for metric computation. The coding gain which includes losses due to timing and frequency synchronization errors is found to be 2.5 dB at BER=10^-5 with respect to uncoded 4-DPSK. Much larger gains are achieved for fading channels if interleaving is applied. Using an eight-state trellis code the performance is determined on Rayleigh and Rician channels for various Doppler spreads and interleaver sizes     

On the frame-error rate of concatenated turbo codes

Turbo codes with long frame lengths are usually constructed using a randomly chosen interleaver. Statistically, this guarantees excellent bit-error rate (BER) performance but also generates a certain number of low weight codewords, resulting in the appearance of an error floor in the BER curve. Several methods, including using an outer code, have been proposed to improve the error floor region of the BER curve. We study the effect of an outer BCH code on the frame-error rate (FER) of turbo codes. We show that additional coding gain is possible not only in the error floor region but also in the waterfall region. Also, the outer code improves the iterative APP decoder by providing a stopping criterion and alleviating convergence problems. With this method, we obtain codes whose performance is within 0.6 dB of the sphere packing bound at an FER of 10^-6     

Multistage decoding of multilevel block M-PSK modulationcodes and its performance analysis

Multistage decoding of multilevel block multilevel phase-shift keying (M-PSK) modulation codes for the additive white Gaussian noise (AWGN) channel is investigated. Several types of multistage decoding, including a suboptimum soft-decision decoding scheme, are devised and analyzed. Upper bounds on the probability of an incorrect decoding of a code are derived for the proposed multistage decoding schemes. Error probabilities of some specific multilevel block 8-PSK modulation codes are evaluated and simulated. The computation and simulation results for these codes show that with multistage decoding, significant coding gains can be achieved with large reduction in decoding complexity. In one example, it is shown that the difference in performance between the proposed suboptimum multistage soft-decision decoding and the single-stage optimum decoding is small, only a fraction of a dB loss in SNR at the block error probability of 10^-6     

Self-Orthogonal Convolutional Coding for the DPCM-AQB Speech Encoder

A fixed-tap differential pulse code modulation (DPCM) system with a robust backward-adaptive Jayant quantizer is investigated for speech encoding at 16-40 kbits/s using binary phase shift keying over an additive white Gaussian noise channel. The performance of this system becomes unacceptable as the channel bit error rate(P_{b})approaches 10^-2. Using high-rate, long constraint length, self-orthogonal convolutional codes, the DPCM system performance is much-improved for10^{-4} < P_{b} < 10^{-2}depending on the transmitted data rate. The use of high-rate(n - 1)/n, n = 2,3,4,, and 5 codes minimizes the number of bits allocated to channel coding, and decoding complexity is reduced by employing self-orthogonal codes which admit threshold decoding. Subjectively, while there is additional quantization noise with channel coding, the irritating popping and squeaking sounds due to channel errors are eliminated.     

Zigzag codes and concatenated zigzag codes

This paper introduces a family of error-correcting codes called zigzag codes. A zigzag code is described by a highly structured zigzag graph. Due to the structural properties of the graph, very low-complexity soft-in/soft-out decoding rules can be implemented. We present a decoding rule, based on the Max-Log-APP (MLA) formulation, which requires a total of only 20 addition-equivalent operations per information bit, per iteration. Simulation of a rate-1/2 concatenated zigzag code with four constituent encoders with interleaver length 65 536, yields a bit error rate (BER) of 10^-5 at 0.9 dB and 1.3 dB away from the Shannon limit by optimal (APP) and low-cost suboptimal (MLA) decoders, respectively. A union bound analysis of the bit error probability of the zigzag code is presented. It is shown that the union bounds for these codes can be generated very efficiently. It is also illustrated that, for a fixed interleaver size, the concatenated code has increased code potential as the number of constituent encoders increases. Finally, the analysis shows that zigzag codes with four or more constituent encoders have lower error floors than comparable turbo codes with two constituent encoders     

On multilevel codes and iterative multistage decoding

This paper develops an approach to iterative multistage decoding of multilevel codes. This involves passing reliability information to previous and subsequent decoders instead of only hard decisions to subsequent decoders. The paper also develops an adaptive version of the suboptimal soft output decoding algorithm of Picart and Pyndiah (1996). This adaptive algorithm provides a gain of approximately 0.24 dB at a bit error rate (BER) of 10^-5 after four iterations and approximately 0.43 dB after ten iterations over the algorithm of Picart et al. If the adaptive algorithm is used in conjunction with iterative multistage decoding then a gain of approximately 0.62 dB is obtained at a BER of 10^-5 after four iterations and approximately 0.9 dB after ten iterations over the algorithm of Picart et al     

On the design of low-density parity-check codes within 0.0045 dB ofthe Shannon limit

We develop improved algorithms to construct good low-density parity-check codes that approach the Shannon limit very closely. For rate 1/2, the best code found has a threshold within 0.0045 dB of the Shannon limit of the binary-input additive white Gaussian noise channel. Simulation results with a somewhat simpler code show that we can achieve within 0.04 dB of the Shannon limit at a bit error rate of 10^-6 using a block length of 10⁷     

Iterative decoding of binary block and convolutional codes

Iterative decoding of two-dimensional systematic convolutional codes has been termed “turbo” (de)coding. Using log-likelihood algebra, we show that any decoder can be used which accepts soft inputs-including a priori values-and delivers soft outputs that can be split into three terms: the soft channel and a priori inputs, and the extrinsic value. The extrinsic value is used as an a priori value for the next iteration. Decoding algorithms in the log-likelihood domain are given not only for convolutional codes but also for any linear binary systematic block code. The iteration is controlled by a stop criterion derived from cross entropy, which results in a minimal number of iterations. Optimal and suboptimal decoders with reduced complexity are presented. Simulation results show that very simple component codes are sufficient, block codes are appropriate for high rates and convolutional codes for lower rates less than 2/3. Any combination of block and convolutional component codes is possible. Several interleaving techniques are described. At a bit error rate (BER) of 10^-4 the performance is slightly above or around the bounds given by the cutoff rate for reasonably simple block/convolutional component codes, interleaver sizes less than 1000 and for three to six iterations     

Multistage recursive interleaver for turbo codes in DS-CDMA mobileradio

A multistage recursive block interleaver (MIL) is proposed for the turbo code internal interleaver. Unlike conventional block interleavers, the MIL repeats permutations of rows and columns in a recursive manner until reaching the final interleaving length. The bit error rate (BER) and frame error rate (FER) performance with turbo coding and MIL under frequency-selective Rayleigh fading are evaluated by computer simulation for direct-sequence code-division multiple-access mobile radio. The performance of rate-1/3 turbo codes with MIL is compared with pseudorandom and S-random interleavers assuming a spreading chip rate of 4.096 Mcps and an information bit rate of 32 kbps. When the interleaving length is 3068 bits, turbo coding with MIL outperforms the pseudorandom interleaver by 0.4 dB at an average BER of 10^-6 on a fading channel using the ITU-R defined Vehicular-B power-delay profile with the maximum Doppler frequency of f_D = 80 Hz. The results also show that turbo coding with MIL provides superior performance to convolutional and Reed-Solomon concatenated coding; the gain over concatenated coding is as much as 0.6 dB     

Hamming Coding of DCT-Compressed Images Over Noisy Channels

Theoretical and simulation results of using Hamming codes with the two-dimensional discrete cosine transform (2D-DCT) at a transmitted data rate of 1 bit/pixel over a binary symmetric channel (BSC) are presented. The design bit error rate (BER) of interest is 10^-2. The (7, 4), (15, 11), and (31, 26) Hamming codes are used to protect the most important bits in each 16 by 16 transformed block, where the most important bits are determined by calculating the mean squared reconstruction error (MSE) contributed by a channel error in each individual bit. A theoretical expression is given which allows the number of protected bits to achieve minimum MSE for each code rate to be computed. By comparing these minima, the best code and bit allocation can be found. Objective and subjective performance results indicate that using the (7, 4) Hamming code to protect the most important 2D-DCT coefficients can substantially improve reconstructed image quality at a BER of 10^-2. Furthermore, the allocation of 33 out of the 256 bits per block to channel coding does not noticeably degrade reconstructed image quality in the absence of channel errors.     

Approaching Shannon's capacity limit by 0.2 dB using simple Hammingcodes

The authors show that the Shannon capacity limit for the additive white Gaussian noise (AWGN) channel can be approached within 0.27 dB at a bit error rate (BER) of 10^-5 by applying long but simple Hamming codes as component codes to an iterative turbo-decoding scheme. In general, the complexity of soft-in/soft-out decoding of binary block codes is rather high. However, the application of a neurocomputer in combination with a parallelization of the decoding rule facilitates an implementation of the decoding algorithm in the logarithmic domain which requires only matrix additions and multiplications. But the storage requirement might still be quite high depending on the interleavers used     

Performance of phase-invariant trellis coding for differentially-encoded coherent M-PSK signals on Rayleigh fading channels

Rate(n-1)/n phase-invariant trellis coding with unquantised maximum-likelihood Viterbi decoding for differentially-encoded coherent M-ary (M-2/sup n/) PSK signals on Rayleigh fading channels is considered. The simulated bit error probability performance of the trellis-coded modulation is presented for four- and eight-state linear and nonlinear codes for constraint lengths 3 and 4, respectively, with coding gains of at least 2.5 dB at a bit error rate of 10/sup -3/.<>     

Optical Communication Using Subcarrier PSK Intensity Modulation Through Atmospheric Turbulence Channels

This paper studies optical communications using subcarrier phase shift keying (PSK) intensity modulation through atmospheric turbulence channels. The bit error rate (BER) is derived for optical communication systems employing either on/off key (OOK) or subcarrier PSK intensity modulation. It is shown that at BER = 10^-6 and a scintillation level of sigma = 0.1, an optical communication system employing subcarrier BPSK is 3 dB better than a comparable system using fixed-threshold OOK. When sigma = 0.2, an optical communication system employing subcarrier BPSK achieves a BER = 10^-6 at SNR = 13.7 dB, while the BER of a comparable system employing OOK can never be less than 10^-4. Convolutional codes are discussed for optical communication through atmospheric turbulence channels. Interleaving is employed to overcome memory effect in atmospheric turbulence channels. An upper bound on BER is derived for optical communication systems employing convolutional codes and subcarrier BPSK modulation.     

一种基于位反转置换的系统极化码的缩短方法

极化码作为 3GPP 标准制定中的一种信道编码技术方案,具有良好的纠错性能。为了进一步提高删余极化码的误码率性能,将极化码中基于位反转置换的缩短算法应用到系统极化码,提出一种系统极化码的缩短方法。仿真结果表明,在AWGN信道中,在高码率条件下,建议的系统极化码的缩短方法的误码率性能优于系统极化码的准均匀凿孔方法,也优于极化码的缩短方法。当码率为3/4、误码率为10^-4时,系统极化码的缩短方法比极化码的缩短方法约有0.5 dB的增益,比系统极化码的准均匀凿孔方法约有0.25 dB的增益。