音频信号的数字处理及其应用设计

提出了2.4G无线影音传输系统中的数字音频传输方案,介绍了AES/EBU数字音频接口标准,并详细阐述了系统的关键技术,包括差错掩盖技术和天线切换技术。采用差错掩盖技术,可以消除“噼啪”声;而运用天线切换技术,提高了音频信号接收质量,有效地抑制干扰,提升了系统的性能。     

Huffman code based error screening and channel code optimization for error concealment in perceptual audio coding (PAC) algorithms

The class of perceptual audio coding (PAC) algorithms yields efficient and high-quality stereo digital audio bitstreams at bit rates from 16 kb/sec to 128 kb/sec (and higher). To avoid "pops and clicks" in the decoded audio signals, channel error detection combined with source error concealment, or source error mitigation, techniques are preferred to pure channel error correction. One method of channel error detection is to use a high-rate block code, for example, a cyclic redundancy check (CRC) code. Several joint source-channel coding issues arise in this framework because PAC contains a fixed-to-variable source coding component in the form of Huffman codes, so that the output audio packets are of varying length. We explore two such issues. First, we develop methods for screening for undetected channel errors in the audio decoder by looking for inconsistencies between the number of bits decoded by the Huffman decoder and the number of bits in the packet as specified by control information in the bitstream. We evaluate this scheme by means of simulations of Bernoulli sources and real audio data encoded by PAC. Considerable reduction in undetected errors is obtained. Second, we consider several configurations for the channel error detection codes, in particular CRC codes. The preferred set of formats employs variable-block length, variable-rate outer codes matched to the individual audio packets, with one or more codewords used per audio packet. To maintain a constant bit rate into the channel, PAC and CRC encoding must be performed jointly, e.g., by incorporating the CRC into the bit allocation loop in the audio coder.     

Passive Error Concealment for Wavelet-Coded I-Frames With an Inhomogeneous Gauss–Markov Random Field Model

In video communication over lossy packet networks (e.g., the Internet), packet loss errors can severely damage the transmitted video. The damaged video can largely be repaired with passive error concealment, where neighboring information is used to estimate missing information. We address the problem of passive error concealment for wavelet coded data with dispersive packetization. The reported techniques of this kind have many problems and usually fail in the reconstruction of high-frequency content. This paper presents a novel locally adaptive error concealment method for subband coded I-frames based on an inhomogeneous Gaussian Markov random field model. We estimate the parameters of this model from a local context of each lost coefficient, and we interpolate the lost coefficients accordingly. The results demonstrate a significant improvement over the reported related methods both in terms of objective performance measures and visually. The biggest improvement of the proposed method compared to the state-of-the-art in the field is the correct reconstruction of high-frequency information such as textures and edges.      

地面数字电视广播系统中的视频传输容错算法

本文提出了一套针对MPEG-2视频压缩数据传输的自适应容错机制,用于支持地面数字电视广播系统中的可靠电视传输.具体地,本文首先提出了一种基于时域隐藏和块匹配的差错隐藏算法,在保持较好隐藏效果的同时,通过有效地减小搜索窗口而显著降低了算法复杂度.同时,针对独立I帧图像还提出了独特的差错隐藏方法.将这两种差错隐藏算法与低运算复杂度的空域/时域运动检测方法相结合,又衍生出一种自适应空/时域结合差错隐藏算法.仿真结果表明,本文提出的算法即使在很高的数据差错率情况下,仍然可以实现地面数字电视广播系统中可靠而高效的视频传输.     

HDTV嵌入数字音频分析软件设计

详细介绍了基于SMPTE299标准规定的HD-SDI数据流格式及数字音频嵌入原理。编程实现了HDTV嵌入音频信号的解嵌,分析音频数据包和音频控制包的嵌入格式,并计算出音频幅值、采样频率、音频样值数和嵌入通道数。实验证明,采用该软件完全可以实现嵌入音频的分析。不同于基于硬件的解嵌系统,使用该软件价格低廉,具有广泛的实用价值。     

Packet video error concealment with Gaussian mixture models.

In this paper, Gaussian mixture modeling is applied to error concealment for block-based packet video. A Gaussian mixture model for video data is obtained offline and is thereafter utilized online in order to restore lost blocks from spatial and temporal surrounding information. We propose estimators on closed form for missing data in the case of varying available neighboring contexts. Our error concealment strategy increases peak signal-to-noise ratio compared to previously proposed schemes. Examples of improved subjective visual quality by means of the proposed method are also supplied.     

A survey of packet loss recovery techniques for streaming audio

We survey a number of packet loss recovery techniques for streaming audio applications operating using IP multicast. We begin with a discussion of the loss and delay characteristics of an IP multicast channel, and from this show the need for packet loss recovery. Recovery techniques may be divided into two classes: sender- and receiver-based. We compare and contrast several sender-based recovery schemes: forward error correction (both media-specific and media-independent), interleaving, and retransmission. In addition, a number of error concealment schemes are discussed. We conclude with a series of recommendations for repair schemes to be used based on application requirements and network conditions     

Joint encoding and decoding methods for digital audio broadcasting of multiple programs

We introduce new methods for increasing the performance of multiprogram digital audio broadcast systems, e.g., satellite digital audio broadcasting. Joint multiprogram encoding is an attractive possibility for parallel broadcasting of a large number of programs. Joint coding extended over multiple audio frames in time give further improvements. The benefits of this kind of statistical multiplexing yield improved audio quality and/or higher capacity in terms of number of programs. We describe the new Joint Multiple Program Encoding Technique in the context of the perceptual audio coding (PAC) type of algorithms. We also describe methods for multi-program transmission including Equal Error Protection (EEP) as well as Unequal Error Protection (UEP) and improved error concealment for multiple program transmission. Some of the techniques described in this paper, are currently being used in satellite digital audio broadcasting in the United States.     

Robust Digital Terrestrial TV Broadcasting System with Error-Resilient Schemes

In this paper, error-resilient schemes are proposed to support robust video transmission for digital terrestrial TV broadcasting (DTTB). In particular, a temporal error concealment incorporated with a low-complexity block-matching is developed, achieving an effective reception of predictive pictures in harsh terrestrial environment. Special algorithms are also designed for isolated I-pictures. Moreover, combined with an intra/inter case prediction, an adaptive error concealment scheme is further contrived to fit for different error conditions. Extensive simulations have been conducted under various DTTB channel conditions, even with a very high packet error rate, to verify the effectiveness of the proposed schemes.     

An integrated error correction and detection system for digitalaudio broadcasting

Hybrid in-band on-channel digital audio broadcasting systems deliver digital audio signals in such a way that is backward compatible with existing analog FM transmission. We present a channel error correction and detection system that is well-suited for use with audio source coders, such as the so-called perceptual audio coder (PAC), that have error concealment/mitigation capabilities. Such error mitigation is quite beneficial for high quality audio signals. The proposed system involves an outer cyclic redundancy check (CRC) code that is concatenated with an inner convolutional code. The outer CRC code is used for error detection, providing flags to trigger the error mitigation routines of the audio decoder. The inner convolutional code consists of so-called complementary punctured-pair convolutional codes, which are specifically tailored to combat the unique adjacent channel interference characteristics of the FM band. We introduce a novel decoding method based on the so-called list Viterbi algorithm (LVA). This LVA-based decoding method, which may be viewed as a type of joint or integrated error correction and detection, exploits the concatenated structure of the channel code to provide enhanced decoding performance relative to decoding methods based on the conventional Viterbi algorithm (VA). We also present results of informal listening tests and other simulations on the Gaussian channel. These results include the preferred length of the outer CRC code for 96-kb/s audio coding and demonstrate that LVA-based decoding can significantly reduce the error flag rate relative to conventional VA-based decoding, resulting in dramatically improved decoded audio quality. Finally, we propose a number of methods for screening undetected errors in the audio domain     

Efficient error localization and temporal concealment based on motion estimation of enlarged block

We propose a modified motion estimation algorithm that is adequate for error localization and temporal error concealment in transmitting videos over unreliable channels. In order to achieve good error concealment performance, the proposed algorithm implicitly imposes spatial correlations on motion vectors by extending the block size and overlapping blocks in motion estimation. Thereby, the obtained motion vectors can be used to improve error concealment performance while keeping the encoding efficiency with negligible overhead. In addition, the proposed motion estimation can provide a new error detection measure so that we can maximally utilize uncorrupted data rather than simply discarding all data in a defected packet. Simulation results show that the proposed motion estimation scheme provides significant improvements in error concealment performance over the existing schemes and improves the bit utility over a wide range of error conditions.     

Design and Implementation of MIMO-OFDM Baseband Processor for High-Speed Wireless LANs

In this brief, we present the design and implementation results of a digital 120 Mb/s multiple-input multiple-output (MIMO) orthogonal frequency-division multiplexing (OFDM) wireless LAN (WLAN) baseband processor based on the proposed decoding algorithms. The processor has two MIMO-OFDM modes, space-frequency block coded OFDM and space division multiplexed OFDM. From those, it achieves a considerable performance gain as well as supports double data rates compared to the conventional IEEE 802.11a WLANs. In the results of performance evaluation, the processor requires a signal-to-noise ratio of 1.8-27 dB for transmission modes at 10% packet error rate, and the chip is implemented with 4.8 M transistors in 3.9 times 3.9 mm2 using 0.18-mum CMOS process.     

一种新的IP网络视频通信丢包错误纠正方案

分组丢失是IP交换网络常见的现象。该文针对下一代网络多媒体通信,提出了一套IP网络抗分组丢失的方案。包括纠删编码、打包和发送以及接收端错误掩盖。与常见的纠删编码相比,该文提出的[9,5,3]码具有构造简单,编解码时间短,纠删能力高的优点。打包和发送方案根据[9,5,3]码的纠删性能对视频数据打包,并以一定顺序发送,提高了纠删码抗突发错误的能力。采用新的视频编码方案H.264所提供的抗误码工具灵活的宏块次序(FMO),对纠删失效的视频数据在解码端进行错误掩盖。     

Image Error Concealment Using Watermarking with Subbands for Wireless Channels

Transmission of block-coded images through error-prone wireless channels often results in lost blocks. In this study, we investigate a novel error concealment method for covering up these high packet losses and reconstructing a close approximation. Our scheme is a modified discrete wavelet transform (DWT) technique (namely, subbands based image error concealment (SIEC)) for embedding downsized replicas of original image into itself. We propose that this technique can be implemented for wireless channels to combat degradations in a backward-compatible scheme. We show that the proposed error concealment technique is promising, especially for the erroneous channels causing a wider range of packet losses, at the expense of computational burden     

Content-Aware Resource Allocation and Packet Scheduling for Video Transmission over Wireless Networks

A cross-layer packet scheduling scheme that streams pre-encoded video over wireless downlink packet access networks to multiple users is presented. The scheme can be used with the emerging wireless standards such as HSDPA and IEEE 802.16. A gradient based scheduling scheme is used in which user data rates are dynamically adjusted based on channel quality as well as the gradients of a utility function. The user utilities are designed as a function of the distortion of the received video. This enables distortion-aware packet scheduling both within and across multiple users. The utility takes into account decoder error concealment, an important component in deciding the received quality of the video. We consider both simple and complex error concealment techniques. Simulation results show that the gradient based scheduling framework combined with the content-aware utility functions provides a viable method for downlink packet scheduling as it can significantly outperform current content-independent techniques. Further tests determine the sensitivity of the system to the initial video encoding schemes, as well as to non-real-time packet ordering techniques.     

An integrated temporal error concealment for H.264/AVC based on spatial evaluation criteria

Owing to error-prone transmission networks, the compressed video bit stream is prone to packet loss in the transmission channel. This loss causes serious distortion and the distortion will propagate to successive frames, especially in highly compressed video coding standard. Therefore, it is very important to efficiently enhance the restored result. In this paper, an integrated temporal error concealment technique for H.264/AVC is proposed. The technique could effectively restore the corrupted data by adaptively integrating error concealment approaches with the adaptive weight-based switching algorithm. The integrated mechanism is based on spatial evaluation criteria, judged by boundary distortion estimation and texture intensity. Experimental results show that the technique could effectively enhance the performance of error concealment.     

Optimization of packetization masks for image coding based on an objective cost function for desired packet spreading

In image communication over lossy packet networks (e.g., cell phone communication), packet loss errors lead to damaged images. Damaged images can be repaired with passive error concealment methods, which use neighboring coefficient or pixel values to estimate the missing ones. Neighboring image data should, thus, be spread over different packets. This paper presents a novel robust packetization method for the transmission of image content in lossy packet networks. We first define novel criteria for a good packetization. Based on these properties, we propose a cost function for packetization masks. We then use stochastic optimization to calculate optimal packetization masks. We test our packetization technique on both wavelet coding and DCT coding. Compared to other packetization techniques, we are able to achieve the same or better mean quality of the reconstructed images but with less fluctuation in quality, which is important for the viewer experience. In this way, we significantly increase the worst case quality, especially for high packet loss rates. This leads to visually more pleasing images in case of a passive reconstruction.     

Error concealment algorithms for robust decoding of MPEG compressed video

This paper provides some research results on the topic of error resilience for robust decoding of MPEG (Moving Picture Experts Group) compressed video. It introduces and characterizes the performance of a general class of error concealment algorithms. Such receiver-based error concealment techniques are essential for many practical video transmission scenarios such as terrestrial HDTV broadcasting, packet network based teleconferencing/multimedia, and digital SDTV/HDTV delivery via ATM (asynchronous transfer mode). Error concealment is intended to ameliorate the impact of channel impairments (i.e., bit-errors in noisy channels, or cell-loss in ATM networks) by utilizing available picture redundancy to provide a subjectively acceptable rendition of affected picture regions. The concealment process must be supported by an appropriate transport format which helps to identify image pixel regions which correspond to lost or damaged data. Once the image regions (i.e., macroblocks, slices, etc.) to be concealed are identified, a combination of spatial and temporal replacement techniques may be applied to fill in lost picture elements. A specific class of spatio-temporal error concealment algorithms for MPEG video is described and alternative realizations are compared via detailed end-to-end simulations for both one- or two-tier transmission media. Several algorithm enhancements based on directional interpolation, ‘I-picture motion vectors’, and use of MPEG-2 ‘scalability’ features are also presented. In each case, achievable performance improvements are estimated via simulation. Overall, these results demonstrate that the proposed class of error concealment algorithms provides significant robustness for MPEG video delivery in the presence of channel impairments, permitting useful operation at ATM cell-loss rates in the region of 10⁻⁴ to 10⁻³ and 10⁻² to 10⁻¹ for one- and two-tier transmission scenarios, respectively.     

A Single-Chip MPEG/Audio Decoder LSI Based on a Compact Decoding Algorithm

A single-chip decoder LSI is developed for ISO/IEC MPEG (the International Organisation for Standardisation/the International Electrotechnical Commission, Moving Pictures Expert Group) audio. The applicable layers are Layer I and II of MPEG-1 and MPEG-2/Lower-Sampling-Frequency Mode. A fast calculation algorithm, which is also effective for on-chip memory reduction, is incorporated in audio signal synthesis. The reliability in bitstream synchronization is improved by including bitstream inconsistency detection. Bitstream error concealment by repeating previous audio data is supported. The decoding delay is adjustable when an optional external memory is connected to the LSI.     

List Viterbi algorithms for continuous transmission

The conventional list Viterbi algorithm (LVA) produces a list of the L best output sequences over a certain block length in decoding a terminated convolutional code. We show in this paper that the LVA with a sufficiently long list is an optimum maximum-likelihood decoder for the concatenated pair of a convolutional code and a cyclic redundancy check (CRC) block code with error detection. The CRC is used to select the output. New LVAs for continuous transmission are proposed and evaluated, where no termination bits are required for the convolutional code for every CRC block. We also present optimum and suboptimum LVAs for tailbiting convolutional codes. Convolutional codes with Viterbi decoding were proposed for so-called hybrid in band on channel (hybrid IBOC) systems for digital audio broadcasting compatible with the frequency modulation band. For high-quality audio signals, it is beneficial to use error concealment/error mitigation techniques to avoid the worst type of channel errors. This requires a reliable error flag mechanism (error detection feature) in the channel decoder. A CRC on a block of audio information bits provides this mechanism. We demonstrate how the LVA can significantly reduce the flag rate compared to the regular Viterbi algorithm (VA) for the same transmission parameters. At the expense of complexity, a receiver optional LVA can reduce the flag rate by more than an order of magnitude. The difference in audio quality is dramatic. The LVA is backward compatible with a VA