H.264中DCT/IDCT/Hadamard变换多时钟方式的FPGA实现

DCT/IDCT/Hadamard变换被广泛应用于多种视频编码标准中,而H.264/MPEG-4AVC作为新一代的视频压缩标准,它具有在相同图像质量下比其他视频压缩标准拥有更高的压缩率的特性[1],因此对于H.264/MPEG-4AVC中的DCT/IDCT/Hadamard变换的研究就有着十分重要的意义。对于H.264/MPEG-4AVC中变换算法进行分析,并且提出一种可用的高效的硬件实现电路结构,此电路结构能够并行计算4输入像素数据。     

Object-based stereo video compression using fractals and shape-adaptive DCT

Based on the classical fractal video compression method, an improved object-based stereo video compression scheme with Shape-Adaptive DCT is proposed in this paper. Firstly, we use more effective macroblock partition scheme instead of classical quadtree partition scheme; thus reducing the block searching strategy. The stereo fractal video coding is proposed which matches the macroblock with two reference frames in left and right view results in increasing compression ratio and reducing bit rate when transmitting compressed stereo data. The stereo codec combines the Motion Compensation Prediction (MCP) and Disparity Compensation Prediction (DCP). Fractal coding is adopted and each object is encoded independently by a prior video segmentation alpha plane, which is defined exactly as in MPEG-4. The testing results with the nature monocular and stereo video sequences provide promising performances at low bit rate coding. We believe it will be a powerful and efficient technique for the object-based monocular and stereo video sequences coding.     

On the adaptive three-dimensional transform coding techniques for moving images

In this paper, an adaptive three-dimensional transform coding technique based on the 3-D discrete cosine transform (DCT) for removing the temporal correlation is proposed. Because of the nonstationary nature of the image data, the energy distribution in a 3-D DCT block varies along the vertical, horizontal and temporal directions. Thus, adaptive schemes, such as the 3-D classification, the classified linear scanning technique and the VLC table selection scheme, are used to take local variations into account. Also, in our approach, a hybrid technique, which adaptively combines relatively simple inter-frame coding with intra-frame coding, is presented. Through intensive computer simulations, the performance of the proposed 3-D transform coding technique is evaluated on several well-known moving sequences. The results show that, especially for moving sequences containing slow or moderate motion, the proposed technique provides an improved performance over the scheme with motion compensation (CCITT, 1989) at rates above 0.5 b/pixel (bpp), and a good visual quality of the reconstructed images is also obtained. Thus, the proposed 3-D transform coding technique is believed to be a good candidate for the digital VCR, since motion compensation is not required in the proposed 3-D coding technique.     

Layered coding for ATM based video distribution systems

This paper discusses packet loss and its protection in an asynchronous transfer mode (ATM) based video distribution system. Packet losses in ATM based networks have such a great impact on the design of coding algorithms and network architectures that they should be exhaustively discussed and resolved. In this paper, first basic configuration of the ATM based video transmission system and its packet-loss protection schemes are discussed. The DCT based layered coding scheme with packet priority classification is proposed as an effective packet-loss protection scheme. Burstiness characteristics of the broadcast video sources are evaluated and modeled to clarify statistical multiplexing performance and packet-loss properties. The quality degradation caused by the packet losses is also evaluated by the SNR, and the superior performance of the proposed layered coding scheme is verified.     

面向对象视频编码模型

目前 ,面向对象的视频编码已成为研究热点。MPEG - 4,MPEG - 7等标准的提出促进了面向对象编码技术的发展 ,同时也使得基于内容的视频检索的应用成为可能。对面向对象的视频编码技术进行深入探讨。在面向对象的视频编码标准中 ,视频序列中的图像被表示为视频对象的集合 ,这样不仅可以提高编码效率 ,同时可以支持面向对象编码和实现基于内容的应用 ,还能帮助提取语义视频对象     

基于DCT和小波的图像和视频编码性能的比较研究

在比较编码性能时,许多人分析了图像和视频编码的离散余弦变换(DCT)和小波变换性能差别,普遍认为图像的小波编码在压缩比和编码质量方面优于传统的DCT变换编码.说明了研究图像和视频压缩算法应当从全面的系统观点来考虑,即把重点放在各要素之间的量化、熵编码和编码系统中的复杂的相互影响的研究上.     

A DCT/DST-based error propagation-free data hiding algorithm for HEVC intra-coded frames

Currently, two error propagation-free discrete cosine transform (DCT)-based data hiding algorithms, one by Ma et al. and the other by Lin et al., were presented for H.264/AVC intra-coded frames. However, the state-of-the-art video codec, high efficiency video coding (HEVC), adopts both integer DCT and discrete sine transform (DST) such that the previous DCT-based algorithms cannot fully utilize available capacity for data hiding in HEVC. This paper presents the first DCT/DST-based data hiding algorithm for HEVC intra-coded frames where the block DCT and DST coefficient characteristics are investigated to locate the transformed coefficients that can be perturbed without propagating errors to neighboring blocks. Experimental results confirm the merits of the proposed algorithm in providing the intra-frame error propagation-free advantage, the quality improvement for marked images, the compression power inherited from HEVC, and the superiority of embedding capacity for low bitrate coding when compared with the previous two algorithms for H.264/AVC.     

Convex Optimization-Based Bit Allocation for Video Coding

This paper presents a new convex optimization-based bit allocation framework for video coding. Motivated by the statistical analysis of the relationship between the rate and the corresponding distortion in typical video sequences, an improved empirical rate-distortion model with more flexibility in explaining the experimental observations is proposed. The convexity and monotonicity properties of the proposed model allow us to formulate the bit allocation problem as a convex programming problem, which can be solved using interior-point methods. Coupled with the region of interest (ROI) functionality and the technique of MB classification, the proposed bit allocation scheme is then applied to the problem of frame-level bit allocation for various video coding standards employing motion compensated hybrid DCT/DPCM technique. Similar bit allocation scheme is also developed for MPEG-4 video object coding at the object level. The relevant model parameters are determined using previously encoded data by means of linear regression. Simulation results show that the proposed algorithms can achieve considerably better PSNR performance than the conventional approaches for the tested video sequences, at the expenses of slight increase in coding complexity.     

Fast motion vector re-estimation for transcoding MPEG-1 into MPEG-4 with lower spatial resolution in DCT-domain

In this paper, we propose a fast motion vector re-estimation for transcoding MPEG-1 to MPEG-4 with lower spatial resolution. This task can be performed in the pixel-domain or in the discrete cosine transform (DCT) domain. In this paper, we concentrate on the DCT-domain approach, which requires lower delay and complexity than those in the pixel-domain. For the DCT-domain transcoding to lower spatial resolution pictures, DCT-domain down-sampling filter is applied and a base motion vector (BMV) for the down-sampled MPEG-4 macroblock is to be calculated from the input motion vectors operating on the higher spatial resolution image. Quality can be significantly improved by refining the BMV. Starting with the BMV, the motion vector refinement (MVR) scheme searches for a delta motion vector within a significantly reduced search area. We propose a fast MVR scheme for video down-sampling in the DCT-domain based on minimizing the number of required check points, and a computationally efficient method for extracting motion compensated DCT block. We also show an efficient scheme for selecting a coding mode for a macroblock in the lower resolution video from those of the corresponding higher resolution video.     

基于粗粒度可重构阵列结构的多标准离散余弦变换设计

在视频信号的编解码流程中,离散余弦变换(DCT)是一个至关重要的环节,其决定了视频压缩的质量和效率。针对88尺寸的2维离散余弦变换,该文提出一种基于粗粒度可重构阵列结构(Coarse-Grained Reconfigurable Array, CGRA)的硬件电路结构。利用粗粒度可重构阵列的可重配置的特性,实现在单一平台支持多个视频压缩编码标准的88 2维离散余弦变换。实验结果显示,这种结构每个时钟周期可以并行处理8个像素,吞吐率最高可达1.157109像素/s。与已有结构相比,设计效率和功耗效率最高可分别提升4.33倍和12.3倍,并能够以最高30帧/s的帧率解码尺寸为40962048,格式为4:2:0的视频序列。     

一种自适应的帧/场DCT变换在MPEG-2中的应用

结合MPEG-2标准语法详细分析了一种自适应选择帧/场DCT变换的算法，产生了一个符合MPEG-2语义的视频流。     

一种简便快速的DCT算法及其硬件实现

传统的DCT算法是直接采用DCT的定义进行变换,由于大量采用浮点运算,运算量大且精度差。针对DCT运算的复杂性,介绍了一种离散余弦变换(DCT)的快速算法,他采用基于尺度提升结构的矩阵分解法,将原先复杂的浮点运算转变为精度更高的整数运算,同时又将复杂的乘法计算分解为简单的移位和加法计算。因此在近乎无损地表示信息的同时,大幅度的降低了运算量。该方法非常适合于应用在实时性要求严格的场合,如视频压缩和目标跟踪,以及硬件的实时实现。最后用Verilog HDL语言给出了采用此算法的DCT核心计算模块的程序。     

一种基于残差系数的快速编码算法

当前视频编码标准有着较高的编码效率,然而也较多地提高了编码复杂度,因此提高编码速度具有很重要的意义。根据残差系数的分布特征,该文提出了一种基于残差的快速编码算法。该算法首先根据Inter1616或者Inter88编码得到的残差系数进行假设检验,根据假设检验的结果来预测可能的编码模式集合;然后根据DCT系数的分布特征分别计算出全零块,11子块,22子块和33子块的判决条件,从而避免44子块中全部或者部分系数的DCT,Q,IQ,IDCT运算。实验证明,该文算法的编码速度要显著快于其它算法,同时编码效率的损失也很小。     

基于多线性子空间KL变换的可伸缩视频压缩方法

该文提出一种基于多线性子空间KL(Karhunen-Loeve)变换的可伸缩视频压缩算法。该算法将纹理不同的图像子块投影到多个线性子空间中去,然后分别进行KL变换编码,使得每个子空间内变换系数更接近高斯分布,从而最大限度地在变换编码阶段提高压缩效率。同时,该算法结合多尺度小波分解,实现了质量可伸缩的视频编码,提高了视频压缩率。通过与DCT、小波变换以及多向DCT算法进行比较,证明该算法可获得更好的率失真性能。     

Motion-compensated DCT temporal filters for efficient spatio-temporal scalable video coding

Although most of the proposals for implementing motion-compensated temporal filtering (MCTF) schemes are based on the wavelet transform, in this paper, we propose an MCTF framework based on the discrete cosine transform (DCT). Using DCT decimation and interpolation, several temporal decomposition structures named motion-compensated DCT temporal filters (MCDCT-TF) are introduced. These structures are able to employ filters of any length with particular emphasis on 5/3 DCT and 7/4 DCT. The proposed MCDCT-TF and the two-dimensional (2D) DCT decimation technique are incorporated into H.264/AVC to provide spatio-temporal scalability. Compared with the current MCTF-based lifting schemes such as Haar, and 5/3 wavelet filters, simulation results show that the proposed MCDCT-TF utilizing longer tap DCT filters achieves a significant improvement in coding gain. The impact of odd/even group of frames, the decimation/interpolation ratios, and motion-compensated connectivity on the MCDCT-TF performance are also analyzed. Moreover, simulation results show that the performance of the presented scalable video coding is close to the single layer H.264/AVC and is slightly inferior to the temporal scalability supported in JSVM, the state-of-the-art scalable video coding standard, that gets its gain from Hierarchical B-pictures. However, our spatio-temporal coding scheme outperforms the spatio-temporal supported in JSVM even if it uses hierarchical B-pictures to improve its gain.     

A compressed domain scheme for classifying block edge patterns.

Detecting and classifying edge components in images find a wide range of applications from perceptually improved coding schemes to content-based searches. In this paper, a fast and systematic scheme is proposed to classify the edge orientation of each block in discrete cosine transform (DCT)-compressed images. Derived from a simple, but acceptable, pixel-domain algorithm, the proposed scheme performs directly on DCT coefficient domain and, thus, saves the arithmetic operations by a considerable amount. The performance of the proposed method is validated by the experiments against various natural images.     

基于DCT变换的内嵌静止图像压缩算法

提出了一种有效的基于离散余弦变换(DCT)的内嵌子带图像编码算法.Xiong等人提出的EZDCT算法采用零树结构实现了一种内嵌DCT编码器,且其性能优于JPEG.本文指出DCT的零树结构在内嵌DCT算法中并非很有效,同时提出了一种不依赖零树结构的简便、高效的内嵌DCT子带编码算法.实验结果表明本文算的压缩性能(PSNR)比EZDCT高约0.5~1.5dB,且接近当前最通用的内嵌小波SPIHT算法,在对某些图像压缩时还优于SPIHT算法.     

基于H.26L的精细度可伸缩视频编码

提出了一种基于H．26L精细度可伸缩(fine granularity scalability)视频编码方案，称为EFGS-H．26L。在该方案中，以MPEG-4的FGS为基础构造了一种新的可伸缩结构(EFGS，enhanced fine granularity scalability)，在EFGS结构中，基本层采用H．26L编码，增强层采用类似于JPEG2000的基于上下文的位平面编码。由于H．26L优良的编码性能，使得基本层的编码效率大大提高，为了提高增强层的编码效率，首先把残余图像按子带的顺序重新排列，这样就可以利用子带系数的相关性来实现冗余信息消除。JPEG2000标准中的EBCOT算法已经被证明是非常高效的位平面编码方法，所以对重排后的DCT系数采用一种类似于JPEG2000的基于上下文的位平面编码方法。实验结果证明，在高比特率时，本文提出的精细度可伸缩编码方案编码效率比MPEG-4中的FGS提高3．0dB左右。     

A unified rate-distortion analysis framework for transform coding: a summary

In our previous work, we have developed a rate-distortion (R-D) modeling framework H.263 video coding by introducing the new concepts of characteristic rate curves and rate curve decomposition. In this paper, we further show it is a unified R-D analysis framework for all typical image/video transform coding systems, such as EZW, SPIHT and JPEG image coding; MPEG-2, H.263, and MPEG-4 video coding. Based on this framework, a unified R-D estimation and control algorithm is proposed for all typical transform coding systems. We have also provided a theoretical justification for the unique properties of the characteristic rate curves. A linear rate regulation scheme is designed to further improve the estimation accuracy and robustness, as well as to reduce the computational complexity of the R-D estimation algorithm. Our extensive experimental results show that with the proposed algorithm, we can accurately estimate the R-D functions and robustly control the output bit rate or picture quality of the image/video encoder.     

Adaptive Block-size Transform based Just-Noticeable Difference model for images/videos

In this paper, we propose a novel Adaptive Block-size Transform (ABT) based Just-Noticeable Difference (JND) model for images/videos. Extension from 8×8 Discrete Cosine Transform (DCT) based JND model to 16×16 DCT based JND is firstly performed by considering both the spatial and temporal Human Visual System (HVS) properties. For still images or INTRA video frames, a new spatial selection strategy based on the Spatial Content Similarity (SCS) between a macroblock and its sub-blocks is proposed to determine the transform size to be employed to generate the JND map. For the INTER video frames, a temporal selection strategy based on the Motion Characteristic Similarity (MCS) between a macroblock and its sub-blocks is presented to decide the transform size for the JND. Compared with other JND models, our proposed scheme can tolerate more distortions while preserving better perceptual quality. In order to demonstrate the efficiency of the ABT-based JND in modeling the HVS properties, a simple visual quality metric is designed by considering the ABT-based JND masking properties. Evaluating on the image and video subjective databases, the proposed metric delivers a performance comparable to the state-of-the-art metrics. It confirms that the ABT-based JND consists well with the HVS. The proposed quality metric also is applied on ABT-based H.264/Advanced Video Coding (AVC) for the perceptual video coding. The experimental results demonstrate that the proposed method can deliver video sequences with higher visual quality at the same bit-rates.