针对MPEG的去块效应技术的研究及其VLSI实现

现今随着数据压缩的广泛应用,以及MPEG视频编解码的普遍使用,块效应噪声也随之而来。为了消除块效应、提高视频质量,许多去块效应的算法[2-12]被人们所提出,然而大部分算法的运算量都很大,不适合应用在视频处理芯片上。针对这个问题,H.-S. Kong等人[13]提出了一种新的自适应后处理算法,该算法既能有效消除块效应又大幅度地降低了运算量,然而对图像边缘信息保护不够。本文在H.-S. Kong等人[13]的算法的基础上,提出了一种针对MPEG视频流的去方块后处理方法。该方法以方块边缘（水平或垂直）附近各两个4×4区域作为滤波处理的分类依据,通过对该两个区域的像素点的值进行计算,将块边缘分为平滑渐变区域、亮度阶跃区域以及复杂纹理区域,并根据这三种区域对图像边缘信息影响程度的大小,而决定采取强滤波、弱滤波或者不滤波等处理方式。这种方法一方面较好地提取了块效应噪声,一方面又保护了图像的边缘信号,而且计算量较小,满足视频处理芯片低复杂度的去噪要求,通过VLSI实现后有着很好的应用前景。      

H.265解码器去块滤波并行化设计与性能优化

H.265继续沿用H.264编码架构,去方块滤波器也是H.265视频编码标准的一个重要选项,去除混合编码带来的块效应极大改善了视频的质量,但由于H.265超级宏块的存在,去方块效应滤波相关参数层层嵌入在每个小的处理单元中,这种结构不利于实现基于宏块行间的并行化,同时也很难高效地利用Cortex-A9架构SIMD优化性能.首先详细分析H.265标准去块滤波器的处理过程以及并行处理的困难,进而提出一种便于实现基于宏块行间的并行去块滤波结构,然后进行Cortex-A9汇编优化.基于HM14.0实验,改进去方块效应滤波器计算复杂度从占整个解码器25％降至14％,大大提升了解码器性能,为移动设备上实现H.265大分辨率视频实时播放奠定基础.     

一种基于人类视觉系统的去块效应算法

基于块离散余弦变换的图像和视频压缩主要缺点就是在低比特率时会在块边界出现明显的方块效应。本文提出一种充分利用人类视觉特性,在图像的平滑区和纹理区分别采用一维DCT域滤波和空间域滤波的去块效应算法。实验结果表明该算法既能有效地去除方块效应又能保护图像的边缘信息。     

H．264抗块效应滤波器

应用抗块效应滤波器的目的是为了减少块失真。抗块效应滤波器是在编码器和解码器的反变换之后应用的。滤波器有两种好处：（a）平滑块边缘，改善解码图像质量（特别是在较高的压缩比时）：（b）为了在编码器中对后面的帧进行运动补偿预测．使用滤波宏块．造成预测后产生一个较小的残差。操作过程是这样的对帧内编码宏块进行滤波．使用未滤波的重建宏块形成预测帧．进行帧内预测．但整幅图像边缘不被滤波。     

Tetrolet变换方块效应改善算法

针对Tetrolet 变换算法对图像去噪后存在方块效应的缺陷,文中对Tetrolet 变换算法进行了扩展和改进,并引入移位（Cycle Spinning）来有效消除Tetrolet 变换算法中的方块效应。仿真结果表明,所提出的算法不仅能有效去除噪声,而且可得到更高的峰值信噪比,提高了图像的主客观质量。去噪后图像保留了原始图像的边缘和细节等局部特征,较为平滑,且方块效应得到了一定的改善和抑制,因而该算法是有效可行的。     

H.264去块滤波算法及硬件实现

H.264是ITU-T/ISO在2003年公布的最新的国际视频压缩编码标准,它大大提高了编码效率和图像质量,其中一个重要原因是在编解码环路中引入了去块滤波器。介绍了H.264视频编码标准中的去块滤波算法,并提出了一种可实现的去块滤波器硬件结构。该结构通过合理利用本地SRAM资源,大大减少了总线带宽需求,提高了硬件处理速度。仿真结果显示,通过该去块滤波器进行环路滤波,很大程度地消除了方块效应,图像质量得到明显改善。     

基于模糊逻辑的指纹图像增强滤波

本文提出了一种新的基于模糊逻辑技术的指纹图像增强滤波器，通过模糊边缘判别器在对任一像素点属于边缘的程度进行模糊软判决的同时完成边缘检测，并针对指纹图像的平滑区域和边缘区域分别采用不同的模糊规则进行增强滤波。实验结果表明这种滤波器在图像的平滑区域具有好的滤波性能，对于边缘区域，则能够在保持边缘细节的同时滤除噪声。     

图像块效应评价标准

文章提出了一种不需要参考图像的基于人类视觉系统的块效应评价标准，首先分别计算了平滑区域和边缘上的块效应，然后利用人类视觉系统对平滑和边缘区域产生的视觉掩盖效应的不同，来调整两者之间的权值，最后把两者的加权和作为评价结果。     

静态图像自适应编码的一种实现方法

在静态图像的方块截断编码中由于受到每个子块中电平级数的限制,编码过程无法正确识别图像边缘的变化,在一些灰度变化比较剧烈的子块中很容易造成有用信息的丢失。为了解决以上问题,本文提出了一种自适应方块截断编码算法,仿真结果表明:本文的自适应算法对图像边缘的恢复有较大的改进,视觉质量有很大的提高。     

基于方向性小波子树分形图像编码的改进算法

本文在分析混合分形零树小波图像编码算法(FZW)优缺点的基础上，提出一种新的基于方向性小波子树的分形图像编码算法。该算法结合零树小波编码和分形编码，通过在匹配搜索过程中使用方向性range和domain子树，提高匹配精度，改善了传统分形小波图像压缩中的方块效应，更大限度的保留了图像的边缘信息。实验结果表明，该算法在提高压缩比和去除图像的方块效应方面，均取得了良好的效果。     

Removing the blocking artifacts of block-based DCT compressed images

One of the major drawbacks of the block-based DCT compression methods is that they may result in visible artifacts at block boundaries due to coarse quantization of the coefficients. We propose an adaptive approach which performs blockiness reduction in both the DCT and spatial domains to reduce the block-to-block discontinuities. For smooth regions, our method takes advantage of the fact that the original pixel levels in the same block provide continuity and we use this property and the correlation between the neighboring blocks to reduce the discontinuity of the pixels across the boundaries. For texture and edge regions, we apply an edge-preserving smoothing filter. Simulation results show that the proposed algorithm significantly reduces the blocking artifacts of still and video images as judged by both objective and subjective measures.     

Error concealment for SNR scalable video coding

This paper proposes an efficient error concealment method for SNR scalable coded video. The algorithm adaptively selects a proper concealment candidate from the base or the enhanced pictures to conceal the artifact of a lost enhancement block. To determine the best concealment candidate, we propose a trial process in which the concealment candidates are examined based on two criteria: (1) picture continuity at the border of concealed macroblocks, and (2) to satisfy the coding distortion bound of the base layer coefficients when they are available. For the latter, requantization of the concealed picture with the base layer quantizer step size and its dequantized pixels should result in zero distortion. We have implemented the method on a proposed SNR scalable H.264 video codec and compared the decoded video quality against just copying the base layer pixels into the enhanced picture. Simulation results show that the proposed method can achieve a considerable improvement by up to 3 dB especially in situations where the enhancement layer contains a large portion of the picture information. This will make scalable video transmission more successful over unreliable channels.     

Adaptive Pixel Interpolation for Spatial Error Concealment

Error concealment techniques are widely used as efficient ways to recover the lost information at the decoder. This paper proposes an adaptive pixel interpolation technique for spatial error concealment in the block based coding system. For a missing pixel in a corrupted block, its value is derived from four neighborhoods of the block through interpolation using multiple prediction strategy. The weighting rules of these four neighborhood blocks are carefully designed with regard to three factors, the distance to the missing pixels within the given corrupted block, the percentage of uncorrupted pixels, and the similarity to the given corrupted block. The proposed method works effectively in consecutive block loss situation, which is common in real applications of video transmission. Experimental results show the proposed technique gains more accurate recovery of the missing pixels than the existing schemes.     

基于块参考像素特征的快速帧内预测模式选择新算法

帧内预测是H.264采用的一种编码新技术。与以前的编码标准相比,H.264编码性能有了很大的提高,但同时编码复杂度和计算量也明显增加。该文研究了提高H.264编码速度的途径,着重分析了帧内预测模式快速选择的问题。经过分析发现,4×4亮度块的参考像素亮度值通常具有相似性,对应地,4×4亮度块的9种预测模式所得的预测结果也是相近的。根据4×4亮度块参考像素的这一特征,该文提出了一种基于4×4亮度块参考像素特征的快速帧内预测模式选择算法。实验结果说明了该文算法的有效性,与H.264编码器JM92相比,该算法的计算量减少了46%,而编码质量、PSNR和输出码率保持基本不变。     

图像的四叉树平面编码

该文提出了一种平面逼近图像编码方法及其四叉树实现方案。在最小二乘方准则下,对于给定的图像子块,找到一个最佳平面,并用其上的点逼近图像的像点。于是,只需要对该平面的三个描述参数进行编码,编码质量和图像子块的平坦程度和大小有关,因此,可按照对编码质量的要求,以四叉树结构选择可变大小的图像子块。     

Adaptive rate distortion optimisation for H.264 intra coding

Rate distortion optimisation (RDO), which is the best performing mode decision method for H.264, does not consider dependence between neighbouring blocks, because calculating rate distortion (RD) costs for all possible mode sets requires too many computations. However, in H.264 intra coding, RD performance of the current block is affected by reference pixels in neighbouring blocks. Thus, considering dependence between neighbouring blocks can enhance RD performance in mode decision. Proposed is an adaptive RDO for H.264 intra coding. To consider block dependence with only a few more computations, a mode decision criterion is proposed for I4 x 4 using the partial boundary sum of the squared differences. Experimental results show that the proposed method improves RD performance compared to RDO.     

基于JPEG2000的优化编码算法

通过深入研究JPEG2000的核心算法优化截取嵌入块编码。发现分块编码每个位平面上三个通道所需编码的像素不均衡。根据这个编码特性，在结合小波系数特点的基础上，对分块编码提出高频子带最高位和次高位平面联合编码以及0和1位平面两通道编码合并的优化算法。这种基于编码通道合并的优化算法，一方面可以减少编码扫描次数，提高编码速度；另一方面，合理的联合位平面编码算法设计减少了对次高位平面上不重要像素的重要性编码，使无损压缩性能的提高成为可能。     

A Segmentation-Based Chroma Intra Prediction Coding Scheme for H.264/AVC

In this paper, we propose a novel segmentation-based intra prediction coding scheme for low-bitrate video coding. Different coding schemes are separately designed for the luma and chroma components in our proposed method. The traditional block-based coding scheme is still used for the luma components, and the segmentation-based coding scheme is developed for the chroma components. The segmentation operation is used for the reconstructed luma components, which groups similar pixels together and produces a set of homogenous regions. Here, these local and homogenous regions are referred to superpixels. By utilizing the spatial correlation between the luma and chroma planes, we transfer the segmentation result of the luma components to the chroma components, which will not induce any side information in the chroma intra prediction coding. Instead of using the macroblock (MB) as the coding unit, the proposed method implements the chroma intra prediction in each superpixel, and the original pixels in each superpixel are employed to substitute the neighboring reconstructed samples in the prediction process. The experimental results show that the proposed method can achieve an average 0.20 dB and up to 0.63 dB coding gains in comparison to the directional intra prediction scheme for H.264/AVC low-bitrate video coding.     

基于分类和陪集码的高光谱图像无损压缩

在基于陪集码的高光谱图像压缩算法中,由于按照编码块的最大残差确定整块无损压缩所需的码率存在较大冗余,该文提出了基于分类和陪集码的高光谱图像压缩算法。首先利用前一波段对应位置的预测噪声对当前波段编码块的像素进行分类,将具有相似相关性的像素归于一类,然后对每一类像素分别进行陪集码编码。实验表明分类可以有效地降低码率。和基于陪集码的算法相比,该文算法无损压缩的平均码率降低了大约0.4 bpp。     

Recovery of image blocks using the method of alternating projections.

A technique for block-loss restoration in block-based image and video coding, dubbed recovery of image blocks using the method of alternating projections (RIBMAP), is developed. The algorithm is based on orthogonal projections onto constraint sets in a Hilbert space. For the recovery of a linear dimension N size block, a total of 8N vectors are extracted from the surrounding area of an N x N missing block. These vectors form a library from which the best matching spatial information for the missing block is extracted. Recovery vectors, including both undamaged and restored damaged pixels, are introduced. The vectors are used to find highly correlated information relating to the lost pixels. To assure continuity with the surrounding undamaged area, three additional convex constraints are formulated. Adherance to these sets is imposed using alternating projections. Simulation results using orthogonal projections demonstrate that RIBMAP recovers spatial structure faithfully. Simulation comparisons with other procedures are presented: Ancis and Giusto's hybrid edge-based average-median interpolation technique, Sun and Kwok's projections onto convex sets-based method, Hemami and Meng's interblock correlation interpolation approach, Shirani et al.'s modified interblock correlation interpolation scheme, and Alkachouh and Bellanger's fast discrete cosine transformation-based spatial domain interpolation algorithm. Characteristic of the results are those of the "Lena" JPEG image when one fourth of periodically spaced blocks in the image have errors. The peak signal-to-noise ratio of the restored image is 28.68, 29.99, 31.86, 31.69, 31.57, and 34.65 dB using that of Ancis and Giusto, Sun and Kwok, Hemami and Meng, Shirani et al., Alkachouh and Bellanger, and RIPMAP, respectively.