一种基于噪声估计的彩色噪声滤除算法

在视频处理中，为了提高电视画面的清晰度，不但需要对亮度噪声进行滤除，对色度噪声的滤除也是必不可少的。文章的滤波算法是：先基于块操作对图像的噪声情况做一个大概的估计，然后根据估计的噪声情况对图像进行降噪或者不作处理。降噪的时候。对彩色脉冲和高斯噪声分别选择不同的阵噪算法。文章着重介绍了彩色脉冲噪声的滹除，该算法综合了线性和非线性矢量滤波，降噪效果明显,对高斯噪声采用矢量均值滤波。     

自适应联合相邻运动矢量的运动补偿插值算法

帧率上采样作为一种视频后处理技术,通过对原始视频插值得到高帧率视频,满足人们对高帧率视频的需求.传统基于重叠块的插值补偿算法会带来块效应或鬼影现象.为了解决这一问题,人们提出联合匹配块及其相邻块预测的方法,但是复杂度高,效果不明显.基于以上几点,本文提出一种自适应联合相邻运动矢量的运动补偿插值算法(Joint Motion-Compensated In-terpolation Algorithm Using Adjacent Block Motion Vectors Adaptively,AJ-MCI).在该算法中,将运动矢量矫正和运动补偿插值算法相结合,同时运动补偿模块中自适应地联合相邻匹配块,以最大限度刻画真实运动轨迹.实验结果表明,本文算法能很好的提升视频的主客观质量,同时保持较低计算复杂度.     

Application of partition-based median type filters for suppressingnoise in images

An adaptive median based filter is proposed for removing noise from images. Specifically, the observed sample vector at each pixel location is classified into one of M mutually exclusive partitions, each of which has a particular filtering operation. The observation signal space is partitioned based an the differences defined between the current pixel value and the outputs of CWM (center weighted median) filters with variable center weights. The estimate at each location is formed as a linear combination of the outputs of those CWM filters and the current pixel value. To control the dynamic range of filter outputs, a location-invariance constraint is imposed upon each weighting vector. The weights are optimized using the constrained LMS (least mean square) algorithm. Recursive implementation of the new filter is then addressed. The new technique consistently outperforms other median based filters in suppressing both random-valued and fixed-valued impulses, and it also works satisfactorily in reducing Gaussian noise as well as mixed Gaussian and impulse noise     

一种实时视频分辨率提升算法及其VLSI设计与实现

提出了一种适合硬件实现的实时视频分辨率提升算法并给出该算法的VISI硬件实现结构。本文根据图像空域内邻近像素多个方向的内容相关性并结合改进的中值滤波方法，得到一种基于图像最大相关性的自适应优化插值算法，有效改善了视频分辨率提升过程中所出现的图像细节模糊和边缘锯齿化等问题。算法已经在Xilinx FPGA平台上通过验证，实现了对视频信号的实时分辨率提升，结果表明该算法能有效提高图像清晰度和视觉效果。     

Efficient implementation of 3D filter for moving object extraction

In this paper the design and implementation of Multi-Dimensional (MD) filter, particularly 3-Dimensional (3D) filter, are presented. Digital (discrete domain) filters applied to image and video signal processing using the novel 3D multirate algorithms for efficient implementation of moving object extraction are engineered with an example. The multirate (decimation and/or interpolation) signal processing algorithms can achieve significant savings in computation and memory usage. The proposed algorithm uses the mapping relations of z-transfer functions between non-multirate and multirate mathematical expressions in terms of time-varying coefficient instead of traditional polyphase de- composition counterparts. The mapping properties can be readily used to efficiently analyze and synthesize MD multirate filters.     

Analysis of two-dimensional center weighted median filters

Center weighted median (CWM) filters, which have been recognized as detail preserving filters, are an important and the simplest subclass of weighted median (WM) filters. In this paper, we analyze the root signals of two-dimensional (2-D) CWM filters. In particular, we derive the required form for a signal to be a root of a 2-D CWM filter. The required form of signals to be roots is then used to evaluate the detail preserving properties of 2-D CWM filters. As examples, the detail preserving properties of some 2-D CWM filters are compared with other detail preserving filters, i.e. multilevel median filters. The generation of binary root signals of some 2-D CWM filters is treated in the term of the smallest surviving object (SSO). It is illustrated by some examples that CWM filters with different orientation of windows can be useful in image segmentation.     

An overview and performance evaluation of classification-based least squares trained filters

An overview of the classification-based least squares trained filters on picture quality improvement algorithms is presented. For each algorithm, the training process is unique and individually selected classification methods are proposed. Objective evaluation is carried out to single out the optimal classification method for each application. To optimize combined video processing algorithms, integrated solutions are benchmarked against cascaded filters. The results show that the performance of integrated designs is superior to that of cascaded filters when the combined applications have conflicting demands in the frequency spectrum.     

Performance analysis of motion-compensated de-interlacing systems.

A lot of research has been conducted on motion-compensated (MC) de-interlacing, but there are very few publications that discuss the performances of de-interlacing quantatively. The various methods are compared through their performance on known video sequences. Linear system analysis of interlaced video and de-interlacer are proposed in. It is well established that the performance of the MC methods outperform the fixed or motion-adaptive methods when the motion vectors used are reliable and true to the scene content. Being an open-loop process the performance of the MC de-interlacers degrade drastically when there are motion vector errors. In this paper, a linear system analysis of MC video upconversion systems is presented and the effects of motion vector accuracy on system performance are analyzed. We investigate the various factors that contribute to the motion vector inaccuracy, such as incorrect motion modelling, acceleration between the frames, and insufficient interpolation kernel.     

一种基于双域拉格朗日插值的视频错误隐藏方法

本文提出了一种基于双域拉格朗日插值的错误隐藏方法,编码采用H.264标准,分别在时域和空域进行插值获得两个运动矢量,通过建立插值系数表构造混合的插值模型,经过边缘匹配算法判断后获得最优的运动矢量作为丢失宏块的运动矢量.为了减小网络突发错误对插值效果的影响,本文在编码端提出了一种类交织的slice划分方法,实验证明本文方法由于充分利用了时域和空域的信息冗余,取得了较好效果,在15％网络丢包率的环境下平均PSNR比空域拉格朗日插值方法高0.5dB~1dB左右.     

H.264帧间模式选择水印算法研究

针对H.264/AVC视频编码标准,提出一种基于帧间模式选择的视频水印算法。在亚宏块模式选择的基础上,算法先对二值图像进行Arnold置乱以及turbo码编码形成待嵌入的水印序列;然后,根据水印数据修改亚宏块模式以改变子块数目的奇偶性,并将修改前后SAD值变化最小的亚宏块作为嵌入域;最后,通过隔帧嵌入、增大滤波器滤波强度来降低水印的嵌入对视频质量的影响。仿真结果表明,在不影响水印正确提取的前提下,算法对视频码率影响较小,具有很好的抗噪声能力,并且在视频PSNR方面能取得较好的效果。      

A comparison of motion-compensated interlace-to-progressive conversion methods

The conversion of interlaced video to progressive format may be carried out in a number of ways, including vertical interpolation, fixed or motion-compensated vertical-temporal interpolation, and approaches based on motion compensation using non-uniform sampling theory. Motion-compensated methods potentially offer the best performance, although the accuracy and reliability of the vectors has a significant impact on their performance. For applications such as display conversion using vectors recovered from an MPEG-2 bitstream, the vectors available may not be of the highest quality. This paper considers several motion-compensated interlace-to-progressive conversion methods, and assesses their performance with both accurate and inaccurate vectors using objective and subjective techniques. The method found to work best uses a motion-compensated three-field vertical-temporal filter, in which the vertical component of the vector is rounded to the nearest even number of picture lines per field period. This method reduced the RMS error of converted picture sequences by almost 20% compared to simple vertical filtering when using vectors from an MPEG-2 bitstream. Conversely, some other motion-compensated methods were found to increase the error by a similar amount.     

一种视频序列中背景亮度闪烁消除新算法

拍摄场景存在运动对象时,视频相机的自动曝光功能可能引起视频序列背景亮度闪烁,针对此问题,提出一种视频序列中背景亮度闪烁消除新算法。该算法找出视频序列中的亮度参考帧,使用最小二乘法确定出当前帧和参考帧之间的背景亮度响应函数,使用亮度补偿的方法消除背景闪烁。实验结果表明,该算法可以有效地消除由于前景物体的运动而引起的背景亮度闪烁现象,用于编码传输时可以节省20%~30%的比特率。     

The effect of reconstruction filters on direct upconversion in amultichannel environment

The effect of reconstruction filters on direct upconversion is analyzed in a multichannel environment. It is shown that the reconstruction filters cause gain and phase imbalances to be frequency dependent, a significant issue when considering the stringent adjacent channel interference (ACI) requirements for radio communication systems. The paper introduces an adaptive compensation technique as a means of overcoming these frequency dependent imbalances. Additionally the error vector between the mismatched filters is shown to be directly related to the amount of sideband rejection. This analysis is then used to develop a methodology for analysing the performance of the novel compensation technique with respect to the mismatched filters. Analysis of the classical all-pole filter algorithms reveal the sensitivity of direct upconversion in a multichannel environment to filter order, type, percentage mismatch and differing ACI level     

A motion vector recovery algorithm for digital video using Lagrange interpolation

In this paper, we propose an efficient motion vector recovery algorithm for the new coding standard H.264, which makes use of the Lagrange interpolation formula. In H.264, a 16/spl times/16 inter macroblock can be divided into different block shapes for motion estimation, and each block has its own motion vector. For nature video the movement within a small area is likely to move in the same direction, hence the neighboring motion vectors are correlative. Because the motion vector in H.264 covers smaller area than previous coding standards, the correlation between neighboring motion vectors increases. We can use the Lagrange interpolation formula to constitute a polynomial that describes the motion tendency of motion vectors, which are next to the lost motion vector, and use this polynomial to recover the lost motion vector. The simulation result shows that our algorithm can efficiently improve the visual quality of corrupted video.     

Interpolated Mth-band filters for image size conversion

Image/video size conversion at variable rates requires that a large set of interpolation filters should be stored in a table. We present the interpolated Mth-band filters as the interpolation filters, which are obtained from the cubic spline interpolation of a prototype M/sub p/th-band eigenfilter. The proposed filter can be calculated in real time, eliminating the need for a large on-chip memory. Scaled images using the proposed filters show superb image quality.     

基于运动相似性的帧率提升算法

为提升低比特率通信接收端的视频帧率,解决快速运动中的图像模糊问题,提出了一种基于运动相似性的帧率提升算法,其三维递归搜索来减少运动估计的计算复杂度,利用自适应的判决窗口减少非相似运动对运动矢量预测的影响,提高运动估计的精度;同时构建运动相似因子,对不同的运动相似块进行不同的运动矢量细化操作,减小块效应;利用对应的相似运动窗口来进行重叠块补偿插值,提高插值的精度.实验结果表明,该算法在主客观方面有较好的性能提升.     

Spatiotemporal error concealment with optimized mode selection and application to H.264

In this paper we propose an error concealment algorithm for video transmission over lossy packet networks. The proposed technique is based on temporal and spatial interpolation. A sophisticated mode selection algorithm decides whether to employ the temporal or the spatial part, or a combination thereof, to estimate a missing macroblock; the selection does not rely on knowledge of the original coding modes. The resulting error concealment algorithm is designed so as to optimize both PSNR and visual quality of the restored video sequence, and employs directional interpolation and texture analysis/synthesis. The technique has been applied to H.264 coded video, providing satisfactory results on a number of test sequences.     

Low complexity deblocking method for DCT coded video signals

A new method to remove blocking artefacts in low bit-rate block-based video coding, such as MPEG-4 and H.264, is presented. A low computational deblocking filter with five modes is proposed, including three frequency-related modes (smooth mode, intermediate mode, and complex mode for low-frequency, mid-frequency, and high-frequency regions, respectively), one special mode (steep mode for a large offset between two blocks) and a refined mode (corner mode for the corner of four blocks). A mode decision procedure is also needed to decide which mode is given by observing pixel behaviour around the block boundary. To take the masking effect of the human visual system (HVS) into consideration, the filter for smooth mode is designed to be much stronger than that for complex mode, because human eyes are more sensitive to smooth regions. Experimental results show that, in most cases, the proposed algorithm removes more blocking artefacts than MPEG-4 deblocking filters do, and improves both subjective and objective image quality. The proposed algorithm keeps the computation lower than MPEG-4 and is suitable for most block-based image and video coding systems.     

多视点视频编码中宏块复杂度的研究

多视点视频带来了更真实生动的画面感,但同时也需要更大的数据量。本文对多视点视频编码模型JMVC中采用的模式选择技术编码计算量大的问题,通过分析和研究当前宏块的模式与相邻的已编码宏块及参考帧相应位置宏块模式间的关系,利用宏块模式间的相关性,对当前编码宏块的模式选择算法进行了优化,减少部分细小块的分割及搜索。实验结果表明,在其重建视频质量及码率开销基本不变的前提下,改进算法对运动较平缓的立体视频序列效果较好,较JMVC模型中的算法对全部测试序列的平均编码时间减少了约67%,而对运动较平缓序列的编码时间减少达73%。      

A 2/3-in 1187(H)×581(V) S-VHS-compatible frame-transfer CCDfor ESP and movie mode

The authors present a high-resolution frame-transfer charge-coupled-device (CCD) suitable for S-VHS camcorders with an additional full-resolution true electronic still picture (ESP) mode of operation. The CCD sensor is composed of an image section, an intermediate readout register, a storage section, and a second readout register. A resolution of 450 TV lines (H) is obtained in color images by applying cyan-green-yellow complementary stripe color filters on the 1187(H)×581(V) pixels. The operation of the sensor in both conventional video and ESP modes is described. Special attention is paid to the 3-D potential calculations required to obtain a design guaranteeing a high-quality picture. Experimental results are presented