Large‐video‐display‐format conversion

Abstract— High‐quality video‐format converters apply motion estimation and motion compensation to prevent jitter resulting from picture‐rate conversion, and aliasing due to de‐interlacing, in sequences with motion. Although initially considered as too expensive, high‐quality conversion is now economically feasible, and since 1995 has been available in consumer television ICs. This paper addresses the issues in format conversion and shows recent progress, introducing a new high‐quality video‐format‐conversion IC for consumer applications.     

Motion‐adaptive alternate gamma drive for flicker‐free motion‐blur reduction in 100/120‐Hz LCD TV

Abstract— LCD motion blur is a well‐known phenomenon, and several approaches have been developed to address it. This includes very‐high‐performance approaches based on motion‐compensated frame rate conversion (MC‐FRC) and very‐low‐cost approaches based on impulsive driving. Impulsive‐driving schemes are attractive because of their low cost, but suffer from two significant issues — loss of luminance and large‐area flicker. A new impulsive‐driving approach using motion‐adaptive alternate gamma driving (MA‐AGD), which removes motion blur and preserves the original luminance level without causing large‐area flicker, is proposed.     

基于自适应双向运动估计的帧速率上转换算法

帧速率上转换主要应用于不同帧速率视频扫描格式之间的转换、低比特率视频通信等领域。提出了一种新的自适应帧速率上转换算法,将基于先验知识的自适应可变尺寸块与双向运动估计相结合,并采用改进的逐级矢量场平滑算法和自适应运动补偿插帧方法,解决了帧速率上转换中存在重叠、空洞等问题,减少了块效应,并保证了较高的运算速度。对标准测试序列的实验结果表明,本文算法较传统方法不仅降低了计算量,而且内插图像的主观和客观质量均有所提高。     

一种自适应帧频提升算法研究*

为减小帧频提升算法中内插帧的误差,提高提升后视频序列的整体观看质量,提出了一种新的自适应帧频提升算法,将基于经验阈值的自适应可变尺寸块与双向运动估计相结合,并对估计得到的运动矢量场进行逐级平滑以减小误差累积,解决了帧频提升中存在的重叠、空洞等问题,减少了块效应,比其他自适应算法简单且易于实现。对标准测试序列的实验结果表明,算法较其他方法不仅降低了计算量,而且内插图像的主观和客观质量均有所提高。     

A psychophysical study of improvements in motion‐image quality by using high frame rates

Abstract— The ideal frame rate for the highest motion‐image quality with respect to blur and jerkiness is presented. In order to determine the requirements for avoiding these impairments, motion images from a high‐speed camera and computer graphics were combined with a high‐speed display to perform a psychophysical evaluation. The camera, operating at 1000 fps, and image processing were used to simulate various frame rates and shutter speeds, and a 480‐Hz CRT display was used to present motion images simulating various frame rates and time characteristics of the display. Subjects were asked to evaluate the difference in quality between motion images at various frame rates. A frame rate of 480 fps was chosen to be an appropriate reference frame rate that, as a first estimation, enables coverage up to the human‐dynamic‐resolution (HDR) limit based on another experiment using real moving charts. The results show that a frame rate of 120 fps provides good improvement compared to that of 60 fps, and that the maximum improvement beyond which evaluation is saturated is found at about 240 fps for representative standard‐resolution natural images.     

Novel 120‐Hz TFT‐LCD motion‐blur‐reduction technology with integrated motion‐compensated frame‐interpolation timing controller

Abstract— Samsung has developed a high‐resolution full‐HD (1920 × 1080) 120‐Hz LCD‐TV panel using a novel pixel structure and a motion‐compensated frame‐interpolation (McFi) single‐chip solution. Our latest work includes launch of a 70‐in. full‐HD panel, the world's largest LCD TV in mass production, with a 120‐Hz frame rate. A serious problem involving the charging time margin has been completely overcome through the use of a new alternative 1G‐2D pixel structure and a new driving scheme. Compared with conventional dot‐inversion driving, our new dot‐inversion method, which is a spatial averaging technique, can save power because the column drivers are operated using vertical inversion driving. In addition, McFi, which merges individual ME/MC and timing‐controller (TCON) ICs and memories, has been developed and applied in a mass‐production product for the first time ever. The McFi solution provides 120‐Hz driving with the lowest possible system cost. Motion‐picture response time (MPRT) has been reduced from 1 5 to 8 msec. Moreover, for the case of 24‐Hz film source mode, motion judder has been completely eliminated. As a result, a lineup consisting of 40‐, 46‐, 52‐, 70‐, and 82‐in. LCD‐TV panels with high quality and manufacturability has been made possible.     

Motion‐blur characterization on liquid‐crystal displays

Abstract— In this paper, several methods to characterize motion blur on liquid‐crystal displays are reviewed. Based on the assumptions of smooth‐pursuit eye tracking and one‐frame temporal luminance integration, a simple algorithm has been proposed to calculate the normalized blurred edge width (N‐BEW) and motion‐picture response time (MPRT) with a one‐frame‐time moving‐window function to LC temporal step response curves. A custom measurement system with a fast‐eye‐sensitivity‐compensated photodiode has been developed to characterize motion blur based on LC response curves (LCRCs). MPRT values obtained by using the algorithm mentioned above and those from the smooth‐pursuit‐camera methods agree. Perception experiments were conducted to validate the correspondence between the simulated results and actual perceived images by the human eyes. In addition, the insufficiency of MPRT to evaluate motion blur on impulse‐type light‐generation LCDs, by analyzing the measurement results of a scanning backlight LCD, is discussed.     

Guiding principles for high‐quality moving picture in LCD TVs

Abstract— The moving‐picture quality of several LCD modules was evaluated by using the quantitative parameter, normalized blurred edge width (N‐BEW), or the N‐BEW value normalized by time (N‐BET), measured and calculated by the developed time‐sequence‐image integration system which has taken LCD‐response characteristics and human‐vision characteristics into consideration. The quality of several LCD TVs is also discussed by using subjective evaluation and the unified quantitative parameter moving‐picture response time (MPRT), which is based on N‐BEW. According to the experimental and calculated results, it is clear that the value of N‐BET can express moving‐picture quality, which depends on the liquid‐crystal response time and the hold‐type character of LCDs. Also, it is confirmed that the value of MPRT can express the moving‐picture quality by comparison with subjective evaluation. The target values of MPRT and N‐BET for the motion‐blur‐less picture are deduced by extrapolating the subjective evaluation results. Then, guidelines to improve the moving picture quality are demonstrated.     

Video 2‐D—to—3‐D conversion based on hybrid depth cueing

Abstract— With the maturation of three‐dimensional (3‐D) technologies, display systems can provide higher visual quality to enrich the viewer experience. However, the depth information required for 3‐D displays is not available in conventional 2‐D recorded contents. Therefore, the conversion of existing 2‐D video to 3‐D video becomes an important issue for emerging 3‐D applications. This paper presents a system which automatically converts 2‐D videos to 3‐D format. The proposed system combines three major depth cues: the depth from motion, the scene depth from geometrical perspective, and the fine‐granularity depth from the relative position. The proposed system uses a block‐based method incorporating a joint bilateral filter to efficiently generate visually comfortable depth maps and to diminish the blocky artifacts. By means of the generated depth map, 2‐D videos can be readily converted into 3‐D format. Moreover, for conventional 2‐D displays, a 2‐D image/video depth perception enhancement application is also presented. With the depth‐aware adjustment of color saturation, contrast, and edge, the stereo effect of the 2‐D content can be enhanced. A user study on subjective quality shows that the proposed method has promising results on depth quality and visual comfort.     

Optimization‐based group performance deducing

Large‐scale group performance animation has been an important research topic because of its diverse range of applications including virtual rehearsal and film production. Animating hundreds of virtual actors as what the director wishes is a tough task. In this paper, we address this challenge by introducing an optimization method that generates large‐scale group performance by deducing a small‐scale one with fewer actors. We introduced group motion bigraph technique and transformed the motion‐deducing problem into a constrained optimization problem. A solving process is then presented to automatically obtain the motion of the large group with velocity constraints. Moreover, an interactive system of constructing the group motion bigraph has been implemented, which provides flexible edit and control on deducing group motion. The animation results show that our method is competent for deducing large‐scale group performance from only several motion clips performed by small groups. Copyright © 2013 John Wiley & Sons, Ltd.     

A consideration on motion‐image‐quality improvement of LCDs and video systems

Abstract— The motion image quality of video systems with hold‐type displays, such as LCDs or OLEDs, were studied with regard to dynamic spatial frequency response and data from subjective evaluations on motion blur. The system parameters of motion image quality, or frame rate (F) and temporal aperture (A^t), were investigated and their required values were derived. A smaller temporal aperture and/or higher frame rate can improve the dynamic response and motion image quality, but the parameters required in order to maintain a good dynamic response for high motion image velocity seems very difficult to implement, such as a frame rate of 900 Hz. Therefore, the performance goal of video systems is set on “limit of acceptance” for motion image quality, as a compromise. An equation or the relational expression between motion image velocity and required parameter values is derived based on dynamic response and data from subjective evaluations found in published studies. Possible examples of parameter sets are obtained from the equation. Those are (F = 300 Hz, A_t = 5/6), (F = 240 Hz, A_t = 2/3), (F = 120 Hz, A_t = 1/3), and (F > 360 Hz, A_t = 1).     

PDP picture‐quality enhancement based on human‐visual‐system relevant features

The success of a new display technology such as plasma is strongly related to the final picture quality assessed by the customer's eyes. The human visual system (HVS) characteristics enable the definition of new cost‐efficient methods to significantly reduce the visibility of all plasma‐specific artifacts. Simple optimized encoding methods based on the luminance perception will be presented as well as more‐complicated algorithms based on motion perception.     

LCD motion‐blur estimation using different measurement methods

Abstract— The primary goal of this study was to find a measurement method for motion blur which is easy to carry out and gives results that can be reproduced from one lab to another. This method should be able to also take into account methods for reduction of motion blur such as backlight flashing. Two methods have been compared. The first method uses a high‐speed camera that permits us to directly picture the blurred‐edge profile. The second one exploits the mathematical analysis of the motion‐blur formation to construct the blurred‐edge profile from the temporal step response. Measurement results and method proposals are given and discussed.     

Evaluation of liquid‐crystal‐display motion blur with moving‐picture response time and human perception

Abstract— The moving‐picture response time (MPRT) for measuring liquid‐crystal‐display (LCD) motion blur was studied by several organizations in 2001. To determine the LCD motion blur that humans perceive, subjective evaluation experiments using the method of adjustment was conducted to find a strong correlation between perceived motion blur and extended blurred edge time (EBET) of the MPRT measurements. MPRT thus clearly indicates the degree of which humans perceive motion blur.     

视频标准帧速率上变换的自适应运动补偿方案

提出了一种自适应的运动补偿方案，首先利用预测三步搜索算法进行运动估计，由于此运动估计算法能够很好地利用运动向量的时空相关性．从而能得到更加平滑的运动向量场。其次．为了能够抑制运动向量场中个别奇异向量以及块匹配算法所固有的块效应问题，对向量场进行中值滤波，并采用了一种特殊的向量分配算法。方案的最后一个环节是运动补偿插值，它综合考虑插值帧的局部图像质量以及全局图像质量，利用一种白适应性较强的中值滤波操作来达到一定的综合效果。实验结果证明，此算法与运动补偿时间插值(MCTI)算法相比，插值得到的图像更加平滑，而且，两者的信噪比指标对比也充分说明了本算法的优越性。     

A field‐sequential‐color display with a local‐primary‐desaturation backlight scheme

Abstract— Field‐sequential‐color technology eliminates the need for color filters in liquid‐crystal displays (LCDs) and results in significant power savings and higher resolution. But the LCD suffers from color breakup, which degrades image quality and limits practical applications. By controlling the backlight temporally and spatially, a so‐called local‐primary‐desaturation (LPD) backlight scheme was developed and implemented in a 180‐Hz optically compensated bend (OCB) mode LCD equipped with a backlight consisting of a matrix of light‐emitting diodes (LEDs). It restores image quality by suppressing color breakup and saves power because it has no color filter and uses local dimming. A perceptual experiment was implemented for verification, and the results showed that a field‐sequential‐color display with a local‐primary‐desaturation backlight reduced the color breakup from very annoying to not annoying and even invisible.     

A perceived sharpness metric based on the luminance slope and overshoot of the motion‐induced edge‐blur profile

To reduce perceived motion blur on liquid crystal displays, typically various techniques such as overdrive, scanning backlight, black‐data insertion, black‐field insertion, and frame rate up‐conversion are widely employed by the liquid crystal display industry. These techniques aim to steepen the edge transitions by improving the dynamic behavior of the light modulation. However, depending on the implementation, this may result in the perception of irregularly shaped motion‐induced edge‐blur profiles. It is not yet fully understood how these irregularities in the steepened edge‐blur profiles contribute to the perceived sharpness of moving objects. To better understand the consequences of several motion‐blur reduction techniques, a perception experiment is designed to evaluate the perceived sharpness of typical motion‐induced edge‐blur profiles at several contrast levels. Relevant characteristics of these profiles are determined on the basis of the perception results by means of regression analysis. As a result, a sharpness metric with two parameters is established, where one parameter relates to the edge slope and the other to the overshoot/undershoot part of the motion‐induced edge‐blur profile.     

Motion blur reduction with triangular waveform emission and optimized enhance filter

Degradation of moving image quality by motion blur on hold‐type displays is a well‐known issue. In order to reduce motion blur, a number of driving methods, such as a higher frame rate and a shorter temporal aperture, have been proposed. Methods to reduce motion blur by means of signal processing as a precompensation method have also been proposed. In these methods, however, hold emission that emits light at a constant intensity during a frame is used. Since the spatial frequency response of the hold emission in a moving picture has a null point, the effectiveness of precompensation methods is limited to the lower‐spatial frequency domain. A triangular waveform emission has been investigated, and it has a higher spatial frequency response than hold emission. In the present paper, we calculated an optimized enhancement filter for the triangular waveform emission as a precompensation method and demonstrated its effectiveness for reducing motion blur by using the triangular waveform emission and the optimized enhancement filter. As a result, the optimized enhancement filter reduced motion blur and suppressed distortion that emerged when using a conventional enhancement filter.     

Characterizing displays by their temporal aperture: A theoretical framework

Abstract— The spatio‐temporal aperture and sample rate of a video display determines both the static and dynamic resolution of the video signal that is rendered. The dynamic display characteristics like the visibility of large‐area flicker, motion judder, and motion blur can be derived from the frame rate and the temporal extent of the pixel aperture (i.e., the temporal aperture). For example, liquid‐crystal displays (LCDs) have an aperture that is relatively small in the spatial dimension and wide in the temporal domain. Consequently, moving objects displayed on an LCD suffer from motion blur. Especially in TV applications, the temporal dimension has a large impact on the overall picture quality. The temporal aperture, together with the frame rate, is shown to predict the amount of perceived large‐area flicker, motion judder, and motion blur and also the performance of motion‐blur reduction algorithms for LCDs. From this analysis it is further determined how to obtain the optimal temporal aperture of a television display, for which not only properties of the human visual system (HVS), but also the properties of the video signal have to be taken into account.     

Capturing human motion using body‐fixed sensors: outdoor measurement and clinical applications

Motion capture is mainly based on standard systems using optic, magnetic or sonic technologies. In this paper, the possibility to detect useful human motion based on new techniques using different types of body‐fixed sensors is shown. In particular, a combination of accelerometers and angular rate sensors (gyroscopes) showed a promising design for a hybrid kinematic sensor measuring the 2D kinematics of a body segment. These sensors together with a portable datalogger, and using simple biomechanical models, allow capture of outdoor and long‐term movements and overcome some limitations of the standard motion capture systems. Significant parameters of body motion, such as nature of motion (postural transitions, trunk rotation, sitting, standing, lying, walking, jumping) and its spatio‐temporal features (velocity, displacement, angular rotation, cadence and duration) have been evaluated and compared to the camera‐based system. Based on these parameters, the paper outlines the possibility to monitor physical activity and to perform gait analysis in the daily environment, and reviews several clinical investigations related to fall risk in the elderly, quality of life, orthopaedic outcome and sport performance. Taking advantage of all the potential of these body‐fixed sensors should be promising for motion capture and particularly in environments not suitable for standard technology such as in any field activity. Copyright © 2004 John Wiley & Sons, Ltd.