Overcoming latency with motion prediction in directional autostereoscopic displays

Imaging delivering to correct retina assisted with tracking technique is a common practice for autostereoscopic displays with stereo two‐view data format. Due to various latencies produced in camera buffering, computer processing, data transmission, and illumination refreshing, delayed image delivery will give rise to a substantial degradation of the 3D display experience. This is particularly obvious for directional backlight 3D displays where significant flickering is resulted as a result of the inherent latency. This work systematically analyzes the source of latency by quantitatively measuring the exact latency value in a typical directional backlight autostereoscopic display. Based on accurate measurement, a motion prediction solution is proposed to improve the synchronization between the backlight illumination and viewer's eye location. Motion prediction helps overcome the lag between the center of illumination and viewer's eye, providing a flicker‐free viewing experience for both a stationary and a moving viewer.     

Characterizing crosstalk in anaglyphic stereoscopic images on LCD monitors and plasma displays

Abstract— In 1853, William Rollman developed the inexpensive and easy to use anaglyph method for displaying stereoscopic images. Although it can be used with nearly any type of full‐color display, the anaglyph method compromises the accuracy of color reproduction, and it often suffers from crosstalk (or ghosting) between the left‐ and right‐eye image channels. Crosstalk degrades the ability of the observer to fuse the stereoscopic image, and hence reduces the quality of the 3‐D image. Crosstalk is present in various levels with most stereoscopic displays; however, it is often particularly evident with anaglyphic 3‐D images. This paper summarizes the results of two projects that characterized the presence of anaglyphic crosstalk due to spectral issues on 13 LCD monitors, 14 plasma displays, and a CRT monitor when used with 25 different pairs of anaglyph 3‐D glasses. A mathematical model was used to predict the amount of crosstalk in anaglyphic 3‐D images when different combinations of displays and glasses are used, and therefore highlight displays, glasses, and combinations thereof which exhibit lower levels of crosstalk when displaying anaglyphic 3‐D images.     

Analytical model for three-dimensional light-field displays based on voxel construction

Three-dimensional light-field displays (3D-LFDs) can provide viewers with glass-free 3D images. The display effect of reconstructed 3D images is closely related to the number of 3D object points that the 3D display system can construct, which can be regarded as the information quantity of the 3D-LFDs. However, the information quantity presented by a 3D-LFD is limited by fixed hardware parameters such as display panels and optical components. It is difficult to present an ideal 3D visual experience with the increase in display depth. In this paper, an analytical model based on voxel construction for 3D-LFDs is proposed, which can estimate the information quantity that a 3D-LFD can reproduce. The variation regularity of information quantity with display depth is analyzed and the influence of hardware parameters on display effect is discussed. With the proposed strategies, the display effect can be improved in a targeted manner without blurring and aliasing by adjusting the hardware parameters in display systems and matching the information quantity at different display depths.     

Image flickering reduction by dimer and polymer stabilization in FFS liquid crystal display

Power consumption of a liquid crystal display, when it is used to display static images, can be reduced by using low frequency driving. However, when the driving frequency is decreased, the brightness of the display may change with time, a phenomenon known as image flickering. One factor responsible for the flickering issue is flexoelectric effect which is sensitive to the polarity of the applied voltage. We show that the flickering in fringe field switching (FFS) LCD can be significantly reduced by doping a liquid crystal dimer and using polymer stabilization. We demonstrated that 2 Hz driving frequency can be used to display static images.     

Influence of 3‐D cross‐talk on qualified viewing spaces in two‐ and multi‐view autostereoscopic displays

Abstract— To estimate the qualified viewing spaces for two‐ and multi‐view autostereoscopic displays, the relationship between image quality (image comfort, annoying ghost image, depth perception) and various pairings between 3‐D cross‐talk in the left and right views are studied subjectively using a two‐view autostereoscopic display and test charts for the left and right views with ghost images due to artificial 3‐D cross‐talk. The artificial 3‐D cross‐talk was tuned to simulate the view in the intermediate zone of the viewing spaces. It was shown that the stereoscopic images on a two‐view autostereoscopic display cause discomfort when they are observed by the eye in the intermediate zone between the viewing spaces. This is because the ghost image due to large 3‐D cross‐talk in the intermediate zone elicits different depth perception from the depth induced by the original images for the left and right views, so the observer's depth perception is confused. Image comfort is also shown to be better for multi‐views, especially the width of the viewing space, which is narrower than the interpupillary distance, where the parallax of the cross‐talking image is small.     

Effect of number of views to the viewing experience with autostereoscopic 3‐D displays

Abstract— The observers' 3‐D viewing experience when the way the content is created and shown on an autostereoscopic 3‐D display alternate is evaluated. The observer's depth impression, and the perceived contour accuracy and image naturalness or peskiness of the content shown on a 3‐D display, has been investigated. In addition, the consequences of the way the content is created to the results from the optical characterization for the same display have been studied. The alternation of the content was realized in two different ways. Firstly, the number of views for creating the image was varied. Two, five, and 14 views were used; the main focus being on testing the same display and treating it as an ordinary two‐view and a 14‐view display with inter‐sub‐view crosstalk. Also, the intermediate condition where five views with non‐uniform view‐specific crosstalk were used has been investigated. Secondly, the way the content is created was varied by using images with computer‐generated content and photos. The effect of these parameters on viewing experience as such and especially the effect of 3‐D crosstalk on the viewing experience were studied.     

Efficiency analysis for multi‐view spatially multiplexed autostereoscopic 2‐D/3‐D displays

Abstract— The wide‐viewing freedom often requested by users of autostereoscopic displays can be delivered by spatial multiplexing of multiple views in which a sequence of images is directed into respective directions by a suitable autostereoscopic optical system. This gives rise to two important design considerations — the optical efficiency and the resolution efficiency of the device. Optical efficiency is particularly important in portable devices such as cell phones. A comparison is given between lens and barrier systems for various spatial multiplexing arrangements. Parallax‐barrier displays suffer from reduced optical efficiency as the number of views presented increases whereas throughput efficiency is independent of the number of views for lens displays. An autostereoscopic optical system is presented for the emerging class of highly efficient polarizer‐free displays. Resolution efficiency can be evaluated by investigating quantitative and subjective comparisons of resolution losses and pixel appearance in each 3‐D image. Specifically, 2.2‐in.‐diagonal 2‐D/3‐D panel performance has been assessed using Nyquist boundaries, human‐visual contrast‐sensitivity models, and autostereoscopic‐display optical output simulations. Four‐view vertical Polarization‐Activated Microlens technology with either QVGA mosaic or VGA striped pixel arrangements is a strong candidate for an optimum compromise between display brightness, viewing angle, and 3‐D pixel appearance.     

Reduced cross‐talk in shutter‐glass‐based stereoscopic LCD

Abstract— It is expected that 3‐D will be the next step in the enhanced viewing experience. At present, there are two competing 3‐D technologies for glasses‐based consumer TVs: active shutter glasses and passive polarized glasses. With the ongoing reduction in response time of liquid‐crystal displays (LCDs), this article will focus on shutter‐glass‐based stereoscopic LCDs. In this paper, the properties of such a display system is described and it is demonstrated that by adding a line‐scanning backlight, the cross‐talk can be reduced to less than 1.4%, allowing for excellent 3‐D portrayal. For images of extreme contrast, this is perceivable, but not judged annoying by a panel of expert viewers. Which characteristics of the display and shutter glasses that should be optimized to create an inexpensive, cross‐talk‐free, 3‐D LCD are discussed.     

A common approach to characterizing autostereoscopic and polarization‐based 3‐D displays

Abstract— Autostereoscopic and polarization‐based stereoscopic 3‐D displays recreate 3‐D images by providing different images in the two eyes of an observer. This aim is achieved differently for these two families of 3‐D displays. It is shown that viewing‐angle measurements can be applied to characterize both types of displays. Viewing‐angle luminance measurements are made at different locations on the display surface for each view emitted by the display. For autostereoscopic displays, a Fourier‐optics instrument with an ultra‐high‐angular‐resolution VCMaster3D is used. For polarization‐based displays, a standard Fourier‐optics instrument with additional glass filters is used. Then, what will be seen by an observer in front of the display is computed. Monocular and binocular quality criteria (left‐ and right‐eye contrast, 3‐D contrast) was used to quantify the ability to perceive depth for any observer position. Qualified monocular and binocular viewing spaces (QMVS and QBVS) are deduced. Precise 3‐D characteristics are derived such as maximum 3‐D contrast, optical viewing freedom in each direction, color shifts, and standard contrast. A quantitative comparison between displays of all types becomes possible.     

Analysing observer preferences when presenting a product in a rendered scene: 2D vs. autostereoscopic 3D displays

ABSTRACT

This research compares the way the image of a product included within a rendered scene shown on an autostereoscopic 3D display is rated versus the same image shown in a 2D display. The purpose is to understand the observer's preferences and to determine the features that a composition should have to highlight the product and to make its presentation more attractive to observers, thereby helping designers and advertisers who use both displays to prepare images to make them more effective when visually presenting a product.

The results show that observers like the images on autostereoscopic 3D displays slightly more than those presented by means of 2D displays. On both displays the product is perceived more quickly when it is larger than the other elements and is shown with greater chromatic contrast, but a composition is seen as more attractive when the chromatic relationship between all the elements is more harmonious.     

Multibeam and multipanel displays: Some perceptual effects of scan architecture

Abstract— Scan architectures involving multiple beams or panels provide a means of increasing display resolution. However, the spatiotemporal pattern of such a scan may differ appreciably from the sampling lattice of standard input devices. If there are discrepancies between the scan pattern used to display a sequence of spatial images and the sampling lattice used to create that sequence, the space‐time display image may not be an accurate reconstruction of the original image. To illustrate the types of error that can occur, this paper presents an analysis of the form and motion distortions that result when a standard, progressive scan is used to display computer‐generated constant‐velocity motion sequences. A summary of pertinent psychophysical research indicates why these distortions are rarely detectable and provides a basis for estimating the perceptual salience of distortions created by combinations of sampling lattices and scan patterns. Finally, an analysis of several possible parallel‐ scan architectures indicates that some will introduce relatively large temporal delays between updates of spatially adjacent areas and thereby seriously distort computer‐generated images.     

Projection‐based head‐tracking 3‐D displays

Abstract— This paper describes the construction and operation of four 3‐D displays in which each display produces two images for each eye and thus fits into the category of projection‐based binocular stereoscopic displays. The four 3‐D displays described are pico‐projector‐based, liquid‐ crystal—on—silicon (LCOS) conventional projector‐based, 120‐Hz digital‐light‐processor (DLP) projector‐ based, and the HELIUM3D system. In the first three displays, images are produced on a direct‐view LCD whose conventional backlight is replaced with a projection illumination source that is controlled by a multi‐user head tracker; novel steering optics direct the projector output to regions referred to as exit pupils located at the viewers' eyes. In the HELIUM3D display, the image information is supplied by a horizontally scanned, fast, light valve whose output is controlled by a spatial light modulator (SLM) to direct images to the appropriate viewers' eyes. The current statu s and the multimodal potential of the HELIUM3D display are described.     

A new modeling interface for the pen-input displays

Sketch interactions based on interpreting multiple pen markings into a 3D shape is easy to design but not to use. First of all, it is difficult for the user to memorize a complete set of pen markings for a certain 3D shape. Secondly, the system will be waiting for the user to complete the sequence of the pen markings, often causing a certain mode error. To address these problems, we present a novel, interaction framework, suitable for interpretations based on single-stroke marking on pen-input display; within this framework 3D shape modeling operations are designed to create appropriate communication protocols.     

Color and brightness appearance issues in tiled displays

Large-format displays created by tiling multiple, projected images have been used for decades in flight simulators and entertainment and are commercially available in a variety of forms. More recently, various research organizations have built custom display walls out of commodity projectors to support research in visualization, large-format display, and interaction. In these settings, making the display appear as a single, seamless surface has proven challenging. Where tiles overlap, they create bright seams. The tiles vary in color and brightness, not only from tile to tile, but within each tile. Each projector has a slightly different color gamut, caused by variations in the bulb, color filters, and digital processing (contrast, brightness, and gamma) for the projector. The spatial variation in brightness has two causes. First, the light from a projection system doesn't uniformly illuminate the screen. Second, the light doesn't scatter uniformly out of the front of the screen, making the perceived brightness depend on the viewing angle. In some projectors, the projected light's color also varies across the tile's face, resulting in unwanted tints in the images. I describe what causes these variations and what can be done about them     

Advanced MEMS-based technologies and displays

MEMS (microelectromechanical systems) are used in many fields including display applications, which are extensively studied both in academia and industry. For practical devices, numbers of advanced technologies have been developed based on MEMS concept. For display technologies, projection displays, reflective displays, transmissive displays and other display modes have been achieved by different MEMS modes. In this review, the current MEMS-based display technologies are introduced and discussed including digital micromirror device (DMD), laser scanning display (LSD), interferometric modulator display (IMOD), digital micro-shutter (DMS), time multiplexed optical shutter (TMOS), grating light valve (GLV) and others. The typical structure and fundamental of each display mode are interpreted.     

Visual quality evaluation of large LED displays based on subjective sensory perception

Large light-emitting diode (LED) displays have undergone a great deal of development in recent years. One of their main characteristics is their potential for great diversity in their physical parameters (size, brightness, power consumption, etc.) and in the configuration of the LED pixel arrays. The physical parameters can vary by several orders of magnitude, while the matrix can be organized in discrete real RGB pixels or in several types of virtual pixel distributions such as Bayer, Hexagonal and Diagonal. For this reason, it is particularly difficult to make a complete and exhaustive evaluation of any type of displays based only on objective parameters. In this paper we have developed and used a subjective method for evaluating the image quality of various types of LED displays. The results obtained show that there is not a perfect display solution and that for each particular project it is possible to find an optimal LED matrix solution based on quality performance and the number and distribution of LEDs used (that marks pixel resolution, overall manufacturing cost and power consumption). For displays with the same number of LEDs the array of emitters formed by real pixels are desirable for applications viewed at short distances and for predominantly alphanumeric content, while virtual pixels arrays are advantageous in applications requiring greater viewing distances and a higher content of complex images.     

Interactive stereoscopic displays

Interactive stereo displays allow for the existence of a natural interaction between the user and the stereo images depicted on the display. In the type of display discussed here, this interaction takes the form of tracking the user's head and hand/arm position. Sensing the user's head position allows for the creation of motion parallax information, an immersive depth cue that can be added to the binocular parallax already present in the display. Sensing the user's hand or arm position allows the user to manipulate the spatial attributes of virtual objects and scenes presented on the display, which can enhance spatial reasoning. Moreover, allowing the user to manipulate virtual objects may permit the creation of a sense of spatial relations among elements in the display via proprioception, which may augment the two parallax cues. The congruence among binocular parallax, motion parallax, and proprioception should increase the sense of depth in the display and increase viewing comfort, as well as enhance the ability of our intuitive reasoning system to make reasoned sense out of the perceptual information. These advantages should make interactive stereo displays, which may be classified as a form of cognitive enhancement display, the display of choice in the future.     

A comparative study of mobile map displays in a geographic orientation task

In an ergonomic experiment, different mobile map displays were compared in a simulated geographical orientation task. Subjects had to cross mazes while the corresponding maps were presented on a hand-held display, two helmet-mounted displays (a retinal scanning and a liquid crystal display) or on paper. The simulated mazes were projected on a backlit screen and the subjects could cross them using a joystick. The displays were compared with regard to subjects' speed when crossing the mazes, experienced task difficulty, visual fatigue and simulator sickness. The results show that speed was lowest with the paper map and experienced task difficulty was highest, whereas no significant differences were found between the electronic displays. Visual fatigue and simulator sickness were low and no significant differences were observed between all displays. The conclusion is drawn that all electronic map displays can be used for short time periods (15 - 30 minutes); however, long term effects have to be analysed in future experimental studies.     

3‐D displays — Technologies and testing methods

Abstract— This paper is a review of stereoscopic 3‐D display technologies and testing methods. The first part addresses the different 3‐D displays with focus on technologies. It gives both a background and the logic to group the technologies into categories. A family‐tree chartsummarizes the technology map. This categorization allows for logical grouping of test methods. The second part is a summary of testing procedures developed as part of the ICDM (International Committee for Display Metrology) standards group, affiliated with SID (Society of Information Display). Definitions to key test parameters pertinent to the evaluation of stereoscopic 3‐D displays including formulae development will be presented. This review paper can serve as an introduction to the 3‐D & Stereoscopic Displays chapter of the IDMS (Information Display Measurement Standard) version 1.0 that will be issued by the ICDM group later this year. The IDMS v1.0 will be the successor of the FPDM‐2 from VESA.     

Optical performance characterization of flexible mobile displays

The high interest in the display industry to produce curved or flexible displays for mobile, wearable, and television markets has raised concerns on the performance of displays in their bent state. Flexible display technologies have been developed for this purpose, but their optical characteristics have not been previously reported at various degrees of curvature. The measurement of flexible displays is possible only with special measurement arrangements using common display characterization devices. A conoscope with a working distance of 15 mm was used to demonstrate the curvature dependence of luminance, viewing angle, and color coordinates of the white point of a flexible active‐matrix organic light‐emitting display. The results show that the effect of curvature on the optical characteristics of the display is most evident at the smallest measured bending radii of +/?50 mm and that the effects are most visible when viewing the bent ends of the display, from the central normal vantage point, with uniform curvature along the display.