Invited Paper: Depth reproducibility of multiview depth‐fused 3‐D display

Abstract— A multi‐view depth‐fused 3‐D (DFD) display that provides smooth motion parallax for wide viewing angles is proposed. A conventional DFD display consists of a stack of two transparent emitting screens. It can produce motion parallax for small changes in observation angle, but its viewing zone is rather narrow due to the split images it provides in inclined views. On the other hand, even though multi‐view 3‐D displays have a wide viewing angle, motion parallax in them is discrete, depending on the number of views they show. By applying a stacked structure to multi‐view 3‐D displays, a wide‐viewing‐angle 3‐D display with smooth motion parallax was fabricated. Experimental results confirmed the viewing‐zone connection of DFD displays while the calculated results show the feasibility of stacked multi‐view displays.     

Projection‐based head‐tracking 3‐D displays

Abstract— This paper describes the construction and operation of four 3‐D displays in which each display produces two images for each eye and thus fits into the category of projection‐based binocular stereoscopic displays. The four 3‐D displays described are pico‐projector‐based, liquid‐ crystal—on—silicon (LCOS) conventional projector‐based, 120‐Hz digital‐light‐processor (DLP) projector‐ based, and the HELIUM3D system. In the first three displays, images are produced on a direct‐view LCD whose conventional backlight is replaced with a projection illumination source that is controlled by a multi‐user head tracker; novel steering optics direct the projector output to regions referred to as exit pupils located at the viewers' eyes. In the HELIUM3D display, the image information is supplied by a horizontally scanned, fast, light valve whose output is controlled by a spatial light modulator (SLM) to direct images to the appropriate viewers' eyes. The current statu s and the multimodal potential of the HELIUM3D display are described.     

Depth‐ and viewing‐angle‐enhanced 3‐D/2‐D switchable display system with high contrast ratio using multiple display devices and a lens array

Abstract— An improved 3‐D/2‐D switchable display system with enhanced depth and viewing angle by adding two LCD panels to an integral imaging system has been realized. The proposed system uses the see‐through property of an LCD panel and displays multiple sets of elemental images on the LCD panels to integrate them on multiple locations simultaneously. As a result, the depth of the 3‐D image can be enhanced. For wide viewing angles, the time‐multiplexing method was adopted by displaying mask patterns on the front LCD panel. In addition, another technique to increase the contrast ratio of the proposed system has also been developed. Some experimental results will be provided.     

Optical characterization of autostereoscopic 3‐D displays

Abstract— Display‐measurement methods different from conventional 2‐D display measurements are needed for verifying the optical characteristics of autostereoscopic (3‐D) displays and for comparing different 3‐D display technologies. Industry is lacking standardized measurement methods, and the reported results can not always be compared. The selected set of characteristics discussed in this paper and partly defining the quality of the 3‐D experience are crosstalk, viewing freedom, and optimum viewing distance. Also, more conventional display characteristics such as luminance are discussed, since the definitions for these characteristics in 3‐D mode usually differ from those used for the 2D displays. We have investigated how these chosen 3‐D display characteristics can be objectively measured from transmissive two‐view and multiview 3‐D displays. The scope of this article is to generally define those basic characteristics as well as the different measurement methods. Most of the 3‐D characteristics can be derived from the luminance and colors versus the viewing angle. Either a conoscopic or a goniometric measurement system can be used, as long as the angular and stray‐light properties are suitable and known. The characteristics and methods are currently discussed in the display‐quality standardization forums.     

Cross‐talk acceptability in natural still images for different (auto)stereoscopic display technologies

Abstract— One of the most annoying distortions in (auto)stereoscopic displays is probably cross‐talk, visible as double edges, which is mainly caused by an imperfect separation of left‐ and right‐eye images. For different types of three‐dimensional (3‐D) displays, cross‐talk is caused by different origins, which could result in different levels of perceived image distortion. To evaluate the influence of (auto)stereoscopic display technology on cross‐talk perception, optical measurements and subjective assessments were performed with three different types of 3‐D displays. It is shown with natural still images that the 3‐D display technology with the lowest luminance and contrast level tolerates the highest level of cross‐talk, while still maintaining an acceptable image‐quality level.     

Objective evaluation of qualified viewing spaces for near‐to‐eye and autostereoscopic two‐view displays

Abstract— Virtual‐image (near‐to‐eye) and two‐view autostereoscopic (3‐D) displays share similar optical properties in the comfortable user position for viewing. In this paper, the definitions and criteria of qualified viewing space (QVS) and qualified stereoscopic viewing space (QSVS) are discussed. Due to the complex nature of these viewing spaces, the related presumptions and the required optical characteristics and their measurements are specified. The effects of different display and observer parameters, such as interpupillary distance, to the resulting viewing spaces are discussed. Finally, real measurement data of two autostereoscopic display devices are presented.     

A photographic technique for assessing the viewing‐angle performance of liquid‐crystal displays

Abstract— Liquid‐crystal displays (LCDs) have notable variation in luminance and perceived contrast as a function of the angle from which they are viewed. Though this is an important performance issue for LCDs, most evaluation techniques for assessing this variation have been limited to laboratory settings. This study demonstrates the use of a photographic technique for such an evaluation. The technique is based on an actively cooled charge‐coupled‐device (CCD) detector in combination with a macro lens covering a circular angular range (θ) of ±42.5°. The camera was used to evaluate the luminance and perceived contrast properties of an LCD. Uniform field images corresponding to 17 equally spaced gray‐scale values in the digital driving level (DDL) range of the display system were acquired. The 12‐bit gray‐scale digital images produced by the camera were converted to luminance units (cd/m²) via the measured luminance vs. DDL response function of the camera. The changes in perceived contrast as a function of viewing angle were derived from the Barten model of the gray‐scale response of the human‐visual system using the methods proposed by the AAPM TG18 Report. The results of this photographic technique were compared to measurements acquired from a similar display using a Fourier‐optics‐based luminance meter. The results of the two methods generally agreed to within 5%. The photographic methods used were found to be accurate and robust for in‐field assessment of the angular response of LCDs over the FOV of the camera.     

Angular dependence of the performance of stereoscopic liquid‐crystal‐display (LCD) television using shutter glasses (SG)

Abstract— 3‐D cross‐talk typically represents the ratio of image overlap between the left and right views. For stereoscopic LCDs using shutter‐glasses technology, 3‐D cross‐talk for stereoscopic LCD TV with a diagonal size of 46 in. and vertical alignment (VA) mode was measured to change from 1% to 10% when the stereoscopic display is rotated around the vertical axis. Input signals consist of the left and right images that include patterns of different amounts of binocular disparity and various gray levels. Ghost‐like artifacts are observed. Furthermore, intensities of these artifacts are observed to change as the stereoscopic display is rotated about the vertical axis. The temporal luminance of the LCD used in stereoscopic TV was found to be dependent on the viewing direction and can be considered as one cause of the phenomenon of angular dependence of performance for stereoscopic displays.     

Efficiency analysis for multi‐view spatially multiplexed autostereoscopic 2‐D/3‐D displays

Abstract— The wide‐viewing freedom often requested by users of autostereoscopic displays can be delivered by spatial multiplexing of multiple views in which a sequence of images is directed into respective directions by a suitable autostereoscopic optical system. This gives rise to two important design considerations — the optical efficiency and the resolution efficiency of the device. Optical efficiency is particularly important in portable devices such as cell phones. A comparison is given between lens and barrier systems for various spatial multiplexing arrangements. Parallax‐barrier displays suffer from reduced optical efficiency as the number of views presented increases whereas throughput efficiency is independent of the number of views for lens displays. An autostereoscopic optical system is presented for the emerging class of highly efficient polarizer‐free displays. Resolution efficiency can be evaluated by investigating quantitative and subjective comparisons of resolution losses and pixel appearance in each 3‐D image. Specifically, 2.2‐in.‐diagonal 2‐D/3‐D panel performance has been assessed using Nyquist boundaries, human‐visual contrast‐sensitivity models, and autostereoscopic‐display optical output simulations. Four‐view vertical Polarization‐Activated Microlens technology with either QVGA mosaic or VGA striped pixel arrangements is a strong candidate for an optimum compromise between display brightness, viewing angle, and 3‐D pixel appearance.     

An integral‐imaging three‐dimensional display with wide viewing angle

Abstract— The viewing angle and flipping areas of a conventional integral‐imaging three‐dimensional (3‐D) display were analyzed. The pitches of the elemental image and micro‐lens are identical. The more micro‐lenses used, the smaller the viewing angle becomes and the wider the flipping areas become. In this paper, an improved integral‐imaging 3‐D display is presented. The pitch of the elemental image is larger than that of the micro‐lens. The single‐viewing angles of all micro‐lenses converge and there are no flipping areas at the optimal viewing distance. Computational reconstructions of improved and conventional integral imaging were carried out, and experimental results demonstrate that improved integral‐imaging 3‐D displays have a wider viewing angle than the conventional ones and do not have flipping areas at the optimal viewing distance.     

Viewing‐angle characterization of reflective‐type liquid‐crystal displays by using an ellipsoidal mirror and a two‐dimensional CCD camera

A new photometry to perform the viewing‐angle characterization for reflective‐type LCDs has been developed. The optics consists of a rotating ellipsoidal mirror and a 2‐D CCD camera. The information obtained by this photometry includes the viewing‐angle characteristics of reflectance, contrast ratio, and chromaticity coordinates, which are comparable to gonioscopic photometry in terms of accuracy. Both the illuminating polar angle and azimuth angle can be scanned. The measurement time for this method is as short as that for conoscopic photometry when using a 2‐D CCD camera. An instrument equipped with light‐polarizing devices is already available. If analytic software was available, viewing‐angle characterization could be determined by a polarization analysis.     

Dual layered display that presents auto‐stereoscopic 3D images to multiple viewers in arbitrary positions

Dual layered display or also called tensor display that consists of two panels in a stack can present full‐parallax 3D images with high resolution and continuous motion parallax by reconstructing corresponding light ray field within a viewing angle. The depth range where the 3D images can be displayed with reasonable resolution, however, is limited around the panel stack. In this paper, we propose a dual layered display that can present stereoscopic images to multiple viewers located at arbitrary positions in observer space with high resolution and large depth range. Combined with the viewer tracking system, the proposed method provides a practical way to realize high‐resolution large‐depth auto‐stereoscopic 3D display for multiple observers without restriction on the observer position and the head orientation.     

Characterization of crosstalk in stereoscopic display devices

Many different types of stereoscopic display devices are used for commercial and research applications. Stereoscopic displays offer the potential to improve performance in detection tasks for medical imaging diagnostic systems. Due to the variety of stereoscopic display technologies, it remains unclear how these compare with each other for detection and estimation tasks. Different stereo devices have different performance trade‐offs due to their display characteristics. Among them, crosstalk is known to affect observer perception of 3D content and might affect detection performance. We measured and report the detailed luminance output and crosstalk characteristics for three different types of stereoscopic display devices. We recorded the effect of other issues on recorded luminance profiles such as viewing angle, use of different eye wear, and screen location. Our results show that the crosstalk signature for viewing 3D content can vary considerably when using different types of 3D glasses for active stereo displays. We also show that significant differences are present in crosstalk signatures when varying the viewing angle from 0 degrees to 20 degrees for a stereo mirror 3D display device. Our detailed characterization can help emulate the effect of crosstalk in conducting computational observer image quality assessment evaluations that minimize costly and time‐consuming human reader studies.     

Reduced cross‐talk in shutter‐glass‐based stereoscopic LCD

Abstract— It is expected that 3‐D will be the next step in the enhanced viewing experience. At present, there are two competing 3‐D technologies for glasses‐based consumer TVs: active shutter glasses and passive polarized glasses. With the ongoing reduction in response time of liquid‐crystal displays (LCDs), this article will focus on shutter‐glass‐based stereoscopic LCDs. In this paper, the properties of such a display system is described and it is demonstrated that by adding a line‐scanning backlight, the cross‐talk can be reduced to less than 1.4%, allowing for excellent 3‐D portrayal. For images of extreme contrast, this is perceivable, but not judged annoying by a panel of expert viewers. Which characteristics of the display and shutter glasses that should be optimized to create an inexpensive, cross‐talk‐free, 3‐D LCD are discussed.     

Development of a 42‐in. 2‐D/3‐D switchable display using multi‐view technology for public‐information‐display applications

Abstract— A 42‐in. 2‐D/3‐D switchable display operating in a parallax‐barrier‐type system consisting of liquid‐crystal displays (LCDs) has been developed. The system displays 2‐D images in full resolution, without any degradation to the original 2‐D images, and 3‐D autostereoscopic images with resolutions higher than SVGA with wide viewing zones electrically controlled by the parallax‐barrier system. The system is intended for use in public‐information displays (PIDs), a booming field, and as displays for gaming, medical, and simulation applications.     

Laser‐based multi‐user 3‐D display

Abstract— The development of a multi‐user stereoscopic display that does not require the use of special glasses (autostereoscopic), and that enables a large degree of freedom of viewer movement and requires only the minimum amount of information (a stereo pair) for the displays described. The optics comprise an RGB holographic laser projector that is controlled by the output of a multi‐target head‐position head tracker, an optical assembly that converts the projector output into steerable exit pupils, and a screen assembly comprising a single liquid‐crystal display (LCD) and image multiplexing screen. A stereo image pair is produced on the LCD by simultaneously displaying left and right images on alternate rows of pixels. Novel steering optics that replace the conventional backlight are used to direct viewing regions, referred to as exit pupils, to the appropriate viewers' eyes. The results obtained from the first version of the display, where the illumination source consists of several thousand white LEDs, are given and the current status of the latest prototype being constructed on the basis of these results is described. The work indicates that a laser‐based head‐tracking display can provide the basis for the next generation of 3‐D display.     

High‐resolution autostereoscopic 3‐D projection display with a space‐dividing iris‐plane shutter

Abstract— A high‐resolution autostereoscopic 3‐D projection display with a polarization‐control space dividing the iris‐plane liquid‐crystal shutter is proposed. The polarization‐control iris‐plane shutter can control the direction of stereo images without reducing the image quality of the microdis‐play. This autostereoscopic 3‐D projection display is 2‐D/3‐D switchable and has a high resolution and high luminance. In addition, it has no cross‐talk between the left and right viewing zones, a simple structure, and the capability to show multi‐view images.     

Super multi‐view 3D displays reduce conflict between accommodative and vergence responses

A conflict between accommodation and vergence is one possible cause of visual fatigue and discomfort while viewing conventional three‐dimensional displays. Previous studies have proposed the super multi‐view (SMV) display technique to solve the vergence–accommodation conflict, in which two or more parallax images enter the pupil of the eye with highly directional rays. We simultaneously measured accommodative, vergence, and pupillary responses to SMV three‐dimensional displays to examine whether they can reduce the conflict. For comparison, responses to two‐view stereo images and real objects were also measured. The results show that the range of the accommodative response was increased by the SMV images compared with the two‐view images. The slope of the accommodation–vergence response function for the SMV images was similar to that for the real objects rather than the two‐view images. We also found that enhancement of the accommodative range by the SMV images is noticeable with binocular viewing, indicating that vergence‐induced accommodation plays an important role in viewing SMV displays. These results suggest that SMV displays induced a more natural accommodative response than did conventional, two‐view stereo displays. As a result, SMV displays reduced the vergence–accommodation conflict.     

A high‐contrast front‐projection display system optimizing the projected light‐angle range

Abstract— The problem with front‐projection displays is that the screen contrast ratio decreases under bright‐ambient conditions. To overcome this problem, the design of a special screen, composed of the diffuser whose diffusing property shows top‐hat characteristics and a sawtooth reflector, is proposed. The screen diffuses the incident image light arriving at a projection‐angle range that is a lower‐angle range than the viewing‐angle range, and reflects the ambient light out of the viewing‐angle range. In this paper, the projection‐angle range and the viewing‐angle range was optimized to improve the contrast ratio of a front‐projection display. As a result, a special screen with the above‐mentioned diffusing property was realized, and a high‐quality front‐projection display with a high contrast ratio, even in a bright room, was achieved.     

Influence of 3‐D cross‐talk on qualified viewing spaces in two‐ and multi‐view autostereoscopic displays

Abstract— To estimate the qualified viewing spaces for two‐ and multi‐view autostereoscopic displays, the relationship between image quality (image comfort, annoying ghost image, depth perception) and various pairings between 3‐D cross‐talk in the left and right views are studied subjectively using a two‐view autostereoscopic display and test charts for the left and right views with ghost images due to artificial 3‐D cross‐talk. The artificial 3‐D cross‐talk was tuned to simulate the view in the intermediate zone of the viewing spaces. It was shown that the stereoscopic images on a two‐view autostereoscopic display cause discomfort when they are observed by the eye in the intermediate zone between the viewing spaces. This is because the ghost image due to large 3‐D cross‐talk in the intermediate zone elicits different depth perception from the depth induced by the original images for the left and right views, so the observer's depth perception is confused. Image comfort is also shown to be better for multi‐views, especially the width of the viewing space, which is narrower than the interpupillary distance, where the parallax of the cross‐talking image is small.