Projection‐type integral 3‐D display with distortion compensation

Abstract— Our research is aimed at developing a spatial‐imaging‐type integral three‐dimensional (3‐D) display based on an integral photography method using an extremely high‐resolution projector. One problem with the projection‐type integral 3‐D display is that geometrical distortion in projected elemental images causes spatial deformation of the displayed 3‐D image. In this study, a general relationship between the geometric distortion of elemental images and the spatial deformation of reconstructed 3‐D images were analyzed. A projection‐type integral 3‐D display with a distortion compensator which corrects the geometrical distortions of projected images in real‐time have been developed. The deformation of the displayed 3‐D images was significantly reduced by the distortion compensation, and the displayed 3‐D images had a resolution of 182 (H) × 140 (V) pixels and a viewing angle of 24.5°.     

Reduced cross‐talk in shutter‐glass‐based stereoscopic LCD

Abstract— It is expected that 3‐D will be the next step in the enhanced viewing experience. At present, there are two competing 3‐D technologies for glasses‐based consumer TVs: active shutter glasses and passive polarized glasses. With the ongoing reduction in response time of liquid‐crystal displays (LCDs), this article will focus on shutter‐glass‐based stereoscopic LCDs. In this paper, the properties of such a display system is described and it is demonstrated that by adding a line‐scanning backlight, the cross‐talk can be reduced to less than 1.4%, allowing for excellent 3‐D portrayal. For images of extreme contrast, this is perceivable, but not judged annoying by a panel of expert viewers. Which characteristics of the display and shutter glasses that should be optimized to create an inexpensive, cross‐talk‐free, 3‐D LCD are discussed.     

Development of a 42‐in. 2‐D/3‐D switchable display using multi‐view technology for public‐information‐display applications

Abstract— A 42‐in. 2‐D/3‐D switchable display operating in a parallax‐barrier‐type system consisting of liquid‐crystal displays (LCDs) has been developed. The system displays 2‐D images in full resolution, without any degradation to the original 2‐D images, and 3‐D autostereoscopic images with resolutions higher than SVGA with wide viewing zones electrically controlled by the parallax‐barrier system. The system is intended for use in public‐information displays (PIDs), a booming field, and as displays for gaming, medical, and simulation applications.     

Invited Paper: Depth reproducibility of multiview depth‐fused 3‐D display

Abstract— A multi‐view depth‐fused 3‐D (DFD) display that provides smooth motion parallax for wide viewing angles is proposed. A conventional DFD display consists of a stack of two transparent emitting screens. It can produce motion parallax for small changes in observation angle, but its viewing zone is rather narrow due to the split images it provides in inclined views. On the other hand, even though multi‐view 3‐D displays have a wide viewing angle, motion parallax in them is discrete, depending on the number of views they show. By applying a stacked structure to multi‐view 3‐D displays, a wide‐viewing‐angle 3‐D display with smooth motion parallax was fabricated. Experimental results confirmed the viewing‐zone connection of DFD displays while the calculated results show the feasibility of stacked multi‐view displays.     

High‐resolution autostereoscopic 3‐D projection display with a space‐dividing iris‐plane shutter

Abstract— A high‐resolution autostereoscopic 3‐D projection display with a polarization‐control space dividing the iris‐plane liquid‐crystal shutter is proposed. The polarization‐control iris‐plane shutter can control the direction of stereo images without reducing the image quality of the microdis‐play. This autostereoscopic 3‐D projection display is 2‐D/3‐D switchable and has a high resolution and high luminance. In addition, it has no cross‐talk between the left and right viewing zones, a simple structure, and the capability to show multi‐view images.     

Depth‐map generation for multi‐view autostereoscopic 3‐D displays based on the SIFT algorithm constrained by boundary

Abstract— A depth‐map estimation method, which converts two‐dimensional images into three‐dimensional (3‐D) images for multi‐view autostereoscopic 3‐D displays, is presented. The proposed method utilizes the Scale Invariant Feature Transform (SIFT) matching algorithm to create the sparse depth map. The image boundaries are labeled by using the Sobel operator. A dense depth map is obtained by using the Zero‐Mean Normalized Cross‐Correlation (ZNCC) propagation matching method, which is constrained by the labeled boundaries. Finally, by using depth rendering, the parallax images are generated and synthesized into a stereoscopic image for multi‐view autostereoscopic 3‐D displays. Experimental results show that this scheme achieves good performances on both parallax image generation and multi‐view autostereoscopic 3‐D displays.     

360°‐viewable cylindrical integral imaging system using a 3‐D/2‐D switchable and flexible backlight

Abstract— A 360°‐viewable cylindrical three‐dimensional (3‐D) display system based on integral imaging has been implemented. The proposed system is composed of a cylindrically arranged electroluminescent (EL) pinhole film, an EL film backlight, a barrier structure, and a transmission‐type flexible display panel. The cylindrically arranged point‐light‐source array, which is generated by the EL pinhole film reconstructs 360°‐viewable virtual 3‐D images at the center of the cylinder. In addition, the proposed system provides 3‐D/2‐D convertibility using the switching of EL pinhole film from a point light source to a surface light source. In this paper, the principle of operation, analysis of the viewing parameters, and the experimental results are presented.     

Circular camera array system for 3‐D displays based on the reconstruction of parallax rays

Abstract— A circular camera system employing an image‐based rendering technique that captures light‐ray data needed for reconstructing three‐dimensional (3‐D) images by using reconstruction of parallax rays from multiple images captured from multiple viewpoints around a real object in order to display a 3‐D image of a real object that can be observed from multiple surrounding viewing points on a 3‐D display is proposed. An interpolation algorithm that is effective in reducing the number of component cameras in the system is also proposed. The interpolation and experimental results which were performed on our previously proposed 3‐D display system based on the reconstruction of parallax rays will be described. When the radius of the proposed circular camera array was 1100 mm, the central angle of the camera array was 40°, and the radius of a real 3‐D object was between 60 and 100 mm, the proposed camera system, consisting of 14 cameras, could obtain sufficient 3‐D light‐ray data to reconstruct 3‐D images on the 3‐D display.     

Altitude control in simulated flight using 3‐D objects and terrain texture

Abstract— In this study, the effects of manipulating the properties of 3‐D objects and terrain texture on the control of altitude in simulated flight has been investigated. 3‐D objects were found to be as effective as terrain texture for controlling altitude, and this result was interpreted as suggesting that both terrain texture and 3‐D objects can serve as effective carriers of information about motion parallax and optical expansion and contraction. The present results, which were obtained using a vertically defined flight task, are inconsistent with the findings of Patterson et al., who reported that 3‐D objects were more effective than terrain texture for controlling a horizontally defined heading task. The present results indicate that, when terrain texture is present, the motion parallax or optical expansion associated with the presence of 3‐D objects does not improve altitude control.     

3‐D mobile display based on dual‐directional light guides with a fast‐switching liquid‐crystal panel

Abstract— An autostereoscopic display based on dual‐directional light guides with a fast‐switching liquid‐crystal panel was designed and fabricated to provide better 3‐D perception with image qualities comparable to that of 2‐D displays. With two identical micro‐grooved light guides, each with a light‐controlled ability in one direction, two restricted viewing cones are formed to project pairs of parallax images to the viewer's respective eyes sequentially. Crosstalk of less than 10% located within ±8°–±30° and an LC response time of 7.1 msec for a 1.8‐in. LCD panel can yield acceptable 3‐D perceptions at viewing distance of 5.6–23 cm. Moreover, 2‐D/3‐D compatibility is provided in this module.     

Depth‐ and viewing‐angle‐enhanced 3‐D/2‐D switchable display system with high contrast ratio using multiple display devices and a lens array

Abstract— An improved 3‐D/2‐D switchable display system with enhanced depth and viewing angle by adding two LCD panels to an integral imaging system has been realized. The proposed system uses the see‐through property of an LCD panel and displays multiple sets of elemental images on the LCD panels to integrate them on multiple locations simultaneously. As a result, the depth of the 3‐D image can be enhanced. For wide viewing angles, the time‐multiplexing method was adopted by displaying mask patterns on the front LCD panel. In addition, another technique to increase the contrast ratio of the proposed system has also been developed. Some experimental results will be provided.     

Psychophysical evaluations of a current multi‐view 3‐D display: Its advantages in glossiness reproduction

Abstract— Although two‐view 3‐D displays requiring stereo glasses are on the market, the shape of objects they present is distorted when the observer's head moves. This problem can be solved by using a (passive) multi‐view 3‐D display because such a display can produce motion parallax. Another problem has to do with the surface quality of the presented object, but little is known about the fidelity of such displays as far as the surface quality goes. Previously, it was found that a two‐view 3‐D display has a problem in which glossiness deteriorates when the observer's head moves and that it can be alleviated by using a head tracker, whose data enables the display to produce correct motion parallax and luminance changes when the viewer's head moves. Here, it was determined whether this problem can be solved by using commercially available multi‐view 3‐D displays, whose finite number of viewpoints and certain amount of cross‐talk, however, make luminance changes inexact and smaller than they should be. It was found that this display can solve the problem to a certain extent.     

Self‐calibration three‐dimensional light field display based on scalable multi‐LCDs

Approach to achieve self‐calibration three‐dimensional (3D) light field display is investigated in this paper. The proposed 3D light field display is constructed up on spliced multi‐LCDs, lens and diaphragm arrays, and directional diffuser. The light field imaging principle, hardware configuration, diffuser characteristic, and image reconstruction simulation are described and analyzed, respectively. Besides the light field imaging, a self‐calibration method is proposed to improve the imaging performance. An image sensor is deployed to capture calibration patterns projected onto and then reflected by the polymer dispersed liquid crystal film, which is attached to and shaped the diffuser. These calibration components are assembled with the display unit and can be switched between display mode and calibration mode. In the calibration mode, the imperfect imaging relations of optical components are captured and calibrated automatically. We demonstrate our design by implementing the prototype of proposed 3D light field display by using modified off‐the‐shelf products. The proposed approach successfully meets the requirement of real application on scalable configuration, fast calibration, large viewing angular range, and smooth motion parallax.     

Practical implementation of a depth‐feeling‐enhanced two‐plane electro‐floating display system using three‐dimensional integral images

Abstract— Although there are numerous types of floating‐image display systems which can project three‐dimensional (3‐D) images into real space through a convex lens or a concave mirror, most of them provide only one image plane in space to the observer; therefore, they lack an in‐depth feeling. In order to enhance a real 3‐D feeling of floating images, a multi‐plane floating display is required. In this paper, a novel two‐plane electro‐floating display system using 3‐D integral images is proposed. One plane for the object image is provided by an electro‐floating display system, and the other plane for the background image is provided with the 3‐D integral imaging system. Consequently, the proposed two‐plane electro‐floating display system, having a 3‐D background, can provide floated images in front of background integral images resulting in a different perspective to the observer. To show the usefulness of the proposed system, experiments were carried out and their results are presented. In addition, the prototype was practically implemented and successfully tested.     

Influence of 3‐D cross‐talk on qualified viewing spaces in two‐ and multi‐view autostereoscopic displays

Abstract— To estimate the qualified viewing spaces for two‐ and multi‐view autostereoscopic displays, the relationship between image quality (image comfort, annoying ghost image, depth perception) and various pairings between 3‐D cross‐talk in the left and right views are studied subjectively using a two‐view autostereoscopic display and test charts for the left and right views with ghost images due to artificial 3‐D cross‐talk. The artificial 3‐D cross‐talk was tuned to simulate the view in the intermediate zone of the viewing spaces. It was shown that the stereoscopic images on a two‐view autostereoscopic display cause discomfort when they are observed by the eye in the intermediate zone between the viewing spaces. This is because the ghost image due to large 3‐D cross‐talk in the intermediate zone elicits different depth perception from the depth induced by the original images for the left and right views, so the observer's depth perception is confused. Image comfort is also shown to be better for multi‐views, especially the width of the viewing space, which is narrower than the interpupillary distance, where the parallax of the cross‐talking image is small.     

Double‐viewing‐zone integral imaging 3D display without crosstalk based on a tilted barrier array

We propose an integral imaging (II) three‐dimensional (3D) display using a tilted barrier array and a stagger microlens array. The tilted barrier array consists of two orthogonally polarized sheets. In the stagger microlens array, the center of the microlens has p/2 shift with the elemental image along the horizontal direction, where p is the pitch of the microlens. The proposed II 3D display produces two different viewing zones and each of them is almost equal to that of the conventional II 3D display, and it has no crosstalk. We verify the feasibility of the proposed II 3D display in the simulation results.     

Guidelines for an improved quality of experience in 3‐D TV and 3‐D mobile displays

Stereoscopic (3‐D) movies have become widely popular all over the world. In addition, 3‐D TVs and mobile devices have already been introduced to the consumer market. However, while some manufacturers are introducing 3‐D cameras and movie studios are using proprietary solutions, there are no guidelines for consistently capturing high‐quality stereoscopic content. In this paper, a comprehensive stereoscopic image and video database with content captured at various distances from the camera lenses and under different lighting conditions will be presented. Subjective tests to assess the perceived 3‐D quality of these videos and images, which were shown on displays of different sizes, have been conducted. In addition, the horizontal parallax of the content was adjusted to verify via subjective tests whether this change could increase the viewer's quality of experience. Finally, guidelines of acquisition distances between the cameras and the real scene will be published.     

Measurement and analysis on the accommodation responses to real‐mode,virtual‐mode,and focused‐mode integral imaging display

Integral imaging has three display modes including real mode, virtual mode, and focused mode, and each mode has unique display characteristics. In this paper, the accommodation responses to the three‐dimensional (3‐D) targets reconstructed by each mode of the integral imaging display were measured and statistically analyzed. Through the least square method, standard deviation analysis, and t‐test analysis, we found that the accommodation responses to the 3‐D target reconstructed by the focused mode was more similar to that of the real target on the same depth position. Moreover, the closer to the central depth plane was, the steadier accommodation response 3‐D targets could provide. These statistical analysis results are helpful to the design of integral imaging display device.     

A wide view auto‐stereoscopic 3D display with an eye‐tracking system for enhanced horizontal viewing position and viewing distance

This paper describes the development of auto‐stereoscopic three‐dimensional (3D) display with an eye‐tracking system for not only the X‐axis (right–left) and Y‐axis (up–down) plane directions but also the Z‐axis (forward–backward) direction. In the past, the eye‐tracking 3D system for the XY‐axes plane directions that we had developed had a narrow 3D viewing space in the Z‐axis direction because of occurrence of 3D crosstalk variation on screen. The 3D crosstalk variation on screen was occurred when the viewer's eye position moved back and forth along the Z‐axis direction. The reason was that the liquid crystal (LC) barrier pitch was fixed and the LC barrier was able to control the only barrier aperture position. To solve this problem, we developed the LC barrier that is able to control the barrier pitch as well as the barrier aperture position in real time, corresponding to the viewer's eye position. As a result, the 3D viewing space has achieved to expand up to 320–1016 mm from the display surface in the Z‐axis direction and within a range of ±267 mm in the X‐axis direction. In terms of the Y‐axis direction, the viewing space is not necessary to be considered, because of a stripe‐shaped parallax barrier.     

The effect of stereoscopic viewing in a word‐search task with a layered background

Abstract— The benefits of stereoscopic viewing were explored in searching in words superimposed over a background. In the first experiment, eight participants searched for text in a normal 2‐D display, a 3‐D display using a parallax barrier, and a darkened 2‐D display of equivalent brightness to the 3‐D display. Word‐search performance was significantly faster for the bright 2‐D display vs. the 3‐D display, but when brightness was controlled, performance on the 3‐D display was better relative to the 2‐D (dim) display. In a second experiment, the effect of floating text vs. sinking background disparity was assessed across four background conditions. Twenty participants saw only the floating‐text (FT) condition and 20 participants saw only the sinking‐background (SB) condition. Performance of the SB group was significantly better than that of FT group, and the advantage of SB disparity was greater with the more‐complex backgrounds. Thus, when a parallax‐barrier 3‐D display is used to view text or other figural information overlaid on a background, it is proposed that the layer of primary interest (foreground) should be displayed with zero disparity (on the physical display surface) with the secondary layer (background) appearing to be sunk beneath that surface.