Practical implementation of a depth‐feeling‐enhanced two‐plane electro‐floating display system using three‐dimensional integral images

Abstract— Although there are numerous types of floating‐image display systems which can project three‐dimensional (3‐D) images into real space through a convex lens or a concave mirror, most of them provide only one image plane in space to the observer; therefore, they lack an in‐depth feeling. In order to enhance a real 3‐D feeling of floating images, a multi‐plane floating display is required. In this paper, a novel two‐plane electro‐floating display system using 3‐D integral images is proposed. One plane for the object image is provided by an electro‐floating display system, and the other plane for the background image is provided with the 3‐D integral imaging system. Consequently, the proposed two‐plane electro‐floating display system, having a 3‐D background, can provide floated images in front of background integral images resulting in a different perspective to the observer. To show the usefulness of the proposed system, experiments were carried out and their results are presented. In addition, the prototype was practically implemented and successfully tested.     

Development of a 42‐in. 2‐D/3‐D switchable display using multi‐view technology for public‐information‐display applications

Abstract— A 42‐in. 2‐D/3‐D switchable display operating in a parallax‐barrier‐type system consisting of liquid‐crystal displays (LCDs) has been developed. The system displays 2‐D images in full resolution, without any degradation to the original 2‐D images, and 3‐D autostereoscopic images with resolutions higher than SVGA with wide viewing zones electrically controlled by the parallax‐barrier system. The system is intended for use in public‐information displays (PIDs), a booming field, and as displays for gaming, medical, and simulation applications.     

Determination of luminance distribution of autostereoscopic 3D displays through calculation of angular profile

Abstract— The luminance distribution of autostereoscopic 3‐D displays using the parallax‐barrier method was simulated by two different calculation methods. The first method directly calculates the total luminance distribution by summing light rays coming from different positions on the imaging display through a parallax barrier at each eye position. The second method first calculates the angular distribution of light rays coming from the imaging display through a parallax barrier and then derives the spatial luminance distribution for each eye position. The two methods resulted in an equivalent distribution. Yet, the second method outperforms the first method in terms of calculating the speed and versatility.     

Prototyping and optical evaluation of 9‐in. OCB time‐division‐multiplexing 18‐view 3‐D display

Abstract— An integral imaging time‐division‐multiplexing 18‐view 3‐D display based on the one‐dimensional integral‐imaging (1‐D‐II) technique using a 9‐in. OCB‐LCD, lenticular sheet, and active shutter has been developed. By simulating a lens shape and a shutter structure and analyzing the light‐beam profile of the increasing‐parallax‐number region to find the best conditions, depth range, and viewing angle were an enhanced and a brighter and flicker‐less 3‐D image with smooth motion parallax was obtained.     

A study of optimal viewing distance in a parallax barrier 3D display

The optimal viewing distance was proposed as a parameter for designing a parallax barrier 3D display. It can be designed based on simple geometric method and by considering the pitches of image display pixels and parallax barrier, or even including the aperture ratios of the image display pixels and parallax barrier. It can be analyzed by using ray tracing method. By considering the optical refraction index of the cover glass, the angular behavior of the system becomes more realistic; however, the geometric method is difficult to be used. We propose a revised method for estimating the view distance and angular behavior. In this paper, we have demonstrated a designated eye position (DEP) for each view and shown that multiple DEPs make a circular curve around the center of the display. We prove the new concept by comparing the optical ray tracing calculations and optical measurement.     

Psychophysical evaluations of a current multi‐view 3‐D display: Its advantages in glossiness reproduction

Abstract— Although two‐view 3‐D displays requiring stereo glasses are on the market, the shape of objects they present is distorted when the observer's head moves. This problem can be solved by using a (passive) multi‐view 3‐D display because such a display can produce motion parallax. Another problem has to do with the surface quality of the presented object, but little is known about the fidelity of such displays as far as the surface quality goes. Previously, it was found that a two‐view 3‐D display has a problem in which glossiness deteriorates when the observer's head moves and that it can be alleviated by using a head tracker, whose data enables the display to produce correct motion parallax and luminance changes when the viewer's head moves. Here, it was determined whether this problem can be solved by using commercially available multi‐view 3‐D displays, whose finite number of viewpoints and certain amount of cross‐talk, however, make luminance changes inexact and smaller than they should be. It was found that this display can solve the problem to a certain extent.     

Multi‐planar plenoptic displays

Multi‐planar plenoptic displays consist of multiple spatially varying light‐emitting and light‐modulating planes. In this work, we introduce a framework to display light field data on this new type of display device. First, we present a mathematical notation that describes each of the layers in terms of the corresponding light transport operators. Next, we explain an algorithm that renders a light field with depth into a given multi‐planar plenoptic display and analyze the approximation error. We show two different physical prototypes that we have designed and built: The first design uses a dynamic parallax barrier and a number of bi‐state (translucent/opaque) screens. The second design uses a beam splitter to co‐locate two pairs of parallax barriers and static image projection screens. We evaluate both designs on a number of different 3D scenes. Finally, we present simulated and real results for different display configurations.     

Invited Paper: Depth reproducibility of multiview depth‐fused 3‐D display

Abstract— A multi‐view depth‐fused 3‐D (DFD) display that provides smooth motion parallax for wide viewing angles is proposed. A conventional DFD display consists of a stack of two transparent emitting screens. It can produce motion parallax for small changes in observation angle, but its viewing zone is rather narrow due to the split images it provides in inclined views. On the other hand, even though multi‐view 3‐D displays have a wide viewing angle, motion parallax in them is discrete, depending on the number of views they show. By applying a stacked structure to multi‐view 3‐D displays, a wide‐viewing‐angle 3‐D display with smooth motion parallax was fabricated. Experimental results confirmed the viewing‐zone connection of DFD displays while the calculated results show the feasibility of stacked multi‐view displays.     

Integral floating‐image display using two lenses with reduced distortion and enhanced depth

Abstract— An integral floating display (IFD) with a long depth range without floating lens distortion is proposed. Two lenses were used to reduce barrel distortion of the floating lens and three‐dimensional (3‐D) image deformation from object‐dependent longitudinal and lateral magnifications in the floating‐display system, combined with an integral imaging display. The distance between the floating lenses is the sum of their focal lengths. In the proposed configuration, lateral and longitudinal magnifications are constant regardless of the distance of the integrated 3‐D images, so the distortions from the distant‐dependent magnifications of the floating lens do not occur with the proposed method. In addition, the proposed floating system expands the depth range of the integral imaging display. As a result, the display can show a correct 3‐D floating image with a large depth range. Experimental results demonstrate that the proposed method successfully displays a 3‐D image without floating lens distortions across a large depth range.     

Design of autostereoscopic two‐view 3D that uses the spherical concave surface and the parallax barrier

Autostereoscopic display where circular concave display was used was investigated in case of the parallax barrier and two‐view 3D. Equation of the barrier pitch of the parallax barrier was derived that depended on the radius of the curved display. Trajectories of the rays coming from the curved display through the parallax barrier were calculated. Calculated distribution of ray trajectories for the autostereoscopic display using curved display showed trends similar to those for the flat display.     

A wide view auto‐stereoscopic 3D display with an eye‐tracking system for enhanced horizontal viewing position and viewing distance

This paper describes the development of auto‐stereoscopic three‐dimensional (3D) display with an eye‐tracking system for not only the X‐axis (right–left) and Y‐axis (up–down) plane directions but also the Z‐axis (forward–backward) direction. In the past, the eye‐tracking 3D system for the XY‐axes plane directions that we had developed had a narrow 3D viewing space in the Z‐axis direction because of occurrence of 3D crosstalk variation on screen. The 3D crosstalk variation on screen was occurred when the viewer's eye position moved back and forth along the Z‐axis direction. The reason was that the liquid crystal (LC) barrier pitch was fixed and the LC barrier was able to control the only barrier aperture position. To solve this problem, we developed the LC barrier that is able to control the barrier pitch as well as the barrier aperture position in real time, corresponding to the viewer's eye position. As a result, the 3D viewing space has achieved to expand up to 320–1016 mm from the display surface in the Z‐axis direction and within a range of ±267 mm in the X‐axis direction. In terms of the Y‐axis direction, the viewing space is not necessary to be considered, because of a stripe‐shaped parallax barrier.     

Dual layered display that presents auto‐stereoscopic 3D images to multiple viewers in arbitrary positions

Dual layered display or also called tensor display that consists of two panels in a stack can present full‐parallax 3D images with high resolution and continuous motion parallax by reconstructing corresponding light ray field within a viewing angle. The depth range where the 3D images can be displayed with reasonable resolution, however, is limited around the panel stack. In this paper, we propose a dual layered display that can present stereoscopic images to multiple viewers located at arbitrary positions in observer space with high resolution and large depth range. Combined with the viewer tracking system, the proposed method provides a practical way to realize high‐resolution large‐depth auto‐stereoscopic 3D display for multiple observers without restriction on the observer position and the head orientation.     

Curved OLED display to effectively enhance natural3D

We studied the stereoscopic effect obtained from a two‐dimensional image without using binocular parallax, which we call “natural3D” (n3D). Unlike a parallax‐based three‐dimensional (3D) display system, n3D causes less tiredness and is free from a decrease of the resolution by half because of image division and viewing position dependence. To make the display with these effects comfortable to use, we conducted statistical tests with sensory evaluation experiments and a quantitative evaluation based on physiological responses. These examinations revealed that the n3D effect can be effectively obtained by using, for example, the characteristics of an organic light‐emitting diode display, such as high contrast and easy bendability. This study discusses optimal display curvatures for displays of different sizes that enhance n3D and reduce tiredness, which are revealed through statistical tests. In addition, we performed an experiment with a frame called an n3D window (n3Dw) that is placed before the display such that a subject views the display through the opening of the frame. We found that the combination of a curve and the n3Dw causes n3D more effectively.     

Circular camera array system for 3‐D displays based on the reconstruction of parallax rays

Abstract— A circular camera system employing an image‐based rendering technique that captures light‐ray data needed for reconstructing three‐dimensional (3‐D) images by using reconstruction of parallax rays from multiple images captured from multiple viewpoints around a real object in order to display a 3‐D image of a real object that can be observed from multiple surrounding viewing points on a 3‐D display is proposed. An interpolation algorithm that is effective in reducing the number of component cameras in the system is also proposed. The interpolation and experimental results which were performed on our previously proposed 3‐D display system based on the reconstruction of parallax rays will be described. When the radius of the proposed circular camera array was 1100 mm, the central angle of the camera array was 40°, and the radius of a real 3‐D object was between 60 and 100 mm, the proposed camera system, consisting of 14 cameras, could obtain sufficient 3‐D light‐ray data to reconstruct 3‐D images on the 3‐D display.     

Multi‐view 3‐D display employing a flat‐panel display with slanted pixel arrangement

Abstract— A flat‐panel display with a slanted subpixel arrangement has been developed for a multi‐view three‐dimensional (3‐D) display. A set of 3M × N subpixels (M × N subpixels for each R, G, and B color) corresponds to one of the cylindrical lenses, which constitutes a lenticular lens, to construct each 3‐D pixel of a multi‐view display that offers M × N views. Subpixels of the same color in each 3‐D pixel have different horizontal positions, and the R, G, and B subpixels are repeated in the horizontal direction. In addition, the ray‐emitting areas of the subpixels within a 3‐D pixel are continuous in the horizontal direction for each color. One of the vertical edges of each subpixel has the same horizontal position as the opposite vertical edge of another subpixel of the same color. Cross‐talk among viewing zones is theoretically zero. This structure is suitable for providing a large number of views. A liquid‐crystal panel having this slanted subpixel arrangement was fabricated to construct a mobile 3‐D display with 16 views and a 3‐D resolution of 256 × 192. A 3‐D pixel is comprised of 12 × 4 subpixels (M = 4 and N = 4). The screen size was 2.57 in.     

3‐D mobile display based on dual‐directional light guides with a fast‐switching liquid‐crystal panel

Abstract— An autostereoscopic display based on dual‐directional light guides with a fast‐switching liquid‐crystal panel was designed and fabricated to provide better 3‐D perception with image qualities comparable to that of 2‐D displays. With two identical micro‐grooved light guides, each with a light‐controlled ability in one direction, two restricted viewing cones are formed to project pairs of parallax images to the viewer's respective eyes sequentially. Crosstalk of less than 10% located within ±8°–±30° and an LC response time of 7.1 msec for a 1.8‐in. LCD panel can yield acceptable 3‐D perceptions at viewing distance of 5.6–23 cm. Moreover, 2‐D/3‐D compatibility is provided in this module.     

Effects of text/background color combination,ambient illuminance,and display type on discriminating performance for young and elderly users

Abstract— This study examined the effects of text/background color combinations (black‐on‐white, red‐on‐white, green‐on‐white, and blue‐on‐white), ambient illuminance (50, 500, and 12,000 lx), and display type (color electronic‐paper displays and conventional transmissive liquid‐crystal displays) on the discriminating performance of young and elderly users. The results showed that when participants used the color e‐paper display, young participants had significantly better discriminating performance than elderly participants under the text/background color combinations of black‐on‐white, green‐on‐white, and blue‐on‐white, whereas no significant difference was present between young and elderly participants under red‐on‐white. When participants used a conventional transmissive LCD, however, there was no significant difference between young and elderly participants under all text/background color‐combination settings. Young participants had substantially better discriminating performance under 500 and 12,000 lx than under 50 lx, whereas elderly participants had the best discriminating performance under 12,000 lx, followed by that under 500 lx, and the worst performance under 50 lx. Participants who used a conventional transmissive LCD had substantially better discriminating performance under 500 and 12,000 lx than under 50 lx. Participants who used the color e‐paper display had the best discriminating performance under 12,000 lx, followed by that under 500 lx, and the worst performance under 50 lx. The results can be the guild for the designers of color e‐paper displays.     

A high‐resolution autostereoscopic display system with a wide viewing angle using an LCOS projector array

Abstract— This study develops an autostereoscopic display based on a multiple miniature projector array to provide a scalable solution for a high‐resolution 3‐D display with large viewing freedom. To minimize distortion and dispersion, and to maximize the modulation transfer function (MTF) of the projection image to optimize 3‐D image quality, a dedicated projection lens and an accurate six‐axis adjusting platform for the miniature projector were designed and fabricated. Image‐blending technology based on a lookup table was adopted to combine images from 30 miniature projectors into a seamless single image. The result was a 35‐in. autostereoscopic display with 60 views ata 30° viewing angle, 90° FOV, and large range of viewing distance. The proposed system exhibits very smooth motion parallax when viewers move around in front of it.     

Floating autostereoscopic display with in situ interaction

Floating three‐dimensional (3D) display implements direct interaction between human hands and virtual 3D images, which offers natural and effective augmented reality interaction. In this study, we propose a novel floating autostereoscopic display, combining head tracking lenticular display with an image projection system, to offer the observers with an accurate 3D image floating in midair without any optical elements between observers and the virtual 3D image. Combined with a gesture recognition device, the proposed system can achieve in situ augmented reality interaction with the floating 3D image. A distortion correction method is developed to achieve 3D display with accurate spatial information. Moreover, a coordinate calibration method is designed to improve the accuracy in the in situ interaction. Experiments were performed to prove the feasibility of the proposed system, and the good results show the potential of human‐computer interaction in medicine and life sciences.     

2‐D/3‐D displays based on switchable lenticulars

Abstract— An attractive concept for 3‐D displays is the one based on LCDs equipped with lenticular lenses. This enables autostereoscopic multiview 3‐D displays without a loss in brightness. A general issue in multiview 3‐D displays is their relatively low spatial resolution because the pixels are divided among the different views. To overcome this problem, we have developed switchable displays, using liquid‐crystal (LC) filled switchable lenticulars. In this way, it is possible to have a high‐brightness 3‐D display capable of fully exploiting the native 2‐D resolution of the underlying LCD. The feasibility of LC‐filled switchable lenticulars was shown in several applications. For applications in which it is advantageous to be able to display 3‐D and 2‐D content simultaneously, a 42‐in. locally switchable prototype having a matrix electrode structure was developed. These displays were realized using cylindrically shaped lenticular lenses in contact with LC. An alternative for these are lenticulars based on gradient‐index (GRIN) LC lenses. Preliminary results for such switchable GRIN lenses are presented as well.