Circular camera array system for 3‐D displays based on the reconstruction of parallax rays

Abstract— A circular camera system employing an image‐based rendering technique that captures light‐ray data needed for reconstructing three‐dimensional (3‐D) images by using reconstruction of parallax rays from multiple images captured from multiple viewpoints around a real object in order to display a 3‐D image of a real object that can be observed from multiple surrounding viewing points on a 3‐D display is proposed. An interpolation algorithm that is effective in reducing the number of component cameras in the system is also proposed. The interpolation and experimental results which were performed on our previously proposed 3‐D display system based on the reconstruction of parallax rays will be described. When the radius of the proposed circular camera array was 1100 mm, the central angle of the camera array was 40°, and the radius of a real 3‐D object was between 60 and 100 mm, the proposed camera system, consisting of 14 cameras, could obtain sufficient 3‐D light‐ray data to reconstruct 3‐D images on the 3‐D display.     

Stereoscopic 3‐D display with optical correction for the reduction of the discrepancy between accommodation and convergence

Abstract— This paper describes a method for reducing the discrepancy between accommodation and convergence when viewing stereoscopic 3‐D images. The method uses a newly developed stereoscopic 3‐D display system with a telecentric optical system and a mobile LCD. The examination of a mono‐focal lens showed that a correction lens having the appropriate refractive power and conditions for presenting stereoscopic 3‐D images clearly reduces the discrepancy between accommodation and convergence. The authors also developed a stereoscopic 3‐D display that uses dynamic optical correction to reduce the discrepancy between accommodation and convergence. The display equalizes the theoretical points of accommodation and convergence. The purpose of the development was to expand the regeneration range of a stereoscopic 3‐D image having the appropriate accommodation. An evaluation of the developed display showed that it resolves the discrepancy between convergence and accommodation.     

Dual layered display that presents auto‐stereoscopic 3D images to multiple viewers in arbitrary positions

Dual layered display or also called tensor display that consists of two panels in a stack can present full‐parallax 3D images with high resolution and continuous motion parallax by reconstructing corresponding light ray field within a viewing angle. The depth range where the 3D images can be displayed with reasonable resolution, however, is limited around the panel stack. In this paper, we propose a dual layered display that can present stereoscopic images to multiple viewers located at arbitrary positions in observer space with high resolution and large depth range. Combined with the viewer tracking system, the proposed method provides a practical way to realize high‐resolution large‐depth auto‐stereoscopic 3D display for multiple observers without restriction on the observer position and the head orientation.     

A high optical efficiency 3D/2D convertible integral imaging display

We propose a high optical efficiency three‐dimensional (3D)/two‐dimensional (2D) convertible integral imaging display by using a pinhole array on a reflective polarizer. The 3D mode is realized by adopting a pinhole array on a reflective polarizer to generate a point light source array. Three‐dimensional/2D convertible feature is realized by electrically controlling a polarization switcher. The reflective polarizer can reflect the light that has the orthogonal polarization direction with the reflective polarizer and transmit the light that has the same polarization direction with the reflective polarizer. The reflected light is recycled, so the optical efficiencies for both 3D and 2D modes are enhanced. In the practical experiments, the optical efficiencies of the proposed integral imaging display increase by 8.04 times and 1.65 times in 3D and 2D modes comparing with the conventional integral imaging display that has no light recycle, respectively.     

Measuring 3D crosstalk uniformity and its influence on contrast ratio

An array detector was employed to characterize the crosstalk and contrast ratio uniformity of three‐dimensional (3D) displays. The measurement method is described and demonstrated on a stereoscopic display with passive glasses. The resulting high resolution spatial uniformity maps enable a comprehensive statistical characterization of the display and provide a useful visual assessment tool. The statistical uniformity data are used to evaluate the crosstalk dependence on viewing conditions (such as viewing distance), and show the degradation in display performance that could not be captured with a discrete spot measurement. The measurement method was also employed to examine the influence of crosstalk on contrast ratio. It is shown that for some 3D displays, the crosstalk uniformity can dominate the perceived contrast. A metric is proposed that defines the maximal crosstalk contribution to the perceived contrast for 3D images with small features. The summary parameters extracted from the uniformity maps can be utilized to define the boundary viewing conditions needed to maintain minimum image quality.     

2‐D/3‐D switchable displays

Abstract— In this paper, the design of a lenticular‐based 2‐D/3‐D display for mobile applications is described. This display combines look‐around capability with good 3‐D resolution. In order to allow high‐resolution datagraphic applications, a concept based on actively switched lenses has been developed. A very noticeable problem for such displays is the occurrence of dark bands. Despite slanting the lenticular and defocusing the lens, banding becomes unacceptable when the display is viewed from an angle. As a solution, fractional viewing systems to reduce the banding intensity by almost two orders of magnitude is introduced. The resulting 3‐D display can be viewed from any horizontal direction without banding.     

Depth‐ and viewing‐angle‐enhanced 3‐D/2‐D switchable display system with high contrast ratio using multiple display devices and a lens array

Abstract— An improved 3‐D/2‐D switchable display system with enhanced depth and viewing angle by adding two LCD panels to an integral imaging system has been realized. The proposed system uses the see‐through property of an LCD panel and displays multiple sets of elemental images on the LCD panels to integrate them on multiple locations simultaneously. As a result, the depth of the 3‐D image can be enhanced. For wide viewing angles, the time‐multiplexing method was adopted by displaying mask patterns on the front LCD panel. In addition, another technique to increase the contrast ratio of the proposed system has also been developed. Some experimental results will be provided.     

Invited Paper: Depth reproducibility of multiview depth‐fused 3‐D display

Abstract— A multi‐view depth‐fused 3‐D (DFD) display that provides smooth motion parallax for wide viewing angles is proposed. A conventional DFD display consists of a stack of two transparent emitting screens. It can produce motion parallax for small changes in observation angle, but its viewing zone is rather narrow due to the split images it provides in inclined views. On the other hand, even though multi‐view 3‐D displays have a wide viewing angle, motion parallax in them is discrete, depending on the number of views they show. By applying a stacked structure to multi‐view 3‐D displays, a wide‐viewing‐angle 3‐D display with smooth motion parallax was fabricated. Experimental results confirmed the viewing‐zone connection of DFD displays while the calculated results show the feasibility of stacked multi‐view displays.     

Design conditions for attractive reality in mobile‐type 3‐D display

Abstract— An autostereoscopic 3‐D display suitable for the mobile environment is prototyped and evaluated. First, the required conditions for a 3‐D display in a mobile environment are considered, and the three major requirements are clarified: small size, viewing‐position flexibility, and application support. An application of a mobile‐type 3‐D display should be different from that of a large‐sized 3‐D display because a mobile‐type 3‐D display cannot realize the feeling of immersion while large‐sized 3‐D displays can realize it easily. From this assumption, it is considered that it is important to realize the feeling to handle a 3‐D image. Three types of 3‐D displays are developed to satisfy these requirements. They are subjectively evaluated to confirm their attractiveness. Results of the tests show that intuitive interaction can increase the reality of the 3‐D image in the sense of unity and also can improve the solidity and depth impression of the 3‐D image.     

Influence of depth and 3D crosstalk on blur in multi‐view 3D displays

Current 3D crosstalk equation was defined from the characteristics of 3D display using glasses. This equation is not suitable for multi‐view 3D display with larger view number as it gives the inappropriately large value. In 3D display using eyeglass, double images occur at large depth. But, in multi‐view 3D display with larger view number, blur occurs to larger width for the larger depth. Hence, blur phenomenon of multi‐view 3D display was investigated to understand the unique characteristics of multi‐view 3D display. For this purpose, ray tracing S/W was used to simulate 3D display image seen at the designed viewing distance, to calculate the relative luminance distribution, and to quantify the relation between blur and depth. Calculated results showed that incomplete image separation caused the overlap of multiple view images and the blur. Blur edge width (BEW) was proportional to the horizontal disparity and related to the depth. BEWR = (BEW) / (binocular disparity) was newly defined, and its usefulness for 3D characterization was investigated. BEW and BEWR might be useful as new measuring items to characterize multi‐view 3D display regarding 3D crosstalk.     

Practical implementation of a depth‐feeling‐enhanced two‐plane electro‐floating display system using three‐dimensional integral images

Abstract— Although there are numerous types of floating‐image display systems which can project three‐dimensional (3‐D) images into real space through a convex lens or a concave mirror, most of them provide only one image plane in space to the observer; therefore, they lack an in‐depth feeling. In order to enhance a real 3‐D feeling of floating images, a multi‐plane floating display is required. In this paper, a novel two‐plane electro‐floating display system using 3‐D integral images is proposed. One plane for the object image is provided by an electro‐floating display system, and the other plane for the background image is provided with the 3‐D integral imaging system. Consequently, the proposed two‐plane electro‐floating display system, having a 3‐D background, can provide floated images in front of background integral images resulting in a different perspective to the observer. To show the usefulness of the proposed system, experiments were carried out and their results are presented. In addition, the prototype was practically implemented and successfully tested.     

360°‐viewable cylindrical integral imaging system using a 3‐D/2‐D switchable and flexible backlight

Abstract— A 360°‐viewable cylindrical three‐dimensional (3‐D) display system based on integral imaging has been implemented. The proposed system is composed of a cylindrically arranged electroluminescent (EL) pinhole film, an EL film backlight, a barrier structure, and a transmission‐type flexible display panel. The cylindrically arranged point‐light‐source array, which is generated by the EL pinhole film reconstructs 360°‐viewable virtual 3‐D images at the center of the cylinder. In addition, the proposed system provides 3‐D/2‐D convertibility using the switching of EL pinhole film from a point light source to a surface light source. In this paper, the principle of operation, analysis of the viewing parameters, and the experimental results are presented.     

Optical simulation for cross‐talk evaluation and improvement of autostereoscopic 3‐D displays with a projector array

Abstract— Multi‐view spatial‐multiplexed autostereoscopic 3‐D displays normally use a 2‐D image source and divide the pixels to generate perspective images. Due to the reduction in the resolution of each perspective image for a large view number, a super‐high‐resolution 2‐D image source is required to achieve 3‐D image quality close to the standard of natural vision. This paper proposes an approach by tiling multiple projection images with a low magnification ratio from a microdisplay to resolve the resolution issue. Placing a lenticular array in front of the tiled projection image can lead to an autostereoscopic display. Image distortion and cross‐talk issues resulting from the projection lens and pixel structure of the microdisplay have been addressed with proper selection of the active pixel and adequate pixel grouping and masking. Optical simulation has shown that a 37‐in. 12‐view autostereoscopic display with a full‐HD (1920 × 1080) resolution can be achieved with the proposed 3‐D architecture.     

Curved OLED display to effectively enhance natural3D

We studied the stereoscopic effect obtained from a two‐dimensional image without using binocular parallax, which we call “natural3D” (n3D). Unlike a parallax‐based three‐dimensional (3D) display system, n3D causes less tiredness and is free from a decrease of the resolution by half because of image division and viewing position dependence. To make the display with these effects comfortable to use, we conducted statistical tests with sensory evaluation experiments and a quantitative evaluation based on physiological responses. These examinations revealed that the n3D effect can be effectively obtained by using, for example, the characteristics of an organic light‐emitting diode display, such as high contrast and easy bendability. This study discusses optimal display curvatures for displays of different sizes that enhance n3D and reduce tiredness, which are revealed through statistical tests. In addition, we performed an experiment with a frame called an n3D window (n3Dw) that is placed before the display such that a subject views the display through the opening of the frame. We found that the combination of a curve and the n3Dw causes n3D more effectively.     

Projection‐type integral 3‐D display with distortion compensation

Abstract— Our research is aimed at developing a spatial‐imaging‐type integral three‐dimensional (3‐D) display based on an integral photography method using an extremely high‐resolution projector. One problem with the projection‐type integral 3‐D display is that geometrical distortion in projected elemental images causes spatial deformation of the displayed 3‐D image. In this study, a general relationship between the geometric distortion of elemental images and the spatial deformation of reconstructed 3‐D images were analyzed. A projection‐type integral 3‐D display with a distortion compensator which corrects the geometrical distortions of projected images in real‐time have been developed. The deformation of the displayed 3‐D images was significantly reduced by the distortion compensation, and the displayed 3‐D images had a resolution of 182 (H) × 140 (V) pixels and a viewing angle of 24.5°.     

Switching directional BLUs for full‐resolution auto‐stereoscopic 3D/2D and 2D/3D LCDs

Directional backlight unit (BLU) design concept was applied to realize full‐resolution field alternate auto‐stereoscopic liquid crystal displays (LCDs) with built‐in 3D/2D and 2D/3D. The application‐oriented BLU design requires priority in realizing 2D mode or 3D mode. The switching characteristic of BLU with two confronting illuminating sets was applied to build 2D mode into 3D display and 3D mode into 2D display. An LCD with 2D mode as primary function requires higher double‐sided luminance uniformity than 3D mode. On the other hand, an LCD with 3D mode requires higher single‐sided luminance uniformity than 2D mode. For increasing the double‐sided luminance uniformity for 2D mode as a primary function of the display, the former BLU design was realized by using uniform prismatic structure, that is, using uniform bilateral prismatic structure with a cross section of isosceles triangle on the back surface of the light‐guide plate. For increasing single‐sided luminance uniformity for 3D mode as a primary function of the display, the latter was realized by using graded angle design, that is, unilateral prisms with a cross section of a scalene triangle on the back surface of the light‐guide plate. The LCDs of small‐sized‐handheld game devices and still cameras were fabricated using the 3D/2D and 2D/3D displays.     

High‐visibility 2‐D/3‐D LCD with HDDP arrangement and its optical characterization methods

Abstract— A 3.1‐in.‐diagonal 2‐D/3‐D LCD with a novel pixel arrangement, called horizontally double‐density pixels (HDDP), for high‐quality 3‐D images has been developed. 3‐D visibility has been improved by broadening the qualified stereoscopic viewing space (QSVS) where high‐quality 3‐D images can be seen. In order to evaluate the QSVS, optical characterization methods, based on the ergonomics for stereoscopy, such as 3‐D crosstalk, interocular luminance difference and 3‐D moiré have been proposed. The implementation results show that these methods can correctly evaluate high‐visibility autostereoscopic displays.     

Development of a 42‐in. 2‐D/3‐D switchable display using multi‐view technology for public‐information‐display applications

Abstract— A 42‐in. 2‐D/3‐D switchable display operating in a parallax‐barrier‐type system consisting of liquid‐crystal displays (LCDs) has been developed. The system displays 2‐D images in full resolution, without any degradation to the original 2‐D images, and 3‐D autostereoscopic images with resolutions higher than SVGA with wide viewing zones electrically controlled by the parallax‐barrier system. The system is intended for use in public‐information displays (PIDs), a booming field, and as displays for gaming, medical, and simulation applications.     

A 2D–3D integrated tabletop environment for multi‐user collaboration

This paper proposes a novel tabletop display system for natural communication and flexible information sharing. The proposed system is specifically designed to integrate two‐dimensional (2D) and three‐dimensional (3D) user interfaces by using a multi‐user stereoscopic display, IllusionHole. The proposed system takes awareness into consideration and provides both 2D and 3D information and user interfaces. On the display, a number of standard Windows desktop environments are provided as personal workspaces, as well as a shared workspace with a dedicated graphical user interface. In the personal workspaces, users can simultaneously access existing applications and data, and exchange information between personal and shared workspaces. In this way, the proposed system can seamlessly integrate personal, shared, 2D, and 3D workspaces with conventional user interfaces and effectively support communication and information sharing. To demonstrate the capabilities of the proposed display system, a modeling application was implemented. A preliminary experiment confirmed the effectiveness of this system. Copyright © 2006 John Wiley & Sons, Ltd.     

High‐resolution autostereoscopic 3‐D projection display with a space‐dividing iris‐plane shutter

Abstract— A high‐resolution autostereoscopic 3‐D projection display with a polarization‐control space dividing the iris‐plane liquid‐crystal shutter is proposed. The polarization‐control iris‐plane shutter can control the direction of stereo images without reducing the image quality of the microdis‐play. This autostereoscopic 3‐D projection display is 2‐D/3‐D switchable and has a high resolution and high luminance. In addition, it has no cross‐talk between the left and right viewing zones, a simple structure, and the capability to show multi‐view images.