Full‐parallax autostereoscopic display with scalable lateral resolution using overlaid multiple projection

Abstract— A method to increase the viewing resolution of an autostereoscopic display without increasing the density of microlenses is proposed. Multiple projectors are used for the projection images to be focused and overlaid on a common plane in the air behind the microlens array. The multiple overlaid projection images yield multiple light spots inside the region of each elemental lenslet of the microlens array. This feature provides scalable high‐resolution images by increasing the number of projectors. Based on the proposed method, a prototype display that includes 15 projectors was designed and built. 3‐D images were successfully reproduced on the prototype display with full parallax and a wide viewing angle of 70°.     

Practical implementation of a depth‐feeling‐enhanced two‐plane electro‐floating display system using three‐dimensional integral images

Abstract— Although there are numerous types of floating‐image display systems which can project three‐dimensional (3‐D) images into real space through a convex lens or a concave mirror, most of them provide only one image plane in space to the observer; therefore, they lack an in‐depth feeling. In order to enhance a real 3‐D feeling of floating images, a multi‐plane floating display is required. In this paper, a novel two‐plane electro‐floating display system using 3‐D integral images is proposed. One plane for the object image is provided by an electro‐floating display system, and the other plane for the background image is provided with the 3‐D integral imaging system. Consequently, the proposed two‐plane electro‐floating display system, having a 3‐D background, can provide floated images in front of background integral images resulting in a different perspective to the observer. To show the usefulness of the proposed system, experiments were carried out and their results are presented. In addition, the prototype was practically implemented and successfully tested.     

Crosstalk‐free dual‐view integral imaging display

We propose a crosstalk‐free dual‐view integral imaging display. It is composed of a display panel, a barrier array, and a micro‐lens array. The central barrier is located at the vertical central axes of the display panel and the micro‐lens array to split the element image array and the viewing zone. Moreover, other barriers are located at the margins of the elemental images and corresponding micro‐lenses to eliminate the crosstalk. The lights emitting from the left and right half of the element image array are modulated by the left and right half of the micro‐lens array to reconstruct the right and left viewing zones, respectively. A prototype of the proposed dual‐view integral imaging display is developed, and good experimental results agree well with the theory.     

Tabletop integral imaging 3D display system based on annular point light source

When the viewers sitting around the table observe 3D images, the viewing direction is generally oblique and the viewpoints should be distributed as annular. In this paper, a tabletop integral imaging (II) three-dimensional (3D) display system based on annular point light sources is demonstrated, which can present 3D images to multiple viewers in a standard annular viewing area with oblique viewing direction. The proposed system consists of annular point light sources, a Fresnel lens, a lens array, a two-dimensional (2D) display panel, and a diffuser screen. Each point light source illuminates the Fresnel lens to form parallel light and then illuminates the lens array and the display panel. A viewing sub-area is generated at the position of the diffuser screen, in which the 3D images can be viewed. Multiple viewing sub-areas are created in a way of time-division multiplexing to form a 360° annular viewing area. Compared with the previous tabletop 3D display, the viewing area can be concentrated at an oblique angle near the tabletop. The experimental results demonstrate the feasibility of the tabletop II 3D display system.     

Fabrication of pinhole/micro‐lens array for improving resolution of integral imaging 3‐D display

In this paper, we present a new fabrication of micro‐lens array (MLA) with pinhole array—pinhole/micro‐lens array (P/MLA) for integral imaging 3‐D display (II), which combine lithography and ink‐jet printing. A black circular groove array (BCGA) is used as pinhole array, and laser 3‐D microscope and a homemade setup have been used for the characterization of P/MLA. The results show that high‐precision P/MLA can be obtained using BCGA as templates. By controlling the driving voltage at different steps, the distance between nozzle and substrate, as well as the number of liquid droplets, P/MLA with smooth morphology, different sizes, good repeatability of geometry parameters, great uniformity of focusing, and good converging performance can be achieved. For demonstration, P/MLA with curvature, focal length, numerical aperture, and F‐number of 815.8 μm, 1.60 mm, 0.1311, and 3.8 are applied for the reconstruction in II, exhibiting good reconstruction performance with high resolution, and BCGA reduces the influence of stray light on II and improves the quality of the reconstructed image.     

Double‐viewing‐zone integral imaging 3D display without crosstalk based on a tilted barrier array

We propose an integral imaging (II) three‐dimensional (3D) display using a tilted barrier array and a stagger microlens array. The tilted barrier array consists of two orthogonally polarized sheets. In the stagger microlens array, the center of the microlens has p/2 shift with the elemental image along the horizontal direction, where p is the pitch of the microlens. The proposed II 3D display produces two different viewing zones and each of them is almost equal to that of the conventional II 3D display, and it has no crosstalk. We verify the feasibility of the proposed II 3D display in the simulation results.     

High‐quality direct‐view display combining multiple integral 3D images

This paper proposes a method for combining multiple integral three‐dimensional (3D) images using direct‐view displays to obtain high‐quality results. A multi‐image combining optical system (MICOS) is used to enlarge and combine multiple integral 3D images without gaps. An optical design with a simple lens configuration that does not require a diffuser plate prevents the deterioration in resolution resulting from lens arrangement errors and the diffuser plate. An experiment was performed to compare a previously developed method with the proposed method, and the latter showed a significant improvement in image quality. A method for expanding the effective viewing angle of the proposed optical design was also developed, and its effectiveness was confirmed experimentally. A prototype device of the proposed optical design was constructed using a high‐density organic light‐emitting diode (OLED) panel with 8K resolution and 1058 ppi pixel density to achieve 311 (H) × 175 (V) elemental images, a viewing angle of 20.6° in both the horizontal and vertical directions, and a display size of 9.1 in. In addition, the proposed optical design enabled making device considerably thinner, ie, with a thickness of only 47 mm.     

Projection‐type integral 3‐D display with distortion compensation

Abstract— Our research is aimed at developing a spatial‐imaging‐type integral three‐dimensional (3‐D) display based on an integral photography method using an extremely high‐resolution projector. One problem with the projection‐type integral 3‐D display is that geometrical distortion in projected elemental images causes spatial deformation of the displayed 3‐D image. In this study, a general relationship between the geometric distortion of elemental images and the spatial deformation of reconstructed 3‐D images were analyzed. A projection‐type integral 3‐D display with a distortion compensator which corrects the geometrical distortions of projected images in real‐time have been developed. The deformation of the displayed 3‐D images was significantly reduced by the distortion compensation, and the displayed 3‐D images had a resolution of 182 (H) × 140 (V) pixels and a viewing angle of 24.5°.     

360°‐viewable cylindrical integral imaging system using a 3‐D/2‐D switchable and flexible backlight

Abstract— A 360°‐viewable cylindrical three‐dimensional (3‐D) display system based on integral imaging has been implemented. The proposed system is composed of a cylindrically arranged electroluminescent (EL) pinhole film, an EL film backlight, a barrier structure, and a transmission‐type flexible display panel. The cylindrically arranged point‐light‐source array, which is generated by the EL pinhole film reconstructs 360°‐viewable virtual 3‐D images at the center of the cylinder. In addition, the proposed system provides 3‐D/2‐D convertibility using the switching of EL pinhole film from a point light source to a surface light source. In this paper, the principle of operation, analysis of the viewing parameters, and the experimental results are presented.     

Implementation of polarization‐multiplexed tiled projection integral imaging system

Abstract— A 40‐in. tiled projection integral imaging system has been implemented, adopting a polarization‐multiplexing technique. The system is composed of two full‐high‐definition (HD) projectors, a time‐varying polarizer, a polarization preserving screen, polarization films, a lens array, and a control unit. An elemental image set is projected using two full‐HD projectors to enhance the resolution of the system. The viewing region of the system is increased by using a polarization switching method. The polarization state of the elemental image set is changed by the time‐varying polarizer, and the elemental image set is diffused by the polarization preserving screen. The elemental image set with a preserved polarization state forms a three‐dimensional image with increased viewing angle by the integration of a lens array with polarization films. A 60‐in. tiled projection integral imaging system was also demonstrated using four full‐HD projectors.     

A YC‐separation‐type projector: High dynamic range with double modulation

Abstract— An experimental projector that features double modulation to obtain high‐resolution (4096 × 2160 pixels) and high‐dynamic‐range images has been developed. Although a conventional projector contains three modulators for red, green, and blue and outputs light after combining the modulated light from these three sources, our projector has an additional modulator for luminance that modulates the combined RGB modulated light. It can display high‐resolution color images by combining three low‐resolution panels for chrominance modulation and one high‐resolution panel for luminance modulation. In addition, the dynamic range is dramatically improved because the double‐modulation scheme minimizes black levels in projected images. The projector demonstrates an extremely high dynamic range of 1.1 million to 1 and 10‐bit tone reproduction.     

Self‐calibration three‐dimensional light field display based on scalable multi‐LCDs

Approach to achieve self‐calibration three‐dimensional (3D) light field display is investigated in this paper. The proposed 3D light field display is constructed up on spliced multi‐LCDs, lens and diaphragm arrays, and directional diffuser. The light field imaging principle, hardware configuration, diffuser characteristic, and image reconstruction simulation are described and analyzed, respectively. Besides the light field imaging, a self‐calibration method is proposed to improve the imaging performance. An image sensor is deployed to capture calibration patterns projected onto and then reflected by the polymer dispersed liquid crystal film, which is attached to and shaped the diffuser. These calibration components are assembled with the display unit and can be switched between display mode and calibration mode. In the calibration mode, the imperfect imaging relations of optical components are captured and calibrated automatically. We demonstrate our design by implementing the prototype of proposed 3D light field display by using modified off‐the‐shelf products. The proposed approach successfully meets the requirement of real application on scalable configuration, fast calibration, large viewing angular range, and smooth motion parallax.     

A 23‐in. full‐panel‐resolution autostereoscopic LCD with a novel directional backlight system

Abstract— An autostereoscopic display that shows stereoscopic images with full‐panel resolution has been developed,¹ but it has a problem in terms of unit size. To resolve this problem, a new directional backlight system was developed, and it was applied to a prototype autostereoscopic LCD. The backlight system has two light sources — one for the right eye and the another for the left eye — and an elliptically shaped mirror that controls the direction of light from the light sources. The LCD uses a field‐sequential method which re‐writes an image for one eye and one for the other eye at a frame rate of 120 Hz, and the light sources alternately blink in synchronization with each frame so that the LCD shows full‐panel‐resolution stereoscopic images without flicker. In this paper, the new backlight system is described. The backlight system is effective for large screen such as 23 in. on the diagonal. By using this backlight system, the prototype LCD achieved practible unit size, brightness over the entire screen, and cross‐talk.     

An integral‐imaging three‐dimensional display with wide viewing angle

Abstract— The viewing angle and flipping areas of a conventional integral‐imaging three‐dimensional (3‐D) display were analyzed. The pitches of the elemental image and micro‐lens are identical. The more micro‐lenses used, the smaller the viewing angle becomes and the wider the flipping areas become. In this paper, an improved integral‐imaging 3‐D display is presented. The pitch of the elemental image is larger than that of the micro‐lens. The single‐viewing angles of all micro‐lenses converge and there are no flipping areas at the optimal viewing distance. Computational reconstructions of improved and conventional integral imaging were carried out, and experimental results demonstrate that improved integral‐imaging 3‐D displays have a wider viewing angle than the conventional ones and do not have flipping areas at the optimal viewing distance.     

Integral floating‐image display using two lenses with reduced distortion and enhanced depth

Abstract— An integral floating display (IFD) with a long depth range without floating lens distortion is proposed. Two lenses were used to reduce barrel distortion of the floating lens and three‐dimensional (3‐D) image deformation from object‐dependent longitudinal and lateral magnifications in the floating‐display system, combined with an integral imaging display. The distance between the floating lenses is the sum of their focal lengths. In the proposed configuration, lateral and longitudinal magnifications are constant regardless of the distance of the integrated 3‐D images, so the distortions from the distant‐dependent magnifications of the floating lens do not occur with the proposed method. In addition, the proposed floating system expands the depth range of the integral imaging display. As a result, the display can show a correct 3‐D floating image with a large depth range. Experimental results demonstrate that the proposed method successfully displays a 3‐D image without floating lens distortions across a large depth range.     

Circular camera array system for 3‐D displays based on the reconstruction of parallax rays

Abstract— A circular camera system employing an image‐based rendering technique that captures light‐ray data needed for reconstructing three‐dimensional (3‐D) images by using reconstruction of parallax rays from multiple images captured from multiple viewpoints around a real object in order to display a 3‐D image of a real object that can be observed from multiple surrounding viewing points on a 3‐D display is proposed. An interpolation algorithm that is effective in reducing the number of component cameras in the system is also proposed. The interpolation and experimental results which were performed on our previously proposed 3‐D display system based on the reconstruction of parallax rays will be described. When the radius of the proposed circular camera array was 1100 mm, the central angle of the camera array was 40°, and the radius of a real 3‐D object was between 60 and 100 mm, the proposed camera system, consisting of 14 cameras, could obtain sufficient 3‐D light‐ray data to reconstruct 3‐D images on the 3‐D display.     

Depth‐enhanced integral‐imaging 3D display using different optical path lengths by polarization devices or mirror barrier array

Abstract— Depth‐enhanced integral three‐dimensional (3D) imaging using different optical path lengths by using a polarization selective mirror pair or mirror barrier array is proposed. In the proposed approach, the enhancement of image depth is achieved by repositioning two types of elemental image planes, thus effectively two central depth planes are obtained. One of the two implementation methods makes use of the two‐arm structure that has different optical path lengths and polarization‐selective mirrors. The other utilizes the mirror barrier array. The primary advantage of the method with polarization devices is that we can observe 3D images that maintain some level of viewing resolution with a large depth difference without any mechanical moving part. The mirror barrier array has the advantage of the compact thickness. We demonstrated and verified our proposals experimentally.     

The design and optimization of lens array for LED backlight in LCD imaging engine of helmet‐mounted display

The light‐emitting diode has become the mainstream lightsource for backlight in the liquid crystal display imaging engine of helmet‐mounted display. The paper proposes a secondary‐optics‐based design to increase the luminance and obtain a uniform illumination. Based on a point lightsource, a single double‐freeform‐surface lens is firstly designed. Then an optimization is performed according to the theory of edge‐ray to improve the uniformity for planar source. As a result, the uniformity reaches 83.4% in a circular illumination with a diameter of 8 mm. Then the lens is cut and four rectangular lenses are combined to form a lens array. But the combination leads to a non‐uniformity. So a method of optimizing the light energy distribution on the target surface is proposed. Finally, the designed lens array is manufactured. The practical measurement results show that the luminance increases by 96.4% compared with the traditional backlight and that the non‐uniformity slightly decreases by 0.86%. The lens array designed in this paper presents high practicability for applications in helmet‐mounted display.     

Viewing angle enhanced integral imaging display based on double‐micro‐lens array

A viewing angle enhanced integral imaging display, which consists of a double microlens array, and a display panel is proposed. The double microlens array includes a convex microlens array and a concave microlens array. The display panel is used to display original elemental image array. The convex microlens array, located near the display panel, is used to provide a virtual elemental image array for the concave microlens array. The concave microlens array, located far away from the display panel, is used to display integral images with the virtual elemental image array. Compared with the original elemental image, the pitch for each virtual elemental image is magnified by the corresponding convex microlens. As a result, the viewing angle is expanded. Simulations based on ray‐tracing are performed and the results agree well with the theory.     

Design of a compact projection display for the visualization of 3‐D images using polarization sensitive eyeglasses

Abstract— A compact optical architecture of a three‐dimensional projection display that simultaneously generates two full‐color images with an orthogonal polarization state is presented. The minimal size of the optical engine was investigated and a compact illumination system using light‐emitting diodes as light sources was designed. The effect of dichroic mirrors in the illumination path on the stereoscopic images was also investigted.