High‐resolution autostereoscopic 3‐D projection display with a space‐dividing iris‐plane shutter

Abstract— A high‐resolution autostereoscopic 3‐D projection display with a polarization‐control space dividing the iris‐plane liquid‐crystal shutter is proposed. The polarization‐control iris‐plane shutter can control the direction of stereo images without reducing the image quality of the microdis‐play. This autostereoscopic 3‐D projection display is 2‐D/3‐D switchable and has a high resolution and high luminance. In addition, it has no cross‐talk between the left and right viewing zones, a simple structure, and the capability to show multi‐view images.     

Invited Paper: Depth reproducibility of multiview depth‐fused 3‐D display

Abstract— A multi‐view depth‐fused 3‐D (DFD) display that provides smooth motion parallax for wide viewing angles is proposed. A conventional DFD display consists of a stack of two transparent emitting screens. It can produce motion parallax for small changes in observation angle, but its viewing zone is rather narrow due to the split images it provides in inclined views. On the other hand, even though multi‐view 3‐D displays have a wide viewing angle, motion parallax in them is discrete, depending on the number of views they show. By applying a stacked structure to multi‐view 3‐D displays, a wide‐viewing‐angle 3‐D display with smooth motion parallax was fabricated. Experimental results confirmed the viewing‐zone connection of DFD displays while the calculated results show the feasibility of stacked multi‐view displays.     

Effect of number of views to the viewing experience with autostereoscopic 3‐D displays

Abstract— The observers' 3‐D viewing experience when the way the content is created and shown on an autostereoscopic 3‐D display alternate is evaluated. The observer's depth impression, and the perceived contour accuracy and image naturalness or peskiness of the content shown on a 3‐D display, has been investigated. In addition, the consequences of the way the content is created to the results from the optical characterization for the same display have been studied. The alternation of the content was realized in two different ways. Firstly, the number of views for creating the image was varied. Two, five, and 14 views were used; the main focus being on testing the same display and treating it as an ordinary two‐view and a 14‐view display with inter‐sub‐view crosstalk. Also, the intermediate condition where five views with non‐uniform view‐specific crosstalk were used has been investigated. Secondly, the way the content is created was varied by using images with computer‐generated content and photos. The effect of these parameters on viewing experience as such and especially the effect of 3‐D crosstalk on the viewing experience were studied.     

Using cross‐talk simulation to predict the performance of anaglyph 3‐D glasses

Abstract— The anaglyph 3‐D method is a widely used technique for presenting stereoscopic 3‐D images. Its primary advantage is that it will work on any full‐color display (LCDs, plasmas, and even prints) and only requires that the user view the anaglyph image using a pair of anaglyph 3‐D glasses with usually one lens tinted red and the other lens tinted cyan (blue plus green). A common image‐quality problem of anaglyph 3‐D images is high levels of cross‐talk — the incomplete isolation of the left and right image channels such that each eye sees a “ghost” of the opposite perspective view. An anaglyph cross‐talk simulation model has been developed which allows the amount of anaglyph cross‐talk to be estimated based on the spectral characteristics of the anaglyph glasses and the display. The model is validated using a visual cross‐talk ranking test which indicates good agreement. The model is then used to consider two scenarios for the reduction of cross‐talk in anaglyph systems and finds that a considerable reduction is likely to be achieved by using spectrally pure displays. The study also finds that the 3‐D performance of commercial anaglyph glasses can be significantly better than handmade anaglyph glasses.     

Depth‐map generation for multi‐view autostereoscopic 3‐D displays based on the SIFT algorithm constrained by boundary

Abstract— A depth‐map estimation method, which converts two‐dimensional images into three‐dimensional (3‐D) images for multi‐view autostereoscopic 3‐D displays, is presented. The proposed method utilizes the Scale Invariant Feature Transform (SIFT) matching algorithm to create the sparse depth map. The image boundaries are labeled by using the Sobel operator. A dense depth map is obtained by using the Zero‐Mean Normalized Cross‐Correlation (ZNCC) propagation matching method, which is constrained by the labeled boundaries. Finally, by using depth rendering, the parallax images are generated and synthesized into a stereoscopic image for multi‐view autostereoscopic 3‐D displays. Experimental results show that this scheme achieves good performances on both parallax image generation and multi‐view autostereoscopic 3‐D displays.     

Angular dependence of the performance of stereoscopic liquid‐crystal‐display (LCD) television using shutter glasses (SG)

Abstract— 3‐D cross‐talk typically represents the ratio of image overlap between the left and right views. For stereoscopic LCDs using shutter‐glasses technology, 3‐D cross‐talk for stereoscopic LCD TV with a diagonal size of 46 in. and vertical alignment (VA) mode was measured to change from 1% to 10% when the stereoscopic display is rotated around the vertical axis. Input signals consist of the left and right images that include patterns of different amounts of binocular disparity and various gray levels. Ghost‐like artifacts are observed. Furthermore, intensities of these artifacts are observed to change as the stereoscopic display is rotated about the vertical axis. The temporal luminance of the LCD used in stereoscopic TV was found to be dependent on the viewing direction and can be considered as one cause of the phenomenon of angular dependence of performance for stereoscopic displays.     

Optical simulation for cross‐talk evaluation and improvement of autostereoscopic 3‐D displays with a projector array

Abstract— Multi‐view spatial‐multiplexed autostereoscopic 3‐D displays normally use a 2‐D image source and divide the pixels to generate perspective images. Due to the reduction in the resolution of each perspective image for a large view number, a super‐high‐resolution 2‐D image source is required to achieve 3‐D image quality close to the standard of natural vision. This paper proposes an approach by tiling multiple projection images with a low magnification ratio from a microdisplay to resolve the resolution issue. Placing a lenticular array in front of the tiled projection image can lead to an autostereoscopic display. Image distortion and cross‐talk issues resulting from the projection lens and pixel structure of the microdisplay have been addressed with proper selection of the active pixel and adequate pixel grouping and masking. Optical simulation has shown that a 37‐in. 12‐view autostereoscopic display with a full‐HD (1920 × 1080) resolution can be achieved with the proposed 3‐D architecture.     

MUTED: Multi‐user 3‐D display

Abstract— Research described in this paper encompasses the design and building of glasses‐free (autostereoscopic) displays that utilize a direct‐view liquid‐crystal display whose backlight is provided by a projector and novel steering optics. This is controlled by the output of a multi‐user head‐position tracker. As the displays employ spatial multiplexing on a liquid‐crystal‐display screen, they are inherently 2‐D/3‐D switchable with 2‐D being achieved by simply displaying the same image in the left and right channels. Two prototypes are described in this paper; one incorporating a holographic projector and the other a conventional LCOS projector. The LCOS projector version addresses the limitations of brightness, cross‐talk, banding in the images, and laser stability that occur in the holographic projector version. The future development is considered and a comparison between the prototypes and with other 3‐D displays is given.     

A common approach to characterizing autostereoscopic and polarization‐based 3‐D displays

Abstract— Autostereoscopic and polarization‐based stereoscopic 3‐D displays recreate 3‐D images by providing different images in the two eyes of an observer. This aim is achieved differently for these two families of 3‐D displays. It is shown that viewing‐angle measurements can be applied to characterize both types of displays. Viewing‐angle luminance measurements are made at different locations on the display surface for each view emitted by the display. For autostereoscopic displays, a Fourier‐optics instrument with an ultra‐high‐angular‐resolution VCMaster3D is used. For polarization‐based displays, a standard Fourier‐optics instrument with additional glass filters is used. Then, what will be seen by an observer in front of the display is computed. Monocular and binocular quality criteria (left‐ and right‐eye contrast, 3‐D contrast) was used to quantify the ability to perceive depth for any observer position. Qualified monocular and binocular viewing spaces (QMVS and QBVS) are deduced. Precise 3‐D characteristics are derived such as maximum 3‐D contrast, optical viewing freedom in each direction, color shifts, and standard contrast. A quantitative comparison between displays of all types becomes possible.     

Two‐parallax‐barriers‐based autostereoscopic liquid‐crystal display without cross‐talk

Abstract— An autostereoscopic liquid‐crystal display (LCD) consists of two parallax barriers and an LCD including a liquid‐crystal panel, and a backlight panel is proposed. Parallax barrier 1 is located between the backlight panel and the liquid‐crystal panel, and Parallax barrier 2 is located between the liquid‐crystal panel and viewers. The operation principle of the autostereoscopic display and the calculation equations for the parallax barriers are described in detail. The autostereoscopic LCD was developed and produces high‐quality stereoscopic images without cross‐talk at the optimal viewing distance and less cross‐talk than a conventional one based on one parallax barrier at other viewing distances.     

Efficiency analysis for multi‐view spatially multiplexed autostereoscopic 2‐D/3‐D displays

Abstract— The wide‐viewing freedom often requested by users of autostereoscopic displays can be delivered by spatial multiplexing of multiple views in which a sequence of images is directed into respective directions by a suitable autostereoscopic optical system. This gives rise to two important design considerations — the optical efficiency and the resolution efficiency of the device. Optical efficiency is particularly important in portable devices such as cell phones. A comparison is given between lens and barrier systems for various spatial multiplexing arrangements. Parallax‐barrier displays suffer from reduced optical efficiency as the number of views presented increases whereas throughput efficiency is independent of the number of views for lens displays. An autostereoscopic optical system is presented for the emerging class of highly efficient polarizer‐free displays. Resolution efficiency can be evaluated by investigating quantitative and subjective comparisons of resolution losses and pixel appearance in each 3‐D image. Specifically, 2.2‐in.‐diagonal 2‐D/3‐D panel performance has been assessed using Nyquist boundaries, human‐visual contrast‐sensitivity models, and autostereoscopic‐display optical output simulations. Four‐view vertical Polarization‐Activated Microlens technology with either QVGA mosaic or VGA striped pixel arrangements is a strong candidate for an optimum compromise between display brightness, viewing angle, and 3‐D pixel appearance.     

Crosstalk‐free dual‐view integral imaging display

We propose a crosstalk‐free dual‐view integral imaging display. It is composed of a display panel, a barrier array, and a micro‐lens array. The central barrier is located at the vertical central axes of the display panel and the micro‐lens array to split the element image array and the viewing zone. Moreover, other barriers are located at the margins of the elemental images and corresponding micro‐lenses to eliminate the crosstalk. The lights emitting from the left and right half of the element image array are modulated by the left and right half of the micro‐lens array to reconstruct the right and left viewing zones, respectively. A prototype of the proposed dual‐view integral imaging display is developed, and good experimental results agree well with the theory.     

Characterizing image quality of autostereoscopic displays by using the maximum luminance at each viewing position

A metric of the 3D image quality of autostereoscopic displays based on optical measurements is proposed. This metric uses each view's luminance contrast, which is defined as the ratio of maximum luminance at each viewing position to total luminance at that position. Conventional metrics of the autostereoscopic display based on crosstalk, which uses “wanted” and “unwanted” lights. However, in case of the multiple‐views‐type autostereoscopic displays, it is difficult to distinguish exactly which lights are wanted lights and which are unwanted lights. This paper assumes that the wanted light has a maximum luminance at the good stereoscopic viewing position, and the unwanted light also has a maximum luminance at the worst pseudo‐stereoscopic viewing position. By using the maximum luminance that is indexed by view number of the autostereoscopic display, the proposed method enables characterizing stereoscopic viewing conditions without using wanted/unwanted light. A 3D image quality metric called “stereo luminance contrast,” the average of both eyes' contrast, is proposed. The effectiveness of the proposed metric is confirmed by the results of optical measurement analyses of different types of autostereoscopic displays, such as the two‐view, scan‐backlight, multi‐view, and integral.     

Cross‐talk acceptability in natural still images for different (auto)stereoscopic display technologies

Abstract— One of the most annoying distortions in (auto)stereoscopic displays is probably cross‐talk, visible as double edges, which is mainly caused by an imperfect separation of left‐ and right‐eye images. For different types of three‐dimensional (3‐D) displays, cross‐talk is caused by different origins, which could result in different levels of perceived image distortion. To evaluate the influence of (auto)stereoscopic display technology on cross‐talk perception, optical measurements and subjective assessments were performed with three different types of 3‐D displays. It is shown with natural still images that the 3‐D display technology with the lowest luminance and contrast level tolerates the highest level of cross‐talk, while still maintaining an acceptable image‐quality level.     

A high‐resolution autostereoscopic display system with a wide viewing angle using an LCOS projector array

Abstract— This study develops an autostereoscopic display based on a multiple miniature projector array to provide a scalable solution for a high‐resolution 3‐D display with large viewing freedom. To minimize distortion and dispersion, and to maximize the modulation transfer function (MTF) of the projection image to optimize 3‐D image quality, a dedicated projection lens and an accurate six‐axis adjusting platform for the miniature projector were designed and fabricated. Image‐blending technology based on a lookup table was adopted to combine images from 30 miniature projectors into a seamless single image. The result was a 35‐in. autostereoscopic display with 60 views ata 30° viewing angle, 90° FOV, and large range of viewing distance. The proposed system exhibits very smooth motion parallax when viewers move around in front of it.     

Objective evaluation of qualified viewing spaces for near‐to‐eye and autostereoscopic two‐view displays

Abstract— Virtual‐image (near‐to‐eye) and two‐view autostereoscopic (3‐D) displays share similar optical properties in the comfortable user position for viewing. In this paper, the definitions and criteria of qualified viewing space (QVS) and qualified stereoscopic viewing space (QSVS) are discussed. Due to the complex nature of these viewing spaces, the related presumptions and the required optical characteristics and their measurements are specified. The effects of different display and observer parameters, such as interpupillary distance, to the resulting viewing spaces are discussed. Finally, real measurement data of two autostereoscopic display devices are presented.     

A high resolution multi‐view 3D display using switchable liquid crystal lens

A 4.4‐inch 2D/3D switchable full high definition (FHD) six‐view 3D display with 3D resolution greater than 170 ppi has been accomplished. In addition to adopting low temperature polysilicon technology (LTPS), which is most suitable for high resolution displays, a new RGBW pixel arrangement using four‐square sub‐pixels has been devised. In 2D, a resolution greater than 500 ppi, accompanied with high luminance, has been achieved. A new liquid crystal lens (LCL) has been exploited for 2D/3D switching. By employing a special multielectrode structure and dedicated manufacturing process, an optical focal ratio less than 20%, which is essential for low 3D cross talk for a six‐view 3D display, has been attained by adopting the LCL. In the vertical direction of the display, there is no cross talk increase when the viewing position is changed because of the new pixel structure. The strong focal strength of the LCL combined with a revised high‐density multi‐view design give rise to a wide 3D viewing angle greater than 20 degrees in the horizontal direction and minimum cross talk less than 10%.     

Analysis of longitudinal viewing freedom of reduced‐view super multi‐view display and increased longitudinal viewing freedom using eye‐tracking technique

Abstract— The viewing freedom of the reduced‐view super multi‐view (SMV) display was analyzed. It was found that there are separate multiple viewing ranges in the depth direction; thus, a technique that selects an appropriate viewing range to increase the longitudinal viewing freedom has been developed. Pixels of a flat‐panel display viewed by the viewer's eyes through a lenticular lens were determined from three‐dimensional (3‐D) positions of the viewer's eyes, which were obtained using an eye‐tracking system that employed a stereo camera. Parallax images corresponding to the 3‐D positions of the viewer's eyes were generated, which were displayed by the determined pixels. The experimental results show that the proposed technique successfully increased the longitudinal viewing freedom. It is also shown that a video camera was able to focus on the produced SMV images.     

Viewpoint image generation for head tracking 3D display using multi‐camera and approximate depth information

A simple and high image quality method for viewpoint image synthesis from multi‐camera images for a stereoscopic 3D display using head tracking is proposed. In this method, slices of images for depth layers are made using approximate depth information, the slices are linearly blended corresponding to the distance between the viewpoint and cameras at each layer, and the layers are overlaid from the perspective of viewpoint. Because the linear blending automatically compensates for depth error because of the visual effects of depth‐fused 3D (DFD), the resulting image is natural to observer's perception. Smooth motion parallax of wide depth range objects induced by viewpoint movement for left‐and‐right and front‐and‐back directions is achieved using multi‐camera images and approximate depth information. Because the calculation algorithm is very simple, it is suitable for real time 3D display applications.     

Luminance effects influencing perception of 3‐D TV imagery

Abstract— This study investigates whether screen luminance or ambient illumination has a significant effect on the perception of 3‐D TV imagery for static images and dynamic films. Two types of stimuli were shown on a multi‐view stereoscopic display: the static image, which included computer‐generated and photographic images, and dynamic film, which contained real‐life and animation images. In each treatment with a different level of screen luminance, subjects completed psychophysical and physiological measurements and subjective comfort evaluations. The results showed that when subjects viewed 3‐D static images, the ambient illumination affected psychophysical visual fatigue and screen luminance had a significant effect on subjective comfort evaluation and visual discrimination performance. However, when subjects viewed 3‐D dynamic films, screen luminance was the major factor causing psychophysical visual fatigue, and ambient illumination significantly affected subjective comfort evaluation. The outcomes contribute to knowledge concerning the suitable viewing conditions for the 3‐D viewing experience. Future work will explore the intolerance threshold of the lowest display luminance or the effect of decomposition of the screen on other physiological measurements.