Measuring visual fatigue and visual discomfort associated with 3‐D displays

Abstract— This research identifies methods for signs of visual complaints associated with stereoscopic displays. Two potential causes for contradictory results concerning these signs in previous research are hypothesized: (1) not all clinical tests are equally appropriate and (2) there is a natural variation in susceptibility amongst people with normal vision. An optometric screening differentiated participants with moderate binocular status (MBS) from those with good binocular status (GBS). In a 2 × 2 within‐subjects design (2‐D vs. 3‐D and MBS vs. GBS), a questionnaire and eight optometric tests (i.e., binocular acuity, aligning prism, fixation disparity, heterophoria, convergent and divergent fusional reserves, vergence facility, and accommodation response) were each administered before and immediately after a reading task. Results revealed that only participants with MBS in 3‐D conditions showed clinically meaningful changes in fusion range, experienced more visual discomfort, and performed worse on the reading task. Acombination of fusion range measurements and self‐report is appropriate for evaluating visual complaints of stereoscopic stills, and people with a MBS are more susceptible to visual complaints associated with stereoscopic displays. A simple measurement tool, i.e., the ratio of reading performance between 2‐D and 3‐D, to categorize people based on their binocular status is proposed.     

True 3‐D scanned voxel displays using single or multiple light sources

Abstract— Conventional stereoscopic displays require viewers to unnaturally keep eye accommodation fixed at one focal distance while they dynamically change vergence to view objects at different distances. This forced decoupling of reflexively linked processes fatigues eyes, causes discomfort, compromises image quality, and may lead to pathologies in developing visual systems. Volumetric displays can overcome this conflict, but only for small objects placed within a limited range of viewing distances and accommodation levels, and cannot render occlusion cues correctly. Our multi‐planar True 3‐D displays generate accommodation cues that match vergence and stereoscopic retinal disparity demands and can display images and objects at viewing distances throughout the full range of human accommodation (from 6.25 cm to infinity), better mimicking natural vision and minimizing eye fatigue.     

Visual comfort enhancement study based on visual attention detection for stereoscopic displays

Although numerous potential causes may lead to visual discomfort when viewing content on three‐dimensional (3D) displays, vergence–accommodation conflict is a particular cause of binocular parallax‐based stereoscopic displays, and it is unavoidable. Based on the study of 3D content visual attention, we proposed a novel stereoscopic depth adjustment method to improve the visual comfort and enhance perceived naturalness. The proposed method combined the 3D image saliency and specific viewing condition to establish a novel model for computing the optimum zero‐disparity plane of stereoscopic image. The results of perception experiments, focused on visual comfort and stereoscopic sensation, supported that the proposed method can significantly enhance stereoscopic viewing comfort and even can improve the stereoscopic sensation by insuring the 3D image fusion.     

Relationship between parallax and spatial resolution on visual comfort of an autostereoscopic display

A primary reason for visual discomfort caused by viewing 3D contents in autostereoscopic displays is the conflict between accommodation and convergence. Parallax directly affects the degree of conflict. In this paper, three factors are investigated—parallax magnitude, changing parallax, and spatial resolution—which are supposed to exert substantial influence upon visual comfort. The aforementioned three factors are integrated into stereoscopic sequences generated by software. With the data on the subjective evaluation of comfort from the viewers, statistical method is used to obtain both the main effects and interactions among the three factors. According to the experimental results, changing parallax might play a more crucial role in visual comfort than parallax magnitude. Spatial resolution might alleviate the negative effects in which changing parallax brings about. The experiment indicates that parallax for autostereoscopic displays should be within 50′ in consideration of comfort.     

Relationship between age differences and display parameters on visual comfort for autostereoscopic display

In order to investigate the age differences for viewing autostereoscopic display, we conduct a 3 × 3 × 3 × 4 mixed design with repeated measurement experiment by using three‐dimensional (3D) video clips. Visual comfort is compared between four age groups with a questionnaire. Results of subjective evaluation are compared through the chi‐square test to check if there is a statistical significance between groups with respect to the distribution of number and proportion according to five levels of visual comfort. Then we examine age differences of visual comfort under three key display parameters including crosstalk, ambient illumination, and disparity. The results indicate that the degree of comfort varies considerably among age groups as the parameters of the display system change. Although the seniors feel most discomfort and the children get best experience in general, there is no statistical difference among the subjects when the ambient illumination is medium or disparity is large. So, it is necessary to take account of the age differences in designing 3D display parameters for enhancing visual comfort.     

Characterizing image quality of autostereoscopic displays by using the maximum luminance at each viewing position

A metric of the 3D image quality of autostereoscopic displays based on optical measurements is proposed. This metric uses each view's luminance contrast, which is defined as the ratio of maximum luminance at each viewing position to total luminance at that position. Conventional metrics of the autostereoscopic display based on crosstalk, which uses “wanted” and “unwanted” lights. However, in case of the multiple‐views‐type autostereoscopic displays, it is difficult to distinguish exactly which lights are wanted lights and which are unwanted lights. This paper assumes that the wanted light has a maximum luminance at the good stereoscopic viewing position, and the unwanted light also has a maximum luminance at the worst pseudo‐stereoscopic viewing position. By using the maximum luminance that is indexed by view number of the autostereoscopic display, the proposed method enables characterizing stereoscopic viewing conditions without using wanted/unwanted light. A 3D image quality metric called “stereo luminance contrast,” the average of both eyes' contrast, is proposed. The effectiveness of the proposed metric is confirmed by the results of optical measurement analyses of different types of autostereoscopic displays, such as the two‐view, scan‐backlight, multi‐view, and integral.     

Super multi‐view 3D displays reduce conflict between accommodative and vergence responses

A conflict between accommodation and vergence is one possible cause of visual fatigue and discomfort while viewing conventional three‐dimensional displays. Previous studies have proposed the super multi‐view (SMV) display technique to solve the vergence–accommodation conflict, in which two or more parallax images enter the pupil of the eye with highly directional rays. We simultaneously measured accommodative, vergence, and pupillary responses to SMV three‐dimensional displays to examine whether they can reduce the conflict. For comparison, responses to two‐view stereo images and real objects were also measured. The results show that the range of the accommodative response was increased by the SMV images compared with the two‐view images. The slope of the accommodation–vergence response function for the SMV images was similar to that for the real objects rather than the two‐view images. We also found that enhancement of the accommodative range by the SMV images is noticeable with binocular viewing, indicating that vergence‐induced accommodation plays an important role in viewing SMV displays. These results suggest that SMV displays induced a more natural accommodative response than did conventional, two‐view stereo displays. As a result, SMV displays reduced the vergence–accommodation conflict.     

Visual experience for autostereoscopic 3D projection display

In order to investigate visual experience for watching the autostereoscopic three‐dimensional (3D) projection display, we conduct a subjective evaluation experiment by a questionnaire when viewing video clips. Factor analysis is adopted to classify the evaluation items for the perpetual constructs of visual experience. Then a mixed design with repeated measurement analysis of variance with dimension and display duration as factors is carried out on the evaluation data to check the factorial effects and interactions for statistical significance. The results of factor analysis extract five factors including visual comfort, image quality, distortion, naturalness, and presence, which can be used as comprehensive indicators to evaluate the autostereoscopic 3D projection display. The results of analysis of variance indicate that image quality, which is used to assess two‐dimensional contents, is no longer applicable. It is necessary to give consideration to depth when evaluating 3D visual experience. Although 3D scenes enhance the overall subjective performance such as naturalness and presence, the health issues and stereoscopic distortion related to the introduction of depth cannot be ignored.     

Efficiency analysis for multi‐view spatially multiplexed autostereoscopic 2‐D/3‐D displays

Abstract— The wide‐viewing freedom often requested by users of autostereoscopic displays can be delivered by spatial multiplexing of multiple views in which a sequence of images is directed into respective directions by a suitable autostereoscopic optical system. This gives rise to two important design considerations — the optical efficiency and the resolution efficiency of the device. Optical efficiency is particularly important in portable devices such as cell phones. A comparison is given between lens and barrier systems for various spatial multiplexing arrangements. Parallax‐barrier displays suffer from reduced optical efficiency as the number of views presented increases whereas throughput efficiency is independent of the number of views for lens displays. An autostereoscopic optical system is presented for the emerging class of highly efficient polarizer‐free displays. Resolution efficiency can be evaluated by investigating quantitative and subjective comparisons of resolution losses and pixel appearance in each 3‐D image. Specifically, 2.2‐in.‐diagonal 2‐D/3‐D panel performance has been assessed using Nyquist boundaries, human‐visual contrast‐sensitivity models, and autostereoscopic‐display optical output simulations. Four‐view vertical Polarization‐Activated Microlens technology with either QVGA mosaic or VGA striped pixel arrangements is a strong candidate for an optimum compromise between display brightness, viewing angle, and 3‐D pixel appearance.     

Effects of contrast and ambient illumination on visual discomfort of autostereoscopic display

The conflict between vergence and accommodation is the main perceptual factors contributing to visual discomfort when viewing autostereoscopic display. The key factors relevant to the accommodation and vergence are the ambient illumination and the contrast. The current study was a 2 × 3 × 3 mixed design comparing VFSI and VIMS symptoms between 2D and 3D video clips with three contrast levels under three ambient illumination levels on the autostereoscopic display. Twenty participants were required to evaluate the degree of discomfort by filing out questionnaires after watching those video clips. According to the result analysis, the 3D viewing participants reported more severe symptoms compared to 2D. The moderate contrast conditions were found to be the optimum for viewing comfort. The difference between VFSI and VIMS symptoms become larger with increasing contrast. The results also suggested the optimum 3D illumination condition should not be too high to effectively relieve visual discomfort. VIMS symptoms were more sensitive to the changes in ambient illumination than VFSI. Moreover, significant interaction between contrast and ambient illumination was found. Participants felt the most comfortable in the combination effect of moderate level of contrast and the high level of ambient illumination.     

The visual impact of augmented reality during an assembly task

Many studies have shown the benefits of augmented reality (AR) to improve manufacturing and control processes in industry. However, the presentation of AR content through optical see-through head-mounted displays may induce unnatural viewing conditions, which consequences on the user’s visual system have not been investigated yet. This study aimed at assessing whether using AR instructions to guide a manual task, i.e., conditions where the user is forced to repeatedly look at and accommodate in different planes to extract information from both real and virtual environments, could potentially impact the visual system of operators. A before/after design study was carried out, asking 26 participants to perform Lego assemblies for 30 min with either paper or AR instructions. The effects of using AR compared to paper instructions were evaluated both on binocular vision, with classical optometric measurements, and on visual fatigue, with the Virtual Reality Symptoms Questionnaire. No clinically significant differences in optometric measurements (far/near visual acuity, stereoacuity, phoria, convergence, fusional amplitude, accommodation amplitude, accommodative convergence) have been found between AR and paper instructions, and only negligible fatigue symptoms have been seen specifically for AR. Results from both objective and subjective measurements suggest that there is no impact of AR on the oculomotor system and that, in this specific case of use, AR can be safely used for production operators.     

3‐D crosstalk and luminance uniformity from angular luminance profiles of multiview autostereoscopic 3‐D displays

Abstract— Autostereoscopic 3‐D display technologies enable a more immersive media experience by adding real depth to the visual content. However, the method used for the creation of a sensation of depth or stereo illusion contains several display design and content‐related issues that need to be carefully considered to maintain sufficient image quality. Conventionally, methods used for 3‐D image‐quality evaluations have been based on subjective testing. Optical measurements, in addition to subjective testing, can be used as an efficient tool for 3‐D display characterization. Objective characterization methods for autostereoscopic displays have been developed. How parameters affecting stereo image quality can be defined and measured, and how their effect on the stereo image quality can be evaluated have been investigated. Developed characterization methods are based on empirically gathered data. In this paper, previously presented methodology for two‐view displays is extended to cover autostereoscopic multiview displays. A distinction between displays where the change in content occurs in clear steps when the user moves in front of the display, and displays where the apparent movement of the objects is more continuous as a function of the head movement is made. Definitions for 3‐D luminance and luminance uniformity, which are equally important, as well as 3‐D crosstalk, which is the dominant factor in the evaluations of the perceived 3‐D image quality, is focused upon.     

Development of a 42‐in. 2‐D/3‐D switchable display using multi‐view technology for public‐information‐display applications

Abstract— A 42‐in. 2‐D/3‐D switchable display operating in a parallax‐barrier‐type system consisting of liquid‐crystal displays (LCDs) has been developed. The system displays 2‐D images in full resolution, without any degradation to the original 2‐D images, and 3‐D autostereoscopic images with resolutions higher than SVGA with wide viewing zones electrically controlled by the parallax‐barrier system. The system is intended for use in public‐information displays (PIDs), a booming field, and as displays for gaming, medical, and simulation applications.     

Depth‐map generation for multi‐view autostereoscopic 3‐D displays based on the SIFT algorithm constrained by boundary

Abstract— A depth‐map estimation method, which converts two‐dimensional images into three‐dimensional (3‐D) images for multi‐view autostereoscopic 3‐D displays, is presented. The proposed method utilizes the Scale Invariant Feature Transform (SIFT) matching algorithm to create the sparse depth map. The image boundaries are labeled by using the Sobel operator. A dense depth map is obtained by using the Zero‐Mean Normalized Cross‐Correlation (ZNCC) propagation matching method, which is constrained by the labeled boundaries. Finally, by using depth rendering, the parallax images are generated and synthesized into a stereoscopic image for multi‐view autostereoscopic 3‐D displays. Experimental results show that this scheme achieves good performances on both parallax image generation and multi‐view autostereoscopic 3‐D displays.     

Optical characterization of autostereoscopic 3‐D displays

Abstract— Display‐measurement methods different from conventional 2‐D display measurements are needed for verifying the optical characteristics of autostereoscopic (3‐D) displays and for comparing different 3‐D display technologies. Industry is lacking standardized measurement methods, and the reported results can not always be compared. The selected set of characteristics discussed in this paper and partly defining the quality of the 3‐D experience are crosstalk, viewing freedom, and optimum viewing distance. Also, more conventional display characteristics such as luminance are discussed, since the definitions for these characteristics in 3‐D mode usually differ from those used for the 2D displays. We have investigated how these chosen 3‐D display characteristics can be objectively measured from transmissive two‐view and multiview 3‐D displays. The scope of this article is to generally define those basic characteristics as well as the different measurement methods. Most of the 3‐D characteristics can be derived from the luminance and colors versus the viewing angle. Either a conoscopic or a goniometric measurement system can be used, as long as the angular and stray‐light properties are suitable and known. The characteristics and methods are currently discussed in the display‐quality standardization forums.     

Luminance effects influencing perception of 3‐D TV imagery

Abstract— This study investigates whether screen luminance or ambient illumination has a significant effect on the perception of 3‐D TV imagery for static images and dynamic films. Two types of stimuli were shown on a multi‐view stereoscopic display: the static image, which included computer‐generated and photographic images, and dynamic film, which contained real‐life and animation images. In each treatment with a different level of screen luminance, subjects completed psychophysical and physiological measurements and subjective comfort evaluations. The results showed that when subjects viewed 3‐D static images, the ambient illumination affected psychophysical visual fatigue and screen luminance had a significant effect on subjective comfort evaluation and visual discrimination performance. However, when subjects viewed 3‐D dynamic films, screen luminance was the major factor causing psychophysical visual fatigue, and ambient illumination significantly affected subjective comfort evaluation. The outcomes contribute to knowledge concerning the suitable viewing conditions for the 3‐D viewing experience. Future work will explore the intolerance threshold of the lowest display luminance or the effect of decomposition of the screen on other physiological measurements.     

Visual comfort in autostereoscopic display

Autostereoscopic displays are likely to become widely used products in the future. However, certain physiological factors, especially visual comfort, limit their development. In this study, four observational parameters – ambient illuminance, image content, scaling ratio, and horizontal distance between major and minor objects – were evaluated to determine the degree of visual comfort offered by 3D computer‐generated images on an autostereoscopic display. Visual comfort score with the range of 0–1 is designed to represent the degree of visual comfort for the 3D images with different manipulations of ambient illuminance, image content, scaling ratio, and horizontal distance between major and minor objects in this study. Subjects were asked to indicate images that produced discomfort. The proportion of images for each condition where participants indicated that viewing the image was comfortable was computed. Images receiving a proportion of 0.5 or greater were classified as acceptable. The disparity ranges over which acceptable images were attained for each participant and for each condition were analyzed with analysis of variance. The analytical results indicate that ambient illuminance and image content have a significant effect on the acceptable disparity range, while scaling ratio and horizontal distance between major and minor objects did not.     

Optical simulation for cross‐talk evaluation and improvement of autostereoscopic 3‐D displays with a projector array

Abstract— Multi‐view spatial‐multiplexed autostereoscopic 3‐D displays normally use a 2‐D image source and divide the pixels to generate perspective images. Due to the reduction in the resolution of each perspective image for a large view number, a super‐high‐resolution 2‐D image source is required to achieve 3‐D image quality close to the standard of natural vision. This paper proposes an approach by tiling multiple projection images with a low magnification ratio from a microdisplay to resolve the resolution issue. Placing a lenticular array in front of the tiled projection image can lead to an autostereoscopic display. Image distortion and cross‐talk issues resulting from the projection lens and pixel structure of the microdisplay have been addressed with proper selection of the active pixel and adequate pixel grouping and masking. Optical simulation has shown that a 37‐in. 12‐view autostereoscopic display with a full‐HD (1920 × 1080) resolution can be achieved with the proposed 3‐D architecture.     

Key design issues for autostereoscopic 2‐D/3‐D displays

Abstract— Flat‐panel 2‐D/3‐D autostereoscopic displays are now being commercialized in a variety of applications, each with its own particular requirements. The autostereoscopic display designer has two key considerations to address in order to meet customer needs — the optical output of the display (defined by the output window structure) and the choice of optical components. Window structure determines 3‐D image resolution, achievable lateral and longitudinal viewing freedom, crosstalk, and 3‐D fringe contrast. Optical‐component selection determines the quality of the imaging of such windows, viewing distances, device ruggedness, thickness, and brightness. Trade‐offs in window design are described, and a comparison of the leading optical component technologies is given. Selection of Polarisation Activated Microlenses? architectures for LCD and OLED applications are described. The technology delivers significant advantages particularly for minimising nominal viewing distances in high pixel density panels and optimizing device ruggedness while maintaining display brightness.     

Using electromyography responses to investigate the effects of the display type,viewing distance,and viewing time on visual fatigue

The rapid success of 3D display technology and daily accessibility to 3D images has greatly increased the interest in such applications for a wide range of fields. This paper compares the effects of watching movies with 2D and 3D displays depending on the viewing distance (3H vs. 6H, where H is the height of the screen) and viewing time to determine the visual fatigue using electromyography (EMG) in terms of the percentage of maximum voluntary contraction (%MVC) of the orbicularis oculi (OO) muscle activity and a subjective visual discomfort score. Twenty healthy male university students with a mean age of 27.7 ± 2.53 years participated in this study as volunteers. None had color blindness, and all had normal vision acuity. A mixed-measures design was performed. The results showed that the viewing time and distance had significant effects on the %MVC and OO muscle activity depending on the display type. Watching the 3D display from a short viewing distance produced significantly high visual fatigue compared to watching the 2D display from a short viewing distance. However, the 3D display seemed to be less stressful than the 2D display at long viewing distances.