Motion and stereoscopic tilt perception

Abstract— Stereoscopic perception of tilt about a vertical or horizontal axis is influenced by size and shear disparities, respectively. Other researchers have reported that, under certain conditions, stereoscopic perception deficits occur when the dots in a random-dot stereogram move at a velocity that produces optokinetic nystagmus. Here we examine how size disparity and shear disparity affect stereoscopic tilt perception under various motion conditions. We hypothesized that visual stimulus motion may interact with these disparities to affect tilt perception. Our results indicate that shear disparity and size disparity effects under static conditions are maintained under motion conditions. A possible explanation for the conflict between the current and previous results is discussed, as are implications for binocular head-mounted display applications.     

A method for reproducing apparent continuous depth in a stereoscopic display using “Depth‐Fused 3D” technology

Abstract— A new method that can present fine depth increments in a stereoscopic display is proposed. In typical stereoscopic displays, depth can be presented by binocular disparity, but binocular disparity of less than one pixel cannot be displayed because, in general, electronic displays have discrete pixels. We combined binocular disparity and modulation of the edge luminance in DFD (depth‐fused 3D) displays. In an experiment, the perceived depth could be continuously changed by modulating the edge luminance only. Therefore, continuous depth can be produced by combining binocular disparity and modulation of edge luminance distribution.     

Angular dependence of the performance of stereoscopic liquid‐crystal‐display (LCD) television using shutter glasses (SG)

Abstract— 3‐D cross‐talk typically represents the ratio of image overlap between the left and right views. For stereoscopic LCDs using shutter‐glasses technology, 3‐D cross‐talk for stereoscopic LCD TV with a diagonal size of 46 in. and vertical alignment (VA) mode was measured to change from 1% to 10% when the stereoscopic display is rotated around the vertical axis. Input signals consist of the left and right images that include patterns of different amounts of binocular disparity and various gray levels. Ghost‐like artifacts are observed. Furthermore, intensities of these artifacts are observed to change as the stereoscopic display is rotated about the vertical axis. The temporal luminance of the LCD used in stereoscopic TV was found to be dependent on the viewing direction and can be considered as one cause of the phenomenon of angular dependence of performance for stereoscopic displays.     

Visual comfort enhancement study based on visual attention detection for stereoscopic displays

Although numerous potential causes may lead to visual discomfort when viewing content on three‐dimensional (3D) displays, vergence–accommodation conflict is a particular cause of binocular parallax‐based stereoscopic displays, and it is unavoidable. Based on the study of 3D content visual attention, we proposed a novel stereoscopic depth adjustment method to improve the visual comfort and enhance perceived naturalness. The proposed method combined the 3D image saliency and specific viewing condition to establish a novel model for computing the optimum zero‐disparity plane of stereoscopic image. The results of perception experiments, focused on visual comfort and stereoscopic sensation, supported that the proposed method can significantly enhance stereoscopic viewing comfort and even can improve the stereoscopic sensation by insuring the 3D image fusion.     

基于视差重映射的立体图像视觉舒适度提升

目的 针对人眼观看立体图像内容可能存在的视觉不舒适性,基于视差对立体图像视觉舒适度的影响,提出了一种结合全局线性和局部非线性视差重映射的立体图像视觉舒适度提升方法。方法 首先,考虑双目融合限制和视觉注意机制,分别结合空间频率和立体显著性因素提取立体图像的全局和局部视差统计特征,并利用支持向量回归构建客观的视觉舒适度预测模型作为控制视差重映射程度的约束;然后,通过构建的预测模型对输入的立体图像的视觉舒适性进行分析,就欠舒适的立体图像设计了一个两阶段的视差重映射策略,分别是视差范围的全局线性重映射和针对提取的潜在欠舒适区域内视差的局部非线性重映射;最后,根据重映射后的视差图绘制得到舒适度提升后的立体图像。结果 在IVY Lab立体图像舒适度测试库上的实验结果表明,相较于相关有代表性的视觉舒适度提升方法对于欠舒适立体图像的处理结果,所提出方法在保持整体场景立体感的同时,能更有效地提升立体图像的视觉舒适度。结论 所提出方法能够根据由不同的立体图像特征构建的视觉舒适度预测模型来自动实施全局线性和局部非线性视差重映射过程,达到既改善立体图像视觉舒适度、又尽量减少视差改变所导致的立体感削弱的目的,从而提升立体图像的整体3维体验。     

Limits of fusion and depth judgment in stereoscopic color displays

The effective use of stereoscopic display systems is dependent, in part, on reliable data describing binocular fusion limits and the accuracy of depth discrimination for such visual display devices. These issues were addressed in three experiments, as were the effects of interocular cross talk. Results showed that limits of fusion were approximately 27.0 min arc for crossed disparity and 24.0 min arc for uncrossed disparity. Subjects were extremely accurate in distinguishing the relative distance among four groups of stimuli, were able to identify a pair of stimuli colocated at the same depth plane within each group, and were fairly accurate in scaling stimuli along the depth dimension. The mean error in using disparity as a depth cue was approximately 2.2 min arc. Interocular cross talk had little effect on fusion limits for 200-ms stimulus presentations but significantly affected fusion for longer (2 s) presentations that enabled vergence responses to be executed. Depth discrimination performance was essentially unaffected by interocular cross talk; however, cross talk significantly influenced subjective ratings of image quality and visual comfort.     

Disparity-based just-noticeable-difference model for perceptual stereoscopic video coding using depth of focus blur effect

Human 3D perception provides an important clue to the removal of redundancy in stereoscopic 3D (S3D) videos. Because objects outside the binocular fusion limit cannot be fused on retina, the human visual system (HVS) makes them blur according to the depth-of-focus (DOF) effect to increase the binocular fusion limit and suppress diplopia, i.e. double vision. Based on human depth perception, we propose a disparity-based just-noticeable-difference model (DJND) to save bit-rate and improve visual comfort in S3D videos. We combine the DOF blur effect with conventional JND models in the pixel domain into DJND. Firstly, we use disparity information to get the average disparity value of each block. Then, we integrate the DOF blur effect into luminance JND (LJND) by a selective low pass Gaussian filter to minimize the visual stimulus in S3D videos. Finally, we incorporate disparity information into the filtered JND models to obtain DJND. Experimental results demonstrate that the proposed method successfully improves both image quality and visual comfort in viewing S3D videos without increasing the bit-rate.     

Depth perception for moving images shown on a large LED display with an aperture grille

Abstract— A type of depth illusion created by the use of an aperture grille is reported. When viewing a moving target through multiple slits, a movement with depth is perceived, which was originally reported (see Ref. 11). The binocular delay is considered to cause a virtual disparity between both perspective images with apparent movement. By using an LED display with an aperture grille as a stereoscopic display, perceived distance caused by a binocular delay has been measured. The measured distance is compared with the perceived distance for stereoscopic still images shown on a stereoscopic LED panel. The comparison supported that the binocular delay is converted into binocular disparity. Furthermore, pair‐comparison tests were conducted to investigate depth impressions. It was found that use of an aperture grille improves depth impression for a movie that was taken with a laterally moving camera.     

Spatial judgments with monoscopic and stereoscopic presentation of perspective displays.

Spatial judgments with monoscopic and stereoscopic presentation of perspective displays were investigated in the present study. The stimulus configuration emulated a visual scene consisting of a volume of airspace above a ground reference plane. Two target symbols were situated at various positions in the space, and observers were instructed to identify the relative depth or altitude of the two symbols. Three viewing orientations (15, 45, or 90 deg elevation angle) were implemented in the perspective projection. In the monoscopic view, depth cues in size, brightness, occlusion, and linear perspective were provided in the format. In the stereoscopic view, binocular disparity was added along the line of sight from the center of projection to reinforce the relative depth in the visual scene. Results revealed that spatial judgments were affected by manipulation of the relative spatial positions of the two target symbols and by the interaction between relative position and viewing orientation. The addition of binocular disparity improved judgments of three-dimensional spatial relationships, and the enhancement was greater when monocular depth cues were less effective and/or ambiguous in recovering the three-dimensional spatial characteristics.     

Evaluation of stereoscopic picture quality with CFF

The method of binocular stereoscopic imaging has attracted attention as a simple and technically feasible means of three-dimensional (3-D) display. It has been said, however, that the binocular picture system is more fatiguing to view than a conventional two-dimensional picture, such as the current television picture. The main objective of this paper is to evaluate quantitatively fatigue caused by binocular stereoscopic picture viewing, to clarify the basic characteristics of this type of picture. Various measurement methods of fatigue have been proposed, and that using the critical flicker frequency (CFF) has found wide use in measurement of mental fatigue and is easy to make. Actual measurement in this study used the CFF value obtained in a descending series of the method of limits, normalized to the value at the start of measurement for each observer, and the CFFs of all observers then averaged. It was found that the measurements produced stable and highly accurate results. CFFs of the observers of a current television picture and a binocular stereoscopic television picture were measured. It was found that the conventional television did not cause a statistically significant decrease in CFF—even over 1?h of viewing—but that the stereoscopic television did cause a significant CFF decrease within 30?min. It was also found that the CFF decreases are related to a subjective feeling of fatigue. From these results, it was concluded that CFF is an effective measure for objectively measuring the fatigue of television observers, including observers of binocular stereoscopic television. Also, the binocular stereoscopic television produced higher fatigue in observers than did the conventional television picture, but it was found that with respect to CFF viewing of around 30?min was allowable.     

Surface textures improve the robustness of stereoscopic depth cues

This research develops design recommendations for surface textures (patterns of color on object surfaces) rendered with stereoscopic displays. In 3 method-of-adjustment procedure experiments, 8 participants matched the disparity of a circular probe and a planar stimulus rendered using a single visible edge. The experiments varied stimulus orientation and surface texture. Participants more accurately matched the depth of vertical stimuli than that of horizontal stimuli, consistent with previous studies and existing theory. Participants matched the depth of surfaces with large pixel-to-pixel luminance variations more accurately than they did surfaces with a small pixel-to-pixel luminance variation. Finally, they matched the depth of surfaces with vertical line patterns more accurately than they did surfaces with horizontal-striped texture patterns. These results suggest that designers can enhance depth perception in stereoscopic displays, and also reduce undesirable sensitivity to orientation, by rendering objects with surface textures using large pixel-to-pixel luminance variations.     

Measurement of the lens accommodation in viewing stereoscopic displays

In observing the stereoscopic display at the viewing distance of 1 m, the amount of the perceived depth was determined by the positions of the crossing point that the viewing direction of two eyes intersect. The positions of the crossing points of stereoscopic stimuli were controlled, and the accommodation was measured by the autorefractometer for the seven participants. Accommodation was also measured when viewing the real film chart which was placed at the same position as these crossing points. The accommodation change when viewing the stereoscopic display was measured to be noticeable only when the crossing point was quite near the participant, but this change was still much smaller compared with the accommodation change when viewing the real film chart. This change in accommodation implies the possible occurrence of fatigue related to the accommodation–convergence conflict, while the constant accommodation within the range of DOF implies no conflict between the accommodation and convergence. This measurement scheme may be used to define the range of DOF where the accommodation remains little changed, and thus define the depth of the 3D object at which no accommodation–convergence conflict occurs, for a given stereoscopic display.     

The effect of stereoscopic viewing in a word‐search task with a layered background

Abstract— The benefits of stereoscopic viewing were explored in searching in words superimposed over a background. In the first experiment, eight participants searched for text in a normal 2‐D display, a 3‐D display using a parallax barrier, and a darkened 2‐D display of equivalent brightness to the 3‐D display. Word‐search performance was significantly faster for the bright 2‐D display vs. the 3‐D display, but when brightness was controlled, performance on the 3‐D display was better relative to the 2‐D (dim) display. In a second experiment, the effect of floating text vs. sinking background disparity was assessed across four background conditions. Twenty participants saw only the floating‐text (FT) condition and 20 participants saw only the sinking‐background (SB) condition. Performance of the SB group was significantly better than that of FT group, and the advantage of SB disparity was greater with the more‐complex backgrounds. Thus, when a parallax‐barrier 3‐D display is used to view text or other figural information overlaid on a background, it is proposed that the layer of primary interest (foreground) should be displayed with zero disparity (on the physical display surface) with the secondary layer (background) appearing to be sunk beneath that surface.     

Effect of disparity and viewing ambient illumination on stereoscopic viewing: An eye movement approach

Researchers have found that factors related to viewing content and viewing environment could influence viewers' stereoscopic viewing experiences. In this paper, the effect of both disparity and viewing ambient illumination condition on stereoscopic viewing was investigated by using an eye movement approach. The eye movement responses to random dot stereograms (RDS) stimuli in stereoscopic viewing were studied by performing a fusion range measurement experiment involving a judgment task. The fusion ranges under two ambient illumination conditions, eye movement responses to RDS stimuli and effects of disparity on eye movement parameters, were analyzed, respectively. The experimental results showed that fusion range under two ambient illumination conditions were different, and changes of eye movement parameters were different among various disparities when ambient illumination conditions varied. As a result, in order to improve viewers' viewing experiences when viewing different 3D contents, the arrangement of viewing ambient illumination conditions and the selection of disparity should be appropriately considered. The findings in this paper provide guidelines to reasonably arrange the viewing ambient illumination condition and efficiently produce healthy disparity in stereoscopic viewing.     

A Portable Bio-Inspired Architecture for Efficient Robotic Vergence Control

In stereoscopic vision, the ability of perceiving the three-dimensional structure of the surrounding environment is subordinated to a precise and effective motor control for the binocular coordination of the eyes/cameras. If, on the one side, the binocular coordination of camera movements is a complicating factor, on the other side, a proper vergence control, acting on the binocular disparity, facilitates the binocular fusion and the subsequent stereoscopic perception process. In real-world situations, an effective vergence control requires further features other than real time capabilities: real robot systems are indeed characterized by mechanical and geometrical imprecision that affect the binocular vision, and the illumination conditions are changeable and unpredictable. Moreover, in order to allow an effective visual exploration of the peripersonal space, it is necessary to cope with different gaze directions and provide a large working space. The proposed control strategy resorts to a neuromimetic approach that provides a distributed representation of disparity information. The vergence posture is obtained by an open-loop and a closed-loop control, which directly interacts with saccadic control. Before saccade, the open-loop component is computed in correspondence of the saccade target region, to obtain a vergence correction to be applied simultaneously with the saccade. At fixation, the closed-loop component drives the binocular disparity to zero in a foveal region. The obtained vergence servos are able to actively drive both the horizontal and the vertical alignment of the optical axes on the object of interest, thus ensuring a correct vergence posture. Experimental tests were purposely designed to measure the performance of the control in the peripersonal space, and were performed on three different robot platforms. The results demonstrated that the proposed approach yields real-time and effective vergence camera movements on a visual stimulus in a wide working range, regardless of the illumination in the environment and the geometry of the system.     

时空联合视差优化的立体视频重定向

目的智能适配显示的图像/视频重定向技术近年受到广泛关注。与图像重定向以及2D视频重定向相比,3D视频重定向需要同时考虑视差保持和时域保持。现有的3D视频重定向方法虽然考虑了视差保持却忽略了对视差舒适度的调整,针对因视差过大和视差突变造成视觉不舒适度这一问题,提出了一种基于时空联合视差优化的立体视频重定向方法,将视频视差范围控制在舒适区间。方法在原始视频上建立均匀网格,并提取显著信息和视差,进而得到每个网格的平均显著值;根据相似性变化原理构建形状保持能量项,利用目标轨迹以及原始视频的视差变化构建时域保持能量项,并结合人眼辐辏调节原理构建视差舒适度调整能量项;结合各个网格的显著性,联合求解所有能量项得到优化后的网格顶点坐标,将其用于确定网格形变,从而生成指定宽高比的视频。结果实验结果表明,与基于细缝裁剪的立体视频重定向方法对比,本文方法在形状保持、时域保持及视差舒适度方面均具有更好的性能。另外,使用现有的客观质量评价方法对重定向结果进行评价,本文方法客观质量评价指标性能优于均匀缩放和细缝裁剪的视频重定向方法,时间复杂度较低,每帧的时间复杂度至少比细缝裁剪方法降低了98%。结论提出的时空联合...     

基于空域自然场景统计的无参考立体图像质量评价模型

针对现有的评价方法大都将图像变换到不同的坐标域问题,提出一种基于空域自然场景统计(NSS)的通用型无参考立体图像质量评价模型。在评价中为了更好地结合人类双目视觉特性, 将左右图像融合成一幅独眼图;评价模型首先统计独眼图归一化亮度(CMSCN)系数分布规律,进而对独眼图提取空域自然场景统计特征;其次,统计视差图归一化亮度(DMSCN)系数的分布规律,并对用光流法得到的视差图提取同样的特征;最后,通过支持向量回归(SVR)建立立体图像特征信息与主观评价值(DMOS)之间的关系,从而预测得到图像质量的客观评价值。实验结果表明,该评价模型对立体数据测试库进行评价,其Pearson线性相关系数(PLCC)和Spearman等级相关系数(SROCC)值均在0.94以上;对于非对称立体图像库,PLCC和SROCC值分别接近0.91和0.93。该模型能够很好地预测人眼对立体图像的主观感知。     

Visual comfort prediction for stereoscopic image using stereoscopic visual saliency

Perceptually salient regions of stereoscopic images significantly affect visual comfort (VC). In this paper, we propose a new objective approach for predicting VC of stereoscopic images according to visual saliency. The proposed approach includes two stages. The first stage involves the extraction of foreground saliency and depth contrast from a disparity map to generate a depth saliency map, which in turn is combined with 2D saliency to obtain a stereoscopic visual saliency map. The second stage involves the extraction of saliency-weighted VC features, and feeding them into a prediction metric to produce VC scores of the stereoscopic images. We demonstrate the effectiveness of the proposed approach compared with the conventional prediction methods on the IVY Lab database, with performance gain ranging from 0.016 to 0.198 in terms of correlation coefficients.     

The interaction of chromostereopsis and stereopsis in stereoscopic CRT displays

To give operators of high-speed, highly-manoeuvrable vehicles the ability to keep pace with their increasingly dynamic environment, stereoscopic 3-D displays may soon replace conventional 2-D displays. Important to the development of stereoscopic 3-D displays is the interaction of perceived depth created by hues (chromostereopsis) and perceived depth created by presenting different images of a single object to the left and right eye of the observer (stereopsis). The purpose of this research is to evaluate the interaction of chromostereopsis and stereopsis on a stereoscopic CRT by determining the level of accuracy with which subjects can properly interpret the relative depth differences of adjacent symbols containing six levels of hue and seven levels of stereoscopic disparity. This research demonstrated that hue, disparity, and the interaction of hue and disparity significantly influenced one's perception of depth on a stereoscopic monitor. The results suggest that caution should be exercised by the stereoscopic 3-D display format designer when choosing hues to represent images located in close proximity on a stereoscopic display. Due to the chromostereoscopic effect on the perception of depth, hues on extreme ends of the colour spectrum should not be used in situations where less than 3.39 arc minutes of disparity difference is being portrayed on a stereoscopic display, unless the hues are consistently being used to alter the depth presented by stereoscopic disparity, or the chromostereoscopic depth resulting from certain hues is consistently nullified by altering disparity levels accordingly.     

Subjective evaluation of visual fatigue due to misalignment of motion and still images in a stereoscopic display

Abstract— In this paper, the relative influences of misalignment such as cross‐talk, vertical shift, and motion blur on visual fatigue by using a binocular stereoscopic display has been verified. Experiments were conducted for two cases: a still image and a motion image. They were evaluated by using the simulator sickness questionnaire (SSQ). By changing the disparity angle, cross‐talk, and vertical shift in the still‐image experiment, it was found that the SSQ score of each parameter increased as the amount of each factor increased. With a two‐sample t‐test between the presence and absence of each factor, a significant difference was found for the case of a more than 36‐arcmin disparity, more than 20% cross‐talk, and more than 10% vertical shift. In the motion‐image experiment, in which motion speed and the misalignment were varied, it was found that movement of the disparity angle caused much more visual fatigue in comparison with the misalignment factors, which were cross‐talk and vertical shift. In contrast, motion images in addition to the cross‐talk and/or vertical shift had a slight but unnoticeable relationship to an increase in visual fatigue. Therefore, it was concluded that vertical shift dominated the evaluation for still images, and the movement itself dominated the evaluation for motion images. The results suggest that it is necessary to evaluate visual fatigue according to the representing case, still or motion images, of a 3‐D stereoscopic display.