Measurement of the lens accommodation in viewing stereoscopic displays

In observing the stereoscopic display at the viewing distance of 1 m, the amount of the perceived depth was determined by the positions of the crossing point that the viewing direction of two eyes intersect. The positions of the crossing points of stereoscopic stimuli were controlled, and the accommodation was measured by the autorefractometer for the seven participants. Accommodation was also measured when viewing the real film chart which was placed at the same position as these crossing points. The accommodation change when viewing the stereoscopic display was measured to be noticeable only when the crossing point was quite near the participant, but this change was still much smaller compared with the accommodation change when viewing the real film chart. This change in accommodation implies the possible occurrence of fatigue related to the accommodation–convergence conflict, while the constant accommodation within the range of DOF implies no conflict between the accommodation and convergence. This measurement scheme may be used to define the range of DOF where the accommodation remains little changed, and thus define the depth of the 3D object at which no accommodation–convergence conflict occurs, for a given stereoscopic display.     

Stereoscopic 3‐D display with optical correction for the reduction of the discrepancy between accommodation and convergence

Abstract— This paper describes a method for reducing the discrepancy between accommodation and convergence when viewing stereoscopic 3‐D images. The method uses a newly developed stereoscopic 3‐D display system with a telecentric optical system and a mobile LCD. The examination of a mono‐focal lens showed that a correction lens having the appropriate refractive power and conditions for presenting stereoscopic 3‐D images clearly reduces the discrepancy between accommodation and convergence. The authors also developed a stereoscopic 3‐D display that uses dynamic optical correction to reduce the discrepancy between accommodation and convergence. The display equalizes the theoretical points of accommodation and convergence. The purpose of the development was to expand the regeneration range of a stereoscopic 3‐D image having the appropriate accommodation. An evaluation of the developed display showed that it resolves the discrepancy between convergence and accommodation.     

三维视觉测量技术及应用进展

三维视觉测量是计算机视觉与精密测量原理交叉融合的前沿高新技术,是工业4.0的基础支撑,是以网络化、智能化制造为变革特征的先进制造业的核心关键技术。经过几十年的发展,三维视觉测量技术在基础研究和应用研究上均获得了快速深入发展,形成了理论方法、技术工艺、系统研发和产品应用四位一体较为完备的方向体系,呈现出理论系统化、方法多维化、精度精准化和速度快捷化的发展趋势,成为智能制造过程控制、产品质量检验保证和装备整机服役测试的不可或缺的优选技术。本文主要围绕单相机、双相机和结构光等典型三维视觉测量技术展开论述,概要介绍其关键技术内涵,综述其发展现状、前沿动态、热点问题和发展趋势。重点论述条纹投影三维测量技术和相位测量偏折术。最后给出了三维视觉测量的发展趋势与未来展望。     

3D-SWiM: 3D vision based seam width measurement for industrial composite fiber layup in-situ inspection

Industrial composite fiber has been widely used in the high-end manufacturing because of its superior stiffness and strength. To ensure the quality of composite fiber placement in making high-end and lightweight aerospace products, it needs reliable composite fiber layup in-situ inspection. An accurate seam width measurement is an indispensable procedure during the layup inspection. However, the traditional seam measurements may fail in presence of surface curvature variance, curved edges between sheets, to name a few. This paper intentionally designs a novel 3D vision based Seam Width Measurement for Industrial Composite Fiber Layup In-situ Inspection (called 3D-SWiM). It aims to address three major challenges in measuring the seam width between the composite fiber sheets, namely, seam region over-segmentation, failures on region of interests (ROI) seam detection, seam width measurement inconsistency. Firstly, the region growing with semantic refinement is designed for 3D point cloud clustering, to overcome over-segmentation on seam regions. Afterwards, the gridding model with edge discrimination is applied to extract the 3D potential candidates in the edge areas. Eventually, we use the cubic B-spline fitting model to describe the seam region curves and the improved particle swarm optimization model to estimate the minimum and maximum distance between the seam edges. 3D-SWiM has been evaluated extensively on the developed composite fiber layup platform. The comparisons with the state-of-the-art methods (such as HT and GFM) on the region-of-interest segmentation, seam extraction and seam width measurement have been performed and the experimental results prove the competitive performance in composite fiber layup in-situ inspections.     

基于立体视觉的接触式三维测量系统

传统的三维接触式测量方法存在着速度慢、测量范围受限等缺点,而纯粹的非接触式测量方法则存在着特征边缘无法获取的问题。结合两种测量方法,设计了一种新的三维测量系统,该系统采用立体视觉技术对接触式测头的空间位置和姿态进行定位,进而间接计算接触式探针针尖位置来完成空间点的三维坐标测量。实验结果表明:系统测量精度优于0.2 mm,能够应用于工业现场进行复杂工件的典型几何特征检测和模型重构。     

Accommodation and convergence in integral imaging 3D display

In this paper, we analyze the visual fatigue of integral imaging three‐dimensional (3D) display by studying the accommodation and convergence when viewing the integral imaging 3D images. The theoretical analyses show that there is no inconsistency between the accommodation and convergence distances, which means that the integral imaging 3D display has no visual fatigue. Experiments are implemented, and the results finally demonstrate the rationality of the theoretical analyses. These analyses can be quite beneficial for researchers to better understand the performances and promote the practical applications of the integral imaging 3D display.     

基于标志点识别的三维位姿测量方法

提出一种基于双目视觉原理测量运动目标三维位姿参数的新方法。采用LED作为标志点来定义运动目标局部坐标系,通过双目视觉方法计算各LED的全局坐标,进而得出运动目标的三维位姿参数。同时根据实验环境的特殊性,提出一种基于优先级的外极线斜率约束匹配算法。实验结果表明该测量方法简单高效,满足精度和实时性的要求。     

基于立体视觉的3D地形拼接

为了从月球车上的全景相机所捕获的立体图像对重建月球车周围的3D地形,给地面科学家制定科学探测指令提供一个直观的可视化平台,预先展开了基于立体视觉的3D地形重建的研究,主要介绍了在3D地形拼接方面的研究进展。当恢复出多个局部3D地形模型时,首先基于边缘检测和图像匹配技术提取出相邻局部模型之间的公共数据点,然后采用分离旋转变换和平移矢量的策略拟合出相邻模型之间的坐标转换关系,之后就可以将局部模型统一在同一个坐标系下。通过室内和室外多次实验验证了该拼接方案。     

点阵测头成像视觉坐标测量系统的研究

柔性三维坐标测量在工业现场测量有较多应用.分析多目标点透视成像原理的基础上,提出了点阵测头成像视觉坐标测量的概念,给出系统完整的三种数学模型及求解方法.设计了一种实用测头,基于单台面阵CCD摄像机实现由三种类型测头组成的视觉测量样机.在距离摄像机1 000 mm,样机进行实际测量,并与三坐标测量机的检测结果进行比对.测试结果表明在摄像机成像面平行的两个方向的测量精度高于摄像机轴向测量精度.     

User experience while viewing stereoscopic 3D television

3D display technologies have been linked to visual discomfort and fatigue. In a lab-based study with a between-subjects design, 433 viewers aged from 4 to 82 years watched the same movie in either 2D or stereo 3D (S3D), and subjectively reported on a range of aspects of their viewing experience. Our results suggest that a minority of viewers, around 14%, experience adverse effects due to viewing S3D, mainly headache and eyestrain. A control experiment where participants viewed 2D content through 3D glasses suggests that around 8% may report adverse effects which are not due directly to viewing S3D, but instead are due to the glasses or to negative preconceptions about S3D (the ‘nocebo effect’). Women were slightly more likely than men to report adverse effects with S3D. We could not detect any link between pre-existing eye conditions or low stereoacuity and the likelihood of experiencing adverse effects with S3D.     

Artificial 3-D contactless measurement in orthognathic surgery with binocular stereo vision

Stereo vision systems are utilized since it provides contactless measurements of objects in 3-D (three-dimensional). Orthognathic surgery is a very sensitive operation that requires very high accuracy in measurements. The reduction of measurement error is an essential problem in orthognathic surgery. Moreover, quality inspection of the process during the course of operation aids the surgeon to avoid or minimize the mitigating circumstances. In this paper, artificial intelligence methods (neural network and neuro-fuzzy system) are used in order to increase the accuracy of positioning of jaws during the real-time practice. The comparison of artificial measurements with the real measurements shows that a statistically acceptable accuracy is achieved in 3-D positioning of teeth.     

双目视觉测量系统的标定及3维测量

针对结构光形位公差视觉测量系统,提出了一阶径向畸变的摄像机成像模型和标定方法,并对传统的直接线性变换(DLT变换)标定算法做了些改进。即先针对没有畸变的线性模型,利用传统的标定算法,解线性超定方程组求解摄像机的全部参数,再针对引入一阶径向畸变的成像模型,以线性模型的参数为初值,通过非线性迭代优化摄像机的图像中心,等效焦距,倾斜因子,畸变系数等内部参数。实验结果表明,该方法无需预标定,精度适中,是相对简单实用的标定方法。     

Conics-enhanced vision approach for easy and low-cost 3D tracking

This paper presents a conics-enhanced vision approach for low-cost and easy-to-operate 3D tracking. The idea is to use paper disks as markers and recover the 3D positions of these paper disks by a property of conics: the 3D rotation and translation information of a planar circle with known radius could be recovered from its elliptic projection in one image (Int. J. Comput. Vision 10(1) (1993) 7). This property implies that tracking a paper disk in 3D could be done by tracking its elliptic projection in a sequence of 2D images. Since ellipse tracking has to consider many factors such as occlusion, background, light and so on, it is difficult to develop a general algorithm that works for all situations. In this paper, we discuss algorithms for two types of ellipse tracking: real-time tracking of single, non-occluded ellipse and off-line tracking of multiple ellipses. They are used to develop a real-time tracker to control the camera movement in a virtual environment and a multiple-tracker system that works off-line to acquire human motion data to animate a 3D human model. Implementation details and experimental results of the tracking systems are presented. The proposed 3D tracking approach is valuable for applications where accuracy and speed are not very critical but affordability and operational ease are most concerned, e.g., the educational-purpose virtual environments for kids.     

医学3D计算机视觉：研究进展和挑战

医学影像的诊断是许多临床决策的基础,而医学影像的智能分析是医疗人工智能的重要组成部分。与此同时,随着越来越多3D空间传感器的兴起和普及,3D计算机视觉正变得越发重要。本文关注医学影像分析和3D计算机的交叉领域,即医学3D计算机视觉或医学3D视觉。本文将医学3D计算机视觉系统划分为任务、数据和表征3个层面,并结合最新文献呈现这3个层面的研究进展。在任务层面,介绍医学3D计算机视觉中的分类、分割、检测、配准和成像重建,以及这些任务在临床诊断和医学影像分析中的作用和特点。在数据层面,简要介绍了医学3D数据中最重要的数据模态：包括计算机断层成像（computed tomography,CT）、磁共振成像（magnetic resonance imaging,MRI）、正电子放射断层成像（positron emission tomography,PET）等,以及一些新兴研究提出的其他数据格式。在此基础上,整理了医学3D计算机视觉中重要的研究数据集,并标注其数据模态和主要视觉任务。在表征层面,介绍并讨论了2D网络、3D网络和混合网络在医学3D数据的表征学习上的优缺点。此外,针对医学影像中普遍存在的小数据问题,重点讨论了医学3D数据表征学习中的预训练问题。最后,总结了目前医学3D计算机视觉的研究现状,并指出目前尚待解决的研究挑战、问题和方向。     

A multiview 3D modeling system based on stereo vision techniques

This paper introduces a stereo vision system to automatically generate 3D models of real objects. 3D model generation is based on the merging of multiview range images obtained from a digital stereo camera. Stereo images obtained from the camera are rectified, and a correlation-based stereo matching technique reconstructs range images from them. A turntable stage is also employed to obtain multiple range images of the objects. To register range images into a common coordinate system automatically, we introduce and calibrate a turntable coordinate system with respect to the camera coordinate system. After the registration of multiview range images, a 3D model is reconstructed using a volumetric integration technique. Error analysis on turntable calibration and 3D model reconstruction shows the accuracy of our 3D modeling system.Received: 2 August 2003, Accepted: 20 September 2004, Published online: 25 February 2005 Correspondence to: S.Y. Park     

双目立体视觉三维重建实验平台研究

三维重建是计算机视觉和虚拟现实领域的一个重要研究内容,其中,欧式重建以其直观能够反应物体原貌的特点在反求工程中得到了广泛的应用。为反求工程的需要开发了一套基于双目立体视觉的三维重建软件,综合考虑了欧式三维重建误差产生多种因素,给出了一整套比较完备的欧式三维重建流程,基于真实图像的实验结果表明,该实验平台可以获得较高的重建精度和良好的重建效果。     

基于立体视觉的玉米叶片形态测量与三维重建

提出一种基于立体视觉的玉米叶片形态测量和重建的方法。利用双目立体视觉系统获取玉米叶片的两幅图像,通过图像分割技术和边缘检测算法对每幅图像中的玉米叶片进行边缘提取;利用极线约束和彩色图像RGB值对图像进行匹配,计算出叶片边缘的三维坐标,从而恢复叶片的三维边缘;利用对叶片边缘的恢复技术,对叶片曲面进行三维重建;根据恢复的区域点云,可以测出任意两点的空间距离,实现了对叶片的三维测量。试验结果表明,此方法能够很好地恢复玉米叶片的三维信息,为玉米叶片三维形态的无损、快速检测监测提供了新的方法。     

动态变形表面的四维测量

提出一种在双目视觉中利用随机三角形纹理进行动态变形表面四维测量的方法。生成随机的三角形纹理,将纹理转印到纸、布等需要进行测量的对象表面上;用标定的两个同步相机拍摄表面的动态变形过程,获得两个同步的图像序列。使用提出的方法,检测每个图像上的三角形;使用提出的三角形描述符和三角形极线约束方法,匹配第一帧图像上的三角形,并根据匹配的结果,测量物体表面在第一帧中的三维信息;根据所测的信息生成每个三角形的局部三维拓扑结构;在两个同步的图像序列中追踪三角形,得到四维测量的结果,并且利用局部拓扑结构检测并修复出现的错误。模拟实验、实际数据实验,验证了该方法的有效性和可行性。     

Effect of 3D depth on the resolution and the observed image for auto‐stereoscopic multi‐view 3D display

In auto‐stereoscopic multi‐views, blurring occurs due to the incomplete separation of views for non‐zero depths. How this blur affects a 3D image was investigated using the commercial multi‐view 3D. The 3D input signal consisted of the square pattern and the gratings of various width and gray level values of G1 and G2. The various combinations of G1 and G2 were used to investigate the dependence of blur on gray G1 and G2 values. The 3D depth caused blurring, which caused a decrease in contrast modulation. Hence, the 3D resolution determined from contrast modulation was affected by the depth and became worse with increasing depth. Therefore, 3D resolution may be used to define the depth range within which the image degradation due to blurring is acceptable. Blur edge width values at the boundaries of gray G1 and G2 were measured and found to be similar irrespective of G1 and G2 values at the same depth. This was because blur was caused by the incomplete separation of views that are independent of G1 and G2. Hence, the blurriness of the observed 3D image is determined only by the depth. The 3D resolution and blur edge width might be useful to characterize the performance of auto‐stereoscopic multi‐view 3D.