虚拟立体视觉自由飞行昆虫运动参数测量系统

本文提出了用于测量自由飞行昆虫运动参数的立体视觉测量系统,实现了高扇翅频昆虫双侧翅膀运动参数的测量.文章在分析虚拟四目立体视觉测量原理的基础上搭建了虚拟四目立体视觉测量系统,并设计了自由飞行昆虫的引导装置,最后利用该测量系统和引导装置实现了自由飞行昆虫双侧翅膀运动参数的测量.实验结果表明该系统不仅降低了系统成本而且减少了多摄像机同步驱动的复杂性,对研究自由飞行状态昆虫运动机理具有重要意义.     

Performance Analysis and Evaluation of Geometric Parameters in Stereo Deflectometry

This paper presents a novel geometric parameters analysis to improve the measurement accuracy of stereo deflectometry. Stereo deflectometry can be used to obtain form information for freeform specular surfaces. A measurement system based on stereo deflectometry typically consists of a fringe-displaying screen, a main camera, and a reference camera. The arrangement of the components of a stereo deflectometry system is important for achieving high-accuracy measurements. In this paper, four geometric parameters of a stereo deflectometry system are analyzed and evaluated: the distance between the main camera and the measured object surface, the angle between the main camera ray and the surface normal, the distance between the fringe-displaying screen and the object, and the angle between the main camera and the reference camera. The influence of the geometric parameters on the measurement accuracy is evaluated. Experiments are performed using simulated and experimental data. The experimental results confirm the impact of these parameters on the measurement accuracy. A measurement system based on the proposed analysis has been set up to measure a stock concave mirror. Through a comparison of the given surface parameters of the concave mirror, a global measurement accuracy of 154.2 nm was achieved.     

双摄像机光笔式三维坐标测量系统研究

基于双目立体视觉传感器三维测量模型和空间坐标变换原理,采用最小二乘冗余算法,讨论了双摄像机测量空间三维点坐标的基本原理,建立了视觉测量系统的非线性测量方程.通过实验验证了双摄像机光笔式三维坐标视觉测量系统建立的可行性.     

Using neural networks for 3D measurement in stereo vision inspection systems

This paper presents a stereo vision inspection process which derives precise 3D measurements. Two artificial neural networks are used to facilitate the whole measurement process. At first, a simple camera calibration process is developed to derive the focal lengths and the relative information. A Hopfield neural network is used to solve the stereo matching problem, which has been constructed as an energy function. By means of a recursive process, the disparities of extracted feature points are obtained. In addition, a backpropagation neural network-based measurement error correction model for 3D measurement is proposed. It reduces the errors of 3D measurement associated with a part's orientation, position, magnitude and distance between the object and cameras. Four procedural processes are designed to implement this model. Our laboratory experiments demonstrate that the proposed measurement process has a satisfactory measurement result.     

A 3D Measurement Method Based on Coded Image

The binocular stereo vision system is often used to reconstruct 3D point clouds of an object. However, it is challenging to find effective matching points in two object images with similar color or less texture. This will lead to mismatching by using the stereo matching algorithm to calculate the disparity map. In this context, the object can’t be reconstructed precisely. As a countermeasure, this study proposes to combine the Gray code fringe projection with the binocular camera as well as to generate denser point clouds by projecting an active light source to increase the texture of the object, which greatly reduces the reconstruction error caused by the lack of texture. Due to the limitation of the camera viewing angle, a one-perspective binocular camera can only reconstruct the 2.5D model of an object. To obtain the 3D model of an object, point clouds obtained from multiple-view images are processed by coarse registration using the coarse SAC-IA algorithm and fine registration using the ICP algorithm, which is followed by voxel filtering fusion of the point cloud. To improve the reconstruction quality, a polarizer is mounted in front of the cameras to filter out the redundant reflected light. Eventually, the 3D model and the dimension of a vase are obtained after calibration.     

基于双目相机的光栅立体印刷图像合成

目的研究一种基于双目相机的光栅立体图像合成方法。方法首先用双目相机采集场景中2个观察角度的二维平面图像数据。基于双目立体视觉理论,采用一种鲁棒性较强的基于区域分割的图像匹配方法,得到精度较高的深度图。然后分析序列视差图像的成像模型,建立一种基于双目图像对生成序列视差图像的方法,得到连续角度等间隔的序列图像。最后基于柱镜光栅的光学特性形成的立体印刷图像编码规则,对序列视差图像进行纵向条纹抽样分割,等间隔的抽取每幅序列视差图像中的对应列实现光栅立体图像的合成。结果验证了该光栅立体图像合成方法的有效性。结论基于双目相机的光栅立体合成方法,可以使立体印刷产品实现个性化、便捷化的即时输出。     

Three-dimensional measurement of distant objects based on laser-projected CCD images

A novel measuring system based on a single CCD camera and two laser projectors to record images and perform three-dimensional measurement of a distant object is proposed here. Because of the alignment of the laser beams which form in parallel with the optical axis of the CCD camera, projected spots will appear on the same scan line in a CCD image. As a result processing of a single scan line rather than the whole image is only required to identify the projected spots in the CCD image. Complex computation of video signals of the whole image via either pattern recognition or image analysis methods is therefore circumvented. On the basic of an established relationship between the distance and pixel counts between the projected spots in the CCD image, the proposed system not only measures the distance from a distant object but also the length of two arbitrarily designated points on the object. To provide better accuracy, intrinsic parameters of the CCD camera are taken into consideration in the measurement. Furthermore, the effect of laser diffusion is also proved to be irrelevant to the measuring accuracy here. Experimental results have demonstrated that the proposed measuring method is capable of yielding accurate results of three-dimensional measurement for a distant object in a very responsive way.     

Pose estimation for autonomous grasping with a robotic arm system

A robust and accurate method for estimating the 3-D pose of a planar rigid object is presented. This article demonstrates that 3-D pose estimation becomes feasible by using the 2-D tracking points on an object of scale-invariant feature transform (SIFT) and 3-D point cloud detected by stereo vision on an object, assuming that a 3-D geometric model of an object is known a priori. The roll and pitch angles of an object are estimated by the normal vector of approximate plane of 3-D point cloud on an object and the yaw angle is estimated by 2-D tracking point on an object of SIFT. Accurate object detection and localization in the camera coordinate system is crucial for grasping. In the motion planning, the bidirectional rapidly exploring random tree algorithm is used to search for a valid path for efficient grasping. Our robot arm can robustly and autonomously grasp a randomly rotative rigid object detected by SIFT in 3-D space. We have realized a grasping scenario with a dexterous arm (ADAM) such that an object in front of ADAM can be grasped. This demonstration shows how the proposed components build a dexterous and robust system integrating object detection, pose estimation, and motion planning.     

Photometric reconstruction of a dynamic textured surface from just one color image acquisition

Textured surface analysis is essential for many applications. We present a three-dimensional recovery approach for real textured surfaces based on photometric stereo. The aim is to be able to measure the textured surfaces with a high degree of accuracy. For this, we use a color digital sensor and principles of color photometric stereo. This method uses a single color image, instead of a sequence of gray-scale images, to recover the surface of the three dimensions. It can thus be integrated into dynamic systems where there is significant relative motion between the object and the camera. To evaluate the performance of our method, we compare it on real textured surfaces to traditional photometric stereo using three images. We thus show that it is possible to have similar results with just one color image.     

标定十字结构光传感器的新方法

建立了基于十字结构光的视觉传感器的数学模型,提出了一种基于自由移动平面靶标的十字结构光传感器参数的简易标定方法。在自由移动的平面靶标上建立局部世界坐标系,将通过交比不变方法获得的两个光平面上特征点的局部世界坐标,变换到摄像机坐标系,从而获得已知三维的标定特征点。利用构建的分别位于两个光平面上标定特征点,可以实现工作状态的十字结构光传感器参数的优化估计。该标定方法降低了标定设备的成本,简化了标定过程,为十字结构光传感器的工程化应用奠定了基础。通过对圆的直径和中心坐标的测量实验,结果表明,该方法切实可行。     

Application of modulation measurement profilometry to objects with surface holes

We present a detailed discussion of how modulation measurement profilometry (MMP) is applied to measuring an object that has holes on its surface. MMP is not based on the conventional three-dimensional profilometry method with structured light triangulation but on modulation measurements; it has the advantage of measuring the surface of a test object by perpendicular projection, that is, the direction of the CCD camera is the same as that of the projecting light, and the wrapped phases need not be calculated. Thus the difficulties from shadows and spatial discontinuities in phase measurement profilometry and Fourier transform profilometry methods do not exist in MMP. Here we measure a wheellike object that is 31.5 mm thick with an outer diameter of 80 mm and an inner diameter of 20 mm. All the object seen with the CCD camera can be measured including the hole. Experimental results prove that this method is useful for three-dimensional profilometry measurement, especially for objects with discontinuous height steps and spatial isolation.     

一种双目立体视觉系统的校准方法

基于双目立体视觉系统的图像分析以及人工神经网络的三维空间建模算法,设计了一种针对双目立体视觉相机的校准方法,并可应用于运动目标点的轨迹追踪。将均匀分布目标点的校准平面放置在有效视野内的不同位置,通过双目立体视觉系统来捕获处于不同位置的校准平面图像。在图像处理之后,使用校准点中心的二维坐标作为人工神经网络训练的输入样本集,通过建立人工神经网络模型结构,实现目标点二维平面坐标到三维空间坐标的映射关系。采用这种具有通用性的方法,可以有效修正系统中存在的失真因子,获得目标三维位置信息,而无需进行复杂的相机校准操作。实验表明,提出的方案具有良好的可行性和鲁棒性。     

Stereo vision calibration based on GMDH neural network

In order to improve the accuracy and stability of stereo vision calibration, a novel stereo vision calibration approach based on the group method of data handling (GMDH) neural network is presented. Three GMDH neural networks are utilized to build a spatial mapping relationship adaptively in individual dimension. In the process of modeling, the Levenberg-Marquardt optimization algorithm is introduced as an interior criterion to train each partial model, and the corrected Akaike's information criterion is introduced as an exterior criterion to evaluate these models. Experiments demonstrate that the proposed approach is stable and able to calibrate three-dimensional (3D) locations more accurately and learn the stereo mapping models adaptively. It is a convenient way to calibrate the stereo vision without specialized knowledge of stereo vision.     

几何量数字化测量方法与装备的现状及发展趋势

几何量数字化测量方法与测量装备的发展对制造业影响深远,随着测量任务的多样化与复杂化,对几何量数字化测量方法与测量装备的要求越来越高.本文以现有的典型测量系统为例,根据传感单元工作原理的不同对这些测量系统进行了分类,分别介绍了激光跟踪仪、激光雷达、激光跟踪干涉仪、移动空间坐标测量系统、室内GPS、数字摄影测量系统的数学模...     

Single‐camera special stereo‐digital image correlation applied for accurate virtual fields method identification

A single‐camera special stereo‐DIC (SS‐DIC) is proposed for accurate virtual fields method (VFM) identification. The single‐camera SS‐DIC allows accurate surface 3D deformation measurements using a single colour camera and a specially designed colour separation device. It not only effectively eliminates the unavoidable out‐of‐plane movement/rotation due to unideal in‐plane loading but also delivers uniformly distributed measurement points that brings great simplicity and convenience for internal virtual work calculation in VFM. In addition, since only a single camera is used for stereovision, the proposed SS‐DIC system requires no complicated synchronisation devices. The effectiveness and practicality of the proposed method are evaluated by heterogeneous deformation experiments of a holed aluminium alloy and 304 stainless steel plate. Combined with a high‐speed colour camera, the proposed method is expected to be a simple and practical method for the calibration of material constitutive model under intermediate and high strain rate conditions using VFM.     

一种浮空器气囊体积测量装置的现场校准方法探讨

介绍一种浮空器气囊体积测量装置的现场校准方法,通过设定现场校准区域,构建地面控制点的局部三维坐标;在被测对象侧边的6个地面控制点设立测站,用激光全站仪和棱镜组件按照极坐标法观察得到被测对象侧边精密标定杆上所有准校点的局部三维坐标,建立校准参考坐标系,构建完整的现场校准场。测量装置对在校准参考坐标系中的精密标定杆上校准点进行拍摄获得图片,解算得到测量装置的每个相机的外方位元素,得到其位置和姿态,完成校准工作。本文提出的现场校准方法解决了测量装置在任意场景下浮空器囊体体积测量的应用问题和测量装置使用中需要搬动情况下的校准问题。     

关节式坐标测量机激光测量头参数标定

在三维视觉测量中,标定方法对测量结果的影响是决定性的.本文通过分析、比较各种视觉模型及标定方法,采用考虑镜头畸变因素的三维视觉模型以满足高精度测量系统的需求.由于关节式坐标测量机的激光测量头,使用单摄像机和线结构光来匹配被测物体表面的三维数据,本文设计了一种新型的阶梯形标定块,通过标定块图像和激光条纹图像完成了摄像机的内外参数标定和激光平面参数标定.实验证明,该标定操作过程简单,易于实现自动化,且具有较高的标定精度.     

Construction of system for controlling the dimensions of large-scale parts based on a 3D machine vision system

A 3D machine vision system based on a television camera and laser for controlling the large dimensions of large-scale parts is considered. The laser ensures structured illumination of the surface of the object, making it possible to obtain three-dimensional coordinates of representative points of the measurement object using a triangulation method and a parametric model. An approach to calibration of the model by means of a special target is presented.Translated from Izmeritelnaya Tekhnika, No. 12, pp. 24–26, December, 2004.This revised version was published online in April 2005 with a corrected cover date.     

Device for convenient measurement of spatially varying bidirectional reflectance

Capturing surface appearance is a challenging task because reflectance varies as a function of viewing and illumination direction. In addition, most real-world surfaces have a textured appearance, so reflectance also varies spatially. We present a texture camera that can conveniently capture spatially varying reflectance on a surface. Unlike other bidirectional imaging devices, the design eliminates the need for complex mechanical apparatus to move the light source and the camera over a hemisphere of possible directions. To facilitate fast and convenient measurement, the device uses a curved mirror so that multiple views of the same surface point are captured simultaneously. Simple planar motions of the imaging components also permit change of illumination direction and region imaging. We present the current prototype of this device, imaging results, and an analysis of the important imaging properties.     

大视场线结构光视觉传感器的现场标定

针对大视场线结构光视觉传感器的现场标定,提出了一种基于自由组合一维靶标的标定方法。自由组合多个一维靶标并固定,其中每个一维靶标至少包含3个共线特征点。靶标在传感器测量空间内自由摆放至少两次。以一维靶标两两之间夹角恒定为约束求解摄像机内部参数;由一维靶标消影点性质和特征点之间距离约束,求解各特征点在摄像机坐标系下的空间坐标;根据交比不变计算光平面与各一维靶标交点的摄像机坐标,拟合出光平面方程。实验表明,该方法可获得与平面靶标相当的标定精度,具有靶标加工容易、精度高、摆放次数少的特点,适合大视场线结构光视觉传感器的现场标定。