Correlation analysis of couple optical paths for microstereovision with stereo light microscope

A micro stereovision system with a stereo light microscope (SLM) has been applied in micromanipulation systems. There is a coupling connection between two optical paths of a stereo light microscope. The coupling intension corresponds with two factors: the structure of an SLM and the position of an object point in the view of an SLM. In this paper, a correlation function is proposed to describe the coupling intension between the couple optical paths of an SLM. The quantified results are applied to the error analysis of the imaging model. Experiments show that the correlation of the optical paths of a common main objective of stereo light microscope (CMO-SLM) is little more than that of a G-SLM, and the error must be considered when a pinhole imaging model is used to analyze its correlation. __________ Translated from Journal of Beijing University of Technology, 2006, 32(8): 724–729 [译自: 北京工业大学学报]     

A cross-target-based accurate calibration method of binocular stereo systems with large-scale field-of-view

This paper presents an accurate calibration method of binocular 3D measurement systems for industrial on-site inspection, which uses a cross target with ring coded points. The cross target can be used to calibrate large-scale field-of-view stereo measurement systems and obtain higher measurement precision conveniently. The world coordinates of these ring coded points are not required. All we need is the distance of two ring coded points as a scale. A new calibration model with 10 distortion parameters for each camera is proposed. The calibration initial values are computed using the relative orientation method and the Direct Linear Transform (DLT) method of photogrammetry. The bundle adjustment algorithm is used to optimize the calibration parameters as well as the 3D coordinates of the ring coded points. Experiment results show that the RMS error of the reprojection in our method is less than 0.05 pixels and the measurement error is 0.011 mm compared with the Coordinate Measuring Machine (CMM).     

水下双目立体视觉对应点匹配与三维重建方法研究

针对水下双目立体视觉成像稠密立体匹配因不满足空气中极线约束问题,提出一种水下对应点匹配与三维测量方法,可将水下双目相机采集的立体图像校正为符合共面行对齐原则的图像对,再套用空气中成熟的立体匹配方法得到水下左右相机图像视差图,从而实现水下目标的三维重建。首先,将进入相机的所有光线总和看成光场,采用四维光场参数表达对每一条光线建模,据此建立相机的折射成像模型和双目立体视觉模型并计算光线的方向向量;根据光线的光场表达将光线转化为点矢量的形式,计算方向图像上任意像点对应原图像的像素坐标并确定位置映射关系。通过插值即可快速得到符合行对齐原则的左、右方向图像,并最终获得每条光线对应的视差图。仿真结果表明,方向图像的行对齐误差小于0.8 pixel。水池实验采用事先标定的靶球作为目标物,利用随机散点主动投射以增加目标物表面的纹理信息,对靶球多次测量的均方根误差为2.8 mm,具有较高的测量精度。     

基于线结构光视觉传感器的圆孔定位误差分析

针对空间圆（类圆）孔几何量测量,传统视觉测量方法一般采用双目立体模型,基于立体像对实现对圆孔空间位置的测量,由于传感器成本、体积、重量等的限制,在特殊视觉系统,尤其在发展迅速的基于工业机器人平台的柔性视觉检测系统中均凸显其不足。本文基于单摄像机架构的线结构光视觉传感器,提出圆（类圆）孔定位两步法,并对被测圆心x ,y ,z 向坐标测量误差进行了详细讨论和分析。通过对被测圆心定位误差的分析计算,在实际测量应用中,z 向测量精度可以优于±0.25mm,x, y 向测量精度优于±0.006mm。研究结果表明该方法切实可行,可以满足实际测量需求,极大地扩展了线结构光视觉传感器的应用范围。     

Image distortion correction for micromanipulation system based on SLM microscopic vision

Stereo light microscope (SLM) simulates stereo imaging principle of human eyes. Microscopic vision system based on SLM has become an important visual tool for micro measurement, micromanipulation, and microinjection. We develop a micromanipulation system based on SLM and present an image distortion correction method. We mainly correct two kinds of image distortions: lateral and vertical distortion. Distortion correction consists of two steps. First, a linear fitting algorithm for each row or column of target points is developed, and the fitting errors are calculated. If the fitting errors are smaller than a given threshold, the linear fitting results are kept and used. Otherwise polynomial fitting procedure will be used. Second, the parallelism of straight lines is corrected. The results show that a line in world coordinate frame (WCF) is not necessarily a straight line in image coordinate frame (ICF), or two parallel lines in WCF may be not parallel in ICF. Distortion correction can restore the parallel and linear relationship. For distorted left and right images, the magnitude of distortion exceeds 6 pixels and 4 pixels in the horizontal direction, and 1.2 pixels and 1.7 pixels in the vertical direction, respectively. After corrected, for left and right image, distortion can be reduced to 0.8 pixels and 0.7 pixels in the horizontal direction, and 0.96 pixels and 1.3 pixels in the vertical direction, respectively. The results show that distortion parameters obtained from the proposed method can effectively correct distorted images. Microsc. Res. Tech. 79:162–177, 2016. © 2016 Wiley Periodicals, Inc.     

基于单目摄像机的光学立体标定技术

为了构建一种基于单摄像机的三维视觉系统,提出了重构光学标定点三维坐标、计算重构误差和优化标定参数的方法。通过移动高精度位移平台,构建三维视觉系统,计算左右摄像机位的初始参数,引入质心坐标法计算两摄像机位间的旋转平移矩阵,利用最优三角剖分法重构光学标定点的三维坐标,计算并最小化重构误差,对标定参数进行优化。实验表明：重构误差直接反映了三维重建的效率,该方法的精度和鲁棒性得到了显著的提高;实物外形测量的误差从0.1123 mm减小到0.0191 mm,标准差从0.1838减小到0.1275。该方法适合应用于三维视觉系统标定质量的评估。     

野外空间坐标测量中的任意姿态多目相机快速标定

针对野外复杂地形环境下,对于多个监测区域进行野外坐标测量的情况,提出一种利用双目立体视觉原理对相机3个姿态角及焦距同时进行现场校准的快速标定方法。该方法对传统的标定方法进行改进,可用于相机焦距、姿态未知的情况,对现场环境条件要求低,避免了传统标定方法中相机架设姿态受限的问题。首先通过选择合适的统一世界坐标系和坐标系旋转顺序,使标定得到的相机外参与相机姿态角对应。然后通过GPS测量得到两个标定点的世界坐标,将两个标定点的世界坐标和图像坐标代入成像模型,用最小二乘法解出相机的焦距和姿态角。在现场对其中一个监测区域进行实际测量验证,结果显示直径200 m的圆形监测区域内,相对误差优于0.38%。该方法工程应用性强,灵活度高,适用性广。     

Videogrammetric technique for three-dimensional structural progressive collapse measurement

In order to solve the shortcomings of the traditional transducers for monitoring the structural progressive collapse, this paper proposes to adopt the high-speed videogrammetric measurement technique to monitor the structural progressive collapse. First, the videogrammetric hardware components are presented. Second, three key issues about the stereo videogrammetric technique are studied in the paper, including camera calibration and placement, movable network control and tracking targets layout and image sequences processing. At last, three different kinds structural progressive collapse of five-story reinforced concrete frame-wall are performed, and the absolute accuracy of 0.43 mm, 0.87 mm and 0.65 mm and the relative accuracy of 0.61 mm, 0.29 mm and 0.62 mm are achieved in the X, Y and Z direction. The results show that the non-contacted videogrammetry is an alternative technique to monitor the structural progressive collapse.     

构建虚拟立体靶标的大视场高精度视觉标定

为了提高立体视觉系统在大视场下的测量精度,基于误差溯源思想提出了一种构建虚拟立体靶标的大视场高精度视觉系统标定方法,克服了大尺寸高精度标定物难以制造等问题。对影响立体视觉系统测量精度的主要因素进行分析,列出视觉测量系统的误差溯源链,解析了大视场视觉系统精度瓶颈的原因。借助激光跟踪仪,运用非线性最小二乘单位四元数算法求解坐标系刚体变换,获取大范围高精度的空间点阵,构建虚拟靶标。在相机畸变模型中考虑了三阶径向畸变和二阶切向畸变参数,并使用Levenberg-Marquardt迭代算法进行标定参数求解,进一步提高系统精度。实验构建了一套测量空间约为4m×3m×2m的双目立体视觉系统,通过对某型号高精度直线导轨进行点距测量,在测量距离3m处,152组不同长度的横向距离测量的误差算术均值为-0.003mm,误差标准差为0.08mm。测量精度相较于传统的平面标定法有较大提升。     

Measurement of multi-degree-of-freedom error motions of a precision linear air-bearing stage

This paper describes the measurement of straightness error motions (vertical straightness and horizontal straightness) and rotational error motions (pitch, yaw and roll) of a commercial precision linear air-bearing stage actuated by a linear motor. Each of the error motions was measured by two different methods for assurance of reliability. The stage was placed in the XY-plane and moved along the X-direction. The pitch error and yaw error, which were measured by an autocollimator and the angle measurement kit of a laser interferometer, were about 8.7 and 1.6 arc-s, respectively, over a travel of 150 mm with a moving speed of 10 mm/s. The roll error was measured by the autocollimator through scanning a flat mirror along the X-direction. The second method for roll error measurement was to scan two capacitance-type displacement probes along the flat surface placed in the XZ-plane. The two probes with their sensing axes in the Y-direction were aligned with a certain spacing along the Z-axis. The roll error can be obtained by dividing the difference of the outputs of the two probes by the spacing between the two probes. The roll error was measured to be approximately 11.8 arc-s over the 150 mm travel. The horizontal straightness error and the vertical straightness error (Y- and Z-straightness errors) were measured by using the straightness measurement kit of the laser interferometer. The second method for straightness measurement was to scan the flat surface with a capacitance-type displacement probe. The horizontal and vertical straightness errors of the stage over the 150 mm travel were measured to be approximately 207 and 660 nm, respectively.     

GPS双目摄像机标定及空间坐标重建

为减轻双目摄像机标定过程中对高精度靶标的依赖,实现摄像机参数的精确标定,并对空间坐标进行高精度重建,提出一种GPS双目摄像机标定及空间坐标重建方法,采用GPS代替2D或3D靶标进行双目摄像机标定。将GPS的位置在视场中任意移动,由被标摄像机拍摄多组含有GPS的图像,利用空间三维坐标与图像二维坐标间的映射关系,结合摄像机成像模型和双目摄像机标定原理,标定出双目摄像机参数,并对空间坐标进行精确重建。通过空间重建坐标与GPS实际测量值之间的相对距离误差,对重建精度进行检验。实验证明,该方法能够克服双目摄像机标定过程中对高精度靶标的依赖,空间重建坐标具有较高的精度,相对距离误差从1.56%减小到0.52%。     

Correlation analysis of couple optical paths for micro stereovision with stereo light microscope

A micro stereovision system with a stereo light microscope (SLM) has been applied in micromanipulation systems. There is a coupling connection between two optical paths of a stereo light microscope. The coupling intension corresponds with two factors: the structure of an SLM and the position of an object point in the view of an SLM. In this paper, a correlation function is proposed to describe the coupling intension between the couple optical paths of an SLM. The quantified results are applied to the error analysis of the imaging model. Experiments show that the correlation of the optical paths of a common main objective of stereo light microscope (CMO-SLM) is little more than that of a G-SLM, and the error must be considered when a pinhole imaging model is used to analyze its correlation.     

大视场双目立体视觉柔性标定

为了实现双目立体视觉系统大范围高精度三维测量,提出了一种大视场双目立体视觉系统柔性标定方法,该方法将系统中各相机内部参数标定与相机间的姿态标定进行分离,标定内部参数时,只需要令标靶相对于相机任意摆放至少三个姿态,对标靶上的编码标志点进行识别,根据标靶上编码标志点信息,建立各姿态下视图的对应关系,粗略计算标志点的初始三维坐标;建立多姿态下逆向投影误差最小的目标函数,采用非线性最小二乘优化获取精确的相机内部参数和标志点三维坐标;最后,建立基于双相机逆向投影误差最小的目标函数,优化得到精确的相机间姿态的外部参数。实验结果表明:当测量空间为1 200mm×1 000mm×1 000mm时,立体视觉系统的测量精度优于0.1mm,满足大范围双目立体视觉系统的高精度测量需求。     

Drill and clamping interface in high-performance drilling

The behaviour of a drill and a clamping unit was investigated in high-performance drilling. Some clamping units were characterised experimentally. In a series of experiments, the free-rotating drill behaviour, and the drilling events were investigated under high-performance conditions. A non-rotating measurement system, including proper procedures for signal processing, enabled the presentation of all measured values in terms and coordinates of the rotating tool. This led to a better understanding of the first-contact event, the penetration and the full drilling phases, as well as the influence of the clamping unit under different cutting conditions.Notation F impulse test exciting force [N] - Fz drilling axial force [N] - F _x F _y drilling lateral force components [N] - F _T drilling table speed (mm min^–1) - L drill overhang - T drilling torque [Nm] - X, Y, Z world coordinates [mm] - X _T,Y _T,Z _T rotating tool coordinates [mm] - _L hole location error [mm] - drill diameter [mm] - rotating angle [°] - R drill end circular movement fadius in world coordinates [mm] - X, Y drill end deflection in world coordinates [mm] - X _T, Y _T drill end deflection in world coordinates [mm] =2R     

基于ArUco Marker 及稀疏光流的动态目标实时跟踪技术

文中提出了一种基于ArUco marker及稀疏光流的动态目标跟踪方法,将ArUco marker与稀疏光流相结合实现动态跟踪,并改善双目匹配的精度。在具体实施过程中,基于检测到的ArUco marker标记进行旋翼无人机的动态跟踪,同时利用双目视觉系统测量并计算ArUco marker在相机坐标系下的相对坐标;然后通过平面拟合得出目标的实时位姿;最后开展了无人机抓捕实验,验证了ArUco marker结合稀疏光流动态目标跟踪方法的有效性。     

双目立体摄影测量中的标定方法

针对立体摄影测量中的双目立体摄影测量,利用透视变换方法及矩阵转换知识建立了双目立体摄影测量系统的空间三维坐标数学模型,提出一种不需要迭代求解摄像机参数的标定方法,避免了迭代算法收敛速度慢、耗时多的缺点。该标定方法只需对标定板在不同角度拍摄一组图像,在无需控制任何运动参数的情况下,通过成像过程中不同坐标系之间的转换,实现了像素坐标与基准坐标之间的直接转换。该算法快速、精确、简便。实验结果表明,该标定算法可达到相对误差为0．2的精度。     

Design and construction of a two-degree-of-freedom linear encoder for nanometric measurement of stage position and straightness

This paper presents a two-degree-of-freedom (two-DOF) linear encoder which can measure the position along the moving axis (X-axis) and the straightness along the axis vertical to the moving axis (Z-axis) of a precision linear stage simultaneously. The two-DOF linear encoder is composed of a reflective-type scale grating and an optical sensor head. A reference grating, which is identical to the scale grating except the scale length, is employed in the optical sensor head. Positive and negative first-order diffracted beams from the two gratings are superposed with each other in the optical sensor head to generate interference signals. The optical configuration is arranged in such a way that the direction of displacement in each axis can also be detected. A prototype two-DOF linear encoder is designed and constructed. The size of the optical sensor head is about 50 mm (X) × 50 mm (Y) × 30 mm (Z) and the pitch of the grating is 1.6 μm. It has been confirmed that the prototype two-DOF linear encoder has sub-nanometer resolutions in both the X- and Z-axes.     

基于牛顿迭代法的显微视觉控制方法研究

在建立显微立体视觉模型的基础上,提出一种仿牛顿迭代法的视觉控制方法,通过遮代逼近的方法控制机械手运动到指定住置,同时还对迭代逼近的收敛条件及近似线性显微视觉系统的迭代误差上限进行分析推导.实验证明,本方法避免了系统的精确标定和高频率采样,具有精确度高、收敛速度快、鲁棒性好等特点,平均迭代3.5次就可以以一个像素的精度逼近目标位置.     

基于样条变换多元回归模型的摄像机标定算法

针对摄像机隐式标定算法中存在的样本点数少和精度要求高的矛盾,利用样条变换多元回归模型,提出一种改进的摄像机隐式标定算法。首先采集标定图片中有限个标定样本点的像素坐标和相应的世界坐标,然后通过样条变换建立像素坐标和世界坐标间的多元回归模型,获得二维图像在世界坐标系中的三维信息,完成摄像机的标定。算法发挥上述模型在标定样本点有限的条件下,对非线性关系映射能力强、局部性质独立的特点,实现整体标定效果的改善。理论分析和实验结果均表明,与基于多项式拟合的标定算法相比,该算法的标定速度与精度显著提高。该算法已成功应用于移动机器人视觉导航系统,提高了导航信息计算的准确度。     

Volumetric error modelling of a stereo vision system for error correction in photogrammetric three-dimensional coordinate metrology

Optical three-dimensional coordinate measurement using stereo vision has systematic errors that affect measurement quality. This paper presents a scheme for measuring, modelling and correcting these errors. The position and orientation of a linear stage are measured with a laser interferometer while a stereo vision system tracks target points on the moving stage. With reference to the higher accuracy laser interferometer measurement, the displacement errors of the tracked points are evaluated. Regression using a neural network is used to generate a volumetric error model from the evaluated displacement errors. The regression model is shown to outperform other interpolation methods. The volumetric error model is validated by correcting the three-dimensional coordinates of the point cloud from a photogrammetry instrument that uses the stereo vision system. The corrected points from the measurement of a calibrated spherical artefact are shown to have size and form errors of less than 50 μm and 110 μm respectively. A reduction of up to 30% in the magnitude of the probing size error is observed after error correction is applied.