足球比赛场景的三维重建和动画生成

介绍一个实用的足球比赛场景三维重建系统。该系统通过比赛的录像片段恢复场景的三维模型 ,包括球员的姿态、位置和足球的运动轨迹 ,允许用户在足球场上漫游 ,从任意的视角观看比赛的进行。通过序列图像 ,系统能够生成一段动画 ,重现精彩的比赛片断。系统通过自动和手工相结合的办法实现特征提取和跟踪过程 ,利用线性定标的方法恢复摄像机视点。经过实验证明 ,该系统重建的模型具有较高的精度 ,误差不超过 1%。     

基于圆曲线的摄像机自定标

本文给出了一种基于圆曲线的摄像机自定标的新方法.设计了一个含有三个两两不包含的圆(其中圆心和半径大小是未知的)的平面模板,让摄像机在三个以上的不同方位观察该模板,然后利用模板的图像来求解摄像机的内参数.文中,首先介绍了三维摄影空间中绝对二次曲线和圆环点的相关知识,接着推导出摄像机内参数的约束方程,最后又详细讨论了圆环点及其图像的求法.其中关键技术是通过求解像曲线的切线确定圆心图像的像素坐标,然后确定圆环点图像坐标来实现摄像机的定标模拟实验和真实图像实验也表明,本方法具有很好的鲁棒性.由于所用模板中的圆不需要精确定位,因此该模板易于制作.由于该技术对摄像机的运动没有限制,因此,它可以在一般的实验平台上实现.     

单目平行线约束下的空间点坐标恢复

提出一种从单目像机拍摄的二维投影图像中恢复空间点三维坐标的简化算法.假定摄像机与空间中的一对平行线的位置关系已知,同时摄像机坐标系下平行线所在平面中的任意空间点在像平面中的投影也已知,通过射影几何可得图像坐标到目标点三维空间坐标的转换系数,即坐标转换因数,从而估计出三维空间点的坐标.实验中通过对人体行走轨迹进行估计来测试算法性能,结果表明算法简单有效,计算开销小.     

一种基于球场模型的广播足球视频摄像机自动定标方法

随着足球视频语义内容分析和理解、自动视频索引、虚拟增强现实表示等研究的不断深入,摄像机定标技术扮演了越来越重要的角色.基于此,提出了一种基于球场模型的广播足球视频摄像机自动定标算法,该算法建立在所定义的球场模型基础之上,首先通过改进的球场线探测算法得到球场平面的特征点,并求解摄像机同形 (Homography)矩阵,然后,利用所求解的同形矩阵来定位球门,得到球门平面的两个特征点,最后根据基于K均值聚类和Hough-like搜索的方法来得到最优的摄像机内外参数.初步的实验结果表明,依据本文算法所求解的摄像机参数最优值相比初始值精确度更高,并且其在连续帧中也更加稳定.     

线结构光传感器参数现场标定方法

为了精确、快速、高效地标定线结构光传感器参数,提出了一种线结构光传感器参数现场标定方法。根据摄像机标定方法,并结合L-M非线性优化算法对摄像机内外参数及镜头畸变系数进行标定。拍摄不同姿态下的平面靶标图像,利用靶标图像计算摄像机外参计算靶标上的圆点在摄像机坐标系下的三维坐标,并构建靶标平面方程。将激光线投射到不同姿态的靶标平面上,通过靶标平面方程计算出激光线上点在摄像机坐标系下的3D坐标,由不同位置重构出激光点在摄像机坐标系下的3D坐标来完成光平面参数标定。通过对摄像机参数、畸变系数和光平面参数的标定,重构目标物体进行测试。测量结果表明:该算法能够快速、准确地获取小车车体的三维坐标,并构造出车体的三维模型。该方法适用于大视场的工业现场标定。     

基于Matlab的二维世界坐标重建

计算机视觉技术研究的目的是要使计算机具有通过二维图像认知三维环境信息的能力.摄像机标定的目的就是要建立三维世界坐标与二维图像坐标之间的一种对应关系.论文为了实现二维世界坐标重建,依据摄像机标定技术与利用立体视觉方法进行二维重建的原理,建立了空间某—点图像坐标和世界坐标的对应关系模型,并在Matlab环境下验证了利用单目摄像机先定标求取投影矩阵之后进行二维世界坐标重建的可行性.实验结果表明该方法可行有效.     

CCD摄像机标定的研究

在计算机视觉中,二维计算机坐标和三维物体空间坐标的关系可通过摄像机模型来建立.模型中的参数包括:摄像机几何、光学特性参数(内参数)及摄像机空间位置参数(外参数).摄像机的标定就是要确定这些参数.本文分析了三维空间点投影在像平面的像点产生畸变的原因:在大视场摄像机镜头各向同性,而且物像空间媒质均匀的情况下,像素单位元面积产生的变化引起像点畸变,并在实际图像坐标到计算机图像(帧存)坐标标定过程中推导出CCD传感器单元N方向的比例系数N<,x>的表达式,并进行了实验测量分析,取得的结果对提高标定精度具有意义.     

一种基于图像序列和外部平移数据的摄像机自定标方法

摄像机标定是从二维图像获取三维信息必不可少的步骤。本文提出了一种新的基于图像序列的自定标方法。通过控制摄像机平台作3次平移运动（其中任意2次均不在同一平面上）且不需要读取运动平台的平移数据，即可线性地标定摄像机的内参数。大量的模拟实验表明该算法精度高和鲁棒性强。     

基于HALCON的全景摄像机标定及应用研究

现有全景摄像机标定算法中,场景的先验知识在很多情况下难以准确获取。提出了一种基于HALCON的双曲面折反射全景摄像机标定算法。通过摄像机或者标定板的相互移动来获取不同位置的标定板图像;通过HALCON预处理后提取角点坐标;通过最小二乘法求解标定点投影方程的展开系数得到相机的内外参数。该算法中摄像机只需满足单视点要求,不需要场景的先验知识,也不需要特殊的装置和设备。实验结果表明能够获得较高的标定精度,并且在足球机器人边线距离的测量中得到了准确的结果。     

基于长序列图像的三维重建技术研究*

提出一种基于长序列未定标图像的三维重建方法,并将其成功地应用于增强现实实例中.首先,基于传统KLT跟踪算法提出了一种针对序列图像的改进特征点匹配策略,通过特征点运动向量的预测减小了相应特征点的搜索范围,进一步根据相近特征点邻域窗口在透视畸变上的相似性大大提高了匹配算法的效率;在得到序列图像的匹配结果后,将传统基于仿射成像模型的测量矩阵(Measurement Matrix)保秩分解算法扩展到透视成像模型中,从而一次性得到整个场景的射影重建;进一步在摄像机自定标的基础上得到整个场景的三维欧氏模型和摄像机的成像矩阵.最后给出真实图像序列的三维重建实验结果,并成功地将其应用到增强现实实例中.     

Kinematic Calibration and Pose Measurement of a Medical Parallel Manipulator by Optical Position Sensors

In the applications of parallel manipulators, kinematic calibration is required to eliminate the errors resulting from the manufacturing and assembly of both base and tools. In this paper, a calibration method of base and tool transformation is developed by virtue of optical position sensors. An error model for calibration is constructed using differential geometry method. The pose error is obtained based on pose measurement results of OPTOTRAK 3020, a commercial 3D position measurement system. An iterative least squares procedure is used to identify the error parameters in the base and tool transformations. Simulation and experiment results are presented to demonstrate the effectiveness of the method for transformation matrices calibration. © 2003 Wiley Periodicals, Inc.     

Camera calibration for a mobile robot prototype

Stereovision is an effective technique to use a CCD video camera to determine the 3D position of a target object from two or more simultaneous views of the scene. Camera calibration is a central issue in finding the position of objects in a stereovision system. This is usually carried out by calibrating each camera independently, and then applying a geometric transformation of the external parameters to find the geometry of the stereo setting. After calibration, the distance of various target objects in the scene can be calculated with CCD video cameras, and recovering the 3D structure from 2D images becomes simpler. However, the process of camera calibration is complicated. Based on the ideal pinhole model of a camera, we describe formulas to calculate intrinsic parameters that specify the correct camera characteristics, and extrinsic parameters that describe the spatial relationship between the camera and the world coordinate system. A simple camera calibration method for our CCD video cameras and corresponding experiment results are also given. This work was presented in part at the 7th International Symposium on Artificial Life and Robotics, Oita, Japan, January 16–18, 2002     

A Video-Based 3D-Reconstruction of Soccer Games

In this paper we present SoccerMan, a reconstruction system designed to generate animated, virtual 3D views from two synchronous video sequences of a short part of a given soccer game. After the reconstruction process, which needs also some manual interaction, the virtual 3D scene can be examined and 'replayed' from any viewpoint. Players are modeled as so-called animated texture objects, i.e. 2D player shapes are extracted from video and texture-mapped onto rectangles in 3D space. Animated texture objects have shown very appropriate as a 3D representation of soccer players in motion, as the visual nature of the original human motion is preserved. The trajectories of the players and the ball in 3D space are reconstructed accurately. In order to create a 3D reconstruction of a given soccer scene, the following steps have to be executed: 1) Camera parameters of all frames of both sequences are computed (camera calibration). 2) The playground texture is extracted from the video sequences. 3) Trajectories of the ball and the players' heads are computed after manually specifying their image positions in a few key frames. 4) Player textures are extracted automatically from video. 5) The shapes of colliding or occluding players are separated automatically. 6) For visualization, player shapes are texture-mapped onto appropriately placed rectangles in virtual space. SoccerMan is a novel experimental sports analysis system with fairly ambitious objectives. Its design decisions, in particular to start from two synchronous video sequences and to model players by texture objects, have already proven promising.     

基于一阶径向畸变算法的双目摄像机多位姿标定方法

双目立体视觉中在对物体进行三维测量或精准定位时,需要对摄像机进行标定以获得其内外参数。研究径向畸变摄像机模型,构造了基于一阶径向畸变（RAC）算法的双目摄像机内外参数线性求解公式。考虑侧倾角、旋转角、俯仰角以及透镜的主要畸变因素,修正了传统RAC标定法中只考虑径向畸变、部分参数需要先验值的缺陷。利用标定所得内、外参数进行了多位姿双目摄像机三维重构实验。实验结果表明,该标定方法重投影误差分布在[-0.3,0.3],动态识别结果与实际运行轨迹重合率为96%,对降低双目立体视觉三维测量误差率有积极性影响。     

Camera calibration and three-dimensional world reconstruction of stereo-vision using neural networks

Stereo-pair images obtained from two cameras can be used to compute three-dimensional (3D) world coordinates of a point using triangulation. However, to apply this method, camera calibration parameters for each camera need to be experimentally obtained. Camera calibration is a rigorous experimental procedure in which typically 12 parameters are to be evaluated for each camera. The general camera model is often such that the system becomes nonlinear and requires good initial estimates to converge to a solution. We propose that, for stereo vision applications in which real-world coordinates are to be evaluated, artificial neural networks be used to train the system such that the need for camera calibration is eliminated. The training set for our neural network consists of a variety of stereo-pair images and corresponding 3D world coordinates. We present the results obtained on our prototype mobile robot that employs two cameras as its sole sensors and navigates through simple regular obstacles in a high-contrast environment. We observe that the percentage errors obtained from our set-up are comparable with those obtained through standard camera calibration techniques and that the system is accurate enough for most machine-vision applications.     

基于标准圆柱的线激光轮廓扫描机器人手眼标定方法

在搭载线激光轮廓传感器的机器人平台手眼标定问题中,依靠线激光轮廓传感器输出的2维点云信息进行标定,存在标定过程复杂、标定精度低的缺点。本文针对这些问题,提出一种基于圆柱侧面约束的手眼标定方法。通过改变扫描机器人末端位姿,获得不同位姿下圆柱侧面扫描数据。对于激光平面与圆柱侧面相交得到的椭圆轮廓,利用随机抽样一致性（RANSAC）算法得到椭圆轮廓中心点坐标。利用椭圆轮廓的估计中心点到圆柱中轴线的距离建立约束优化方程,将手眼标定问题转化为约束优化问题。利用粒子群优化（PSO）算法和广义拉格朗日乘子法的融合算法求解约束优化问题,得到手眼标定的变换矩阵。最后基于所提方法进行模拟仿真和扫描重建试验。分别讨论了标定数据误差、标定参照物位置和标定参数初始值对标定结果的影响,并验证了手眼标定精度。结果表明,该方法不受标定参照物位置和标定参数初始值的影响,具有操作简单、通用性强、标定精度高等特点,标定精度在0.15mm以内,适合现场标定。     

基于投影仪和摄像机的结构光视觉标定方法

为实现基于投影仪和摄像机的结构光视觉系统连续扫描,需要计算投影仪投影的任意光平面与摄像机图像平面的空间位置关系,进而需要求取摄像机光心与投影仪光心之间的相对位置关系。求取摄像机的内参数,在标定板上选取四个角点作为特征点并利用摄像机内参数求取该四个特征点的外参数,从而知道四个特征点在摄像机坐标系中的坐标。利用投影仪自身参数求解特征点在投影仪坐标系中的坐标,从而计算出摄像机光心与投影仪光心之间的相对位置关系,实现结构光视觉标定。利用标定后的视觉系统,对标定板上的角点距离进行测量,最大相对误差为0.277%,表明该标定算法可以应用于基于投影仪和摄像机的结构光视觉系统。     

Auto‐calibration of a projector–camera stereo system for projection mapping

Standard camera and projector calibration techniques use a checkerboard that is manually shown at different poses to determine the calibration parameters. Furthermore, when image geometric correction must be performed on a three‐dimensional (3D) surface, such as projection mapping, the surface geometry must be determined. Camera calibration and 3D surface estimation can be costly, error prone, and time‐consuming when performed manually. To address this issue, we use an auto‐calibration technique that projects a series of Gray code structured light patterns. These patterns are captured by the camera to build a dense pixel correspondence between the projector and camera, which are used to calibrate the stereo system using an objective function, which embeds the calibration parameters together with the undistorted points. Minimization is carried out by a greedy algorithm that minimizes the cost at each iteration with respect to both calibration parameters and noisy image points. We test the auto‐calibration on different scenes and show that the results closely match a manual calibration of the system. We show that this technique can be used to build a 3D model of the scene, which in turn with the dense pixel correspondence can be used for geometric screen correction on any arbitrary surface.     

Combined evolution strategies for dynamic calibration ofvideo-based measurement systems

Calibration is a crucial step to obtaining 3D measurement using video camera-based stereo systems. All the parameters can be determined except for the pair of principal points, which poses a considerable drawback. Whereas in low-accuracy systems such points can be assumed to lie at the image center without degrading the overall 3D accuracy; in high-accuracy systems their true position must be computed accurately. In this case, all the calibration parameters can still be estimated through epipolar geometry, but it is necessary to minimize a highly nonlinear cost function. It is shown here that by combining two evolutionary optimization strategies this minimization can be carried out, both efficiently and reliably. The resulting strategy, which we call enhanced evolutionary search (EES), allows the full calibration of a stereo system using only a rigid bar. Moreover, EES can be applied to a wide range of applications where the cost function contains complex nonlinear relationships among the optimization variables