基于影子的乒乓球机器人单目视觉系统标定

视觉系统的场景标定问题是乒乓球机器人研究中要解决的首要任务。针对传统的双目视觉方案中图像处理运算量大、成本高、高速同步采集实现较为困难的缺点,探索了一种单目摄像机下的基于影子辅助成像的视觉标定方法。从单目摄像机模型出发,简化立体映射为平面映射,利用视觉场景中灯光、乒乓球和影子之间的几何关系,结合最小二乘法和最小误差估计,准确地计算视觉系统中灯与摄像机的位置,为图像识别和3维目标定位奠定基础。该方法既标定了摄像机的参数,同时也标定了辅助灯的参数,而且从平面图像坐标计算3维坐标过程简便,实验结果证明其具有较高的精度（<4 mm）,可应用于快速图像处理的场合（>60 fps）,有望成为一种低成本、便捷而有效的方法。     

结构光测量系统的投影仪标定方法研究

传统单目视觉结构光测量系统通过解相位间接计算被测物的高度信息,系统约束性过强、不易操作、且标定精度较低.将双目立体视觉原理引入单目结构光视觉测量系统,根据投影仪图像坐标和摄像机图像坐标的对应关系,将投影仪当作一个逆向的相机,建立了投影仪模型,使用成熟的相机标定算法对投影仪进行标定.再配合四步相移法和基于多频外差原理的时域相位展开法,实现条纹图像的快速精确解相位.相对于传统的单目视觉结构光测量系统,本方法具有单目视觉系统操作简单、鲁棒性强的特点,同时也可以达到双目视觉测量的精度.实验结果表明,这种方法的投影仪标定精度达到了实际应用的要求.     

双目视觉测量系统摄像机外部参数标定研究

针对双目立体视觉测量系统中摄像机标定问题,讨论了基于标准长度的外部参数标定方法,选定了摄像机透视投影模型,采用双摄像机同时对放置于视场内的十字靶标拍摄多幅图像,得出了基于LabVIEW开发的摄像机标定方法.该方法利用了LabVIEW的开发环境,使用了数学工具包,将遗传算法与LM算法相结合,优化迭代获得摄像机外部参数,运算速度和精度大大提高.开发的模块可用于基于LabVIEW开发的工程软件进行高精度尺寸现场测量.在双目立体视觉测量系统标定结果基础上对标准靶进行测量,测量结果标准差达到0.1.     

融合2D/3D摄像机的方法与获取高精度三维视觉信息的装置

三维飞行时间摄像机可实时同步获取场景三维信息和灰度图像信息.虽然它存在图像分辨率和质量较差等问题,但它可作为二维摄像机的互补.本文借鉴立体视觉技术,提出了一种2D/3D摄像机融合的三维视觉信息获取方案.论文首先基于固定空间关系和相近视野原则,设计2D/3D立体摄像机系统对空间场景同步成像.结合三维TOF摄像机成像特性,论文借鉴立体视觉技术完成二维摄像机的高质量二维彩色图像与插补后的三维摄像机深度图像的匹配关联.因此,本方法可实现场景的高精度彩色图像和对应三维空间信息的实时同步获取,同时保留了二维摄像机的高质量彩色二维成像和三维摄像机的快速稠密三维信息获取的优势.2D/3D摄像机图像融合匹配算法复杂度低,匹配精度和准确度取决于二维摄像机和三维摄像机自身性能、摄像机标定参数精度和深度图像插补算法,不会引入新的运算误差.试验结果验证了本文算法的有效性和精确度.     

基于立体视觉的目标姿态测量技术

基于动态场景分析的计算机视觉系统尤其是对运动目标的运动参数测量已成为计算机视觉研究的热点;建立了基于双目立体视觉的目标姿态测量系统,使用两个摄像机在不同视角对同一目标进行拍摄,采用DLT方法对摄像机标定;对拍摄到的图像进行去噪、滤波,通过立体图像匹配得到特征点在两幅图像中的同名点,姿态参数求解结合DLT算法和立体图像匹配算法,实现了对目标姿态参数的测量,得到了目标的三维姿态信息;实验结果表明,该测量系统结构简单,计算量小,具有较高的测量精度.     

双目视觉的立体标定方法

为实现双目视觉系统的立体标定,分析了摄像机成像模型,并充分考虑了透镜的径向畸变和切向畸变,提出了一种新的立体标定算法。该算法利用张正友的灵活标定算法,初步求取摄像机的内参数,结合Brown算法并提取图像中角点的子像素级坐标,精确求取摄像机内参数和畸变向量。为方便后续的图像校正,基于前面的单个摄像机标定,通过计算空间中的景物点在左右摄像机成像平面上的位置关系,计算出双目视觉系统中两个摄像机之间的旋转矩阵R和平移向量T,从而实现了立体标定。实验结果表明,该算法能取得较高的精度,可以应用于双目视觉系统。     

多目立体视觉在工业测量中的应用研究

以双目立体视觉系统为基础，提出了一种多目立体视觉测量的方法。该方法利用摄像机旋转来获取多幅图像，利用这些立体图像对中对应特征点的视差得到物体的深度信息，达到多目测量的目的，通过实验并与双目立体视觉相比较，验证了其在摄像机标定和提高测量结果精度方面的优越性。     

双目立体视觉系统的非线性摄像机标定技术*

针对双目立体视觉的工业检测精度和实时性要求,采用LENZ畸变模型建立基于面阵CCD的双目成像几何模型,分析了成像模型的内外参数及针孔模型的局限性,提出改进的双目立体视觉系统摄像机两步标定方法。利用HALCON标定板及函数库平台,采用亚像素精度的边缘提取和椭圆拟合算法精确获取标定点,以建立像点与空间点的对应关系,并对标定参数进行非线性优化。实验证明该标定算法灵活准确,并具有良好的可扩展性。     

基于共面靶标双目立体视觉传感器标定

根据双目立体视觉传感器的特点,提出了一种基于共面靶标的双目立体视觉传感器的标定方法.在不需要外部测量设备的情况下,通过共面靶标在平面上自由移动,获得靶标的标定点图像坐标,利用类似于Dr.Janne Heikkil(a)和Dr.Olli Silven所提出来的摄像机内部参数标定模型,采用线性和非线性结合的方法对双目摄像机进行摄像机内部参数的标定.试验结果表明,标定参数与出厂参数有一定的差异,但和实际情况还是吻合的,并且标定方法操作简便,切实可行.     

双目视觉的弱点动目标粒子滤波跟踪定位研究

在研究红外图像序列的弱点动目标粒子滤波跟踪算法和双目立体视觉摄像机标定算法的基础上,基于双目视觉设计了双目图像序列弱点动目标的跟踪、空间定位系统。仿真实验表明：对粒子基于估计参数后的密度函数分配权重的算法,提高了图像跟踪精度,采用线性三角定位方法,有效地实现目标空间定位。     

基于机器视觉的检测系统

反映产品质量：这里所描述基本的技巧和窍门对机器视觉的搭建以及采用机器视觉进行测量．诊断和其他的应用将有所帮助。[编者按]     

Applications of Augmented Vision Head-Mounted Systems in Vision Rehabilitation

Vision loss typically affects either the wide peripheral vision (important for mobility), or central vision (important for seeing details). Traditional optical visual aids usually recover the lost visual function, but at a high cost for the remaining visual function. We have developed a novel concept of vision-multiplexing using augmented vision head-mounted display systems to address vision loss. Two applications are discussed in this paper. In the first, minified edge images from a head-mounted video camera are presented on a see-through display providing visual field expansion for people with peripheral vision loss, while still enabling the full resolution of the residual central vision to be maintained. The concept has been applied in daytime and nighttime devices. A series of studies suggested that the system could help with visual search, obstacle avoidance, and nighttime mobility. Subjects were positive in their ratings of device cosmetics and ergonomics. The second application is for people with central vision loss. Using an on-axis aligned camera and display system, central visibility is enhanced with 1:1 scale edge images, while still enabling the wide field of the unimpaired peripheral vision to be maintained. The registration error of the system was found to be low in laboratory testing.     

Vision and Rain

The visual effects of rain are complex. Rain produces sharp intensity changes in images and videos that can severely impair the performance of outdoor vision systems. In this paper, we provide a comprehensive analysis of the visual effects of rain and the various factors that affect it. Based on this analysis, we develop efficient algorithms for handling rain in computer vision as well as for photorealistic rendering of rain in computer graphics. We first develop a photometric model that describes the intensities produced by individual rain streaks and a dynamic model that captures the spatio-temporal properties of rain. Together, these models describe the complete visual appearance of rain. Using these models, we develop a simple and effective post-processing algorithm for detection and removal of rain from videos. We show that our algorithm can distinguish rain from complex motion of scene objects and other time-varying textures. We then extend our analysis by studying how various factors such as camera parameters, rain properties and scene brightness affect the appearance of rain. We show that the unique physical properties of rain—its small size, high velocity and spatial distribution—makes its visibility depend strongly on camera parameters. This dependence is used to reduce the visibility of rain during image acquisition by judiciously selecting camera parameters. Conversely, camera parameters can also be chosen to enhance the visibility of rain. This ability can be used to develop an inexpensive and portable camera-based rain gauge that provides instantaneous rain-rate measurements. Finally, we develop a rain streak appearance model that accounts for the rapid shape distortions (i.e. oscillations) that a raindrop undergoes as it falls. We show that modeling these distortions allows us to faithfully render the complex intensity patterns that are visible in the case of raindrops that are close to the camera.     

Learning Low-Level Vision

We describe a learning-based method for low-level vision problems—estimating scenes from images. We generate a synthetic world of scenes and their corresponding rendered images, modeling their relationships with a Markov network. Bayesian belief propagation allows us to efficiently find a local maximum of the posterior probability for the scene, given an image. We call this approach VISTA—Vision by Image/Scene TrAining.We apply VISTA to the super-resolution problem (estimating high frequency details from a low-resolution image), showing good results. To illustrate the potential breadth of the technique, we also apply it in two other problem domains, both simplified. We learn to distinguish shading from reflectance variations in a single image under particular lighting conditions. For the motion estimation problem in a blobs world, we show figure/ground discrimination, solution of the aperture problem, and filling-in arising from application of the same probabilistic machinery.     

机器视觉技术及其应用综述

1 机器视觉概念 机器视觉主要研究用计算机来模拟人的视觉功能从客观事物的图像中提取信息，进行处理并加以理解，最终用于实际检测、测量和控制。一个典型的工业机器视觉应用系统包括光源、光学系统、图像捕捉系统、图像数字化模块、数字图像处理模块、智能判断决策模块和机械控制执行模块，如图1所示。首先采用CCD摄像机或其它图像拍摄装置将目标转换成图像信号，然后转变成数字化信号传送给专用的图像处理系统，根据像素分布、亮度和颜色等信息，进行各种运算来抽取目标的特征，根据预设的容许度和其他条件输出判断结果。 光源光学成…     

影像的触觉

西班牙多媒体艺术家丹尼尔·卡诺卡（Daniel Canogar）多年致力于研究新影像技术开发的可能性,从2004年的《舞台记忆》（Memory Theater）系列,到2006年的《罗马秘密》（Clandestinos Rome）.     

平行视觉:基于ACP的智能视觉计算方法

在视觉计算研究中,对复杂环境的适应能力通常决定了算法能否实际应用,已经成为该领域的研究焦点之一.由人工社会（Artificial societies）、计算实验（Computational experiments）、平行执行（Parallel execution）构成的ACP理论在复杂系统建模与调控中发挥着重要作用.本文将ACP理论引入智能视觉计算领域,提出平行视觉的基本框架与关键技术.平行视觉利用人工场景来模拟和表示复杂挑战的实际场景,通过计算实验进行各种视觉模型的训练与评估,最后借助平行执行来在线优化视觉系统,实现对复杂环境的智能感知与理解.这一虚实互动的视觉计算方法结合了计算机图形学、虚拟现实、机器学习、知识自动化等技术,是视觉系统走向应用的有效途径和自然选择.     

Computer Vision Methodologies

In this paper we address the problem of methodologies for computer vision. In the first part we will present a brief survey of the Marr paradigm, e.g., what David Marr called his philosophy. We will emphasize the sequence of hypotheses which progressively makes the scene recovery approach explicit as well as the limitations of this approach. We then present the goal-directed approach as an alternative to the recovery school: behaviorism versus reconstructionism. We show that this dichotomy is not the only possible one and introduce the idealism versus empiricism dichotomy. We propose some directions toward a new methodology in a systemic framework involving another, higher-level, methodological dichotomy: systemism versus reductionism. In this new framework we try to exploit of all the sources of constraints, and, thereby, to reconcile some of the previous approaches like recovery school and purposive vision.     

Vision and action

Our work on active vision has recently focused on the computational modelling of navigational tasks, where our investigations were guided by the idea of approaching vision for behavioural systems in the form of modules that are directly related to perceptual tasks. These studies led us to branch in various directions and inquire into the problems that have to be addressed in order to obtain an overall understanding of perceptual systems. In this paper, we present our views about the architecture of vision systems, about how to tackle the design and analysis of perceptual systems, and promising future research directions. Our suggested approach for understanding behavioural vision to realize the relationships of perception and action builds on two earlier approaches, the Medusa philosophy¹ and the Synthetic approach². The resulting framework calls for synthesizing an artificial vision system by studying vision competences of increasing complexity and, at the same time, pursuing the integration of the perceptual components with action and learning modules. We expect that computer vision research in the future will progress in tight collaboration with many other disciplines that are concerned with empirical approaches to vision, i.e. the understanding of biological vision. Throughout the paper, we describe biological findings that motivate computational arguments which we believe will influence studies of computer vision in the near future.