定位图像匹配尺度与区域的摄像机位姿实时跟踪

目的 提出一种定位图像匹配尺度及区域的有效算法,通过实现当前屏幕图像特征点与模板图像中对应尺度下部分区域中的特征点匹配,实现摄像机对模板图像的实时跟踪,解决3维跟踪算法中匹配精度与效率问题。方法 在预处理阶段,算法对模板图像建立多尺度表示,各尺度下的图像进行区域划分,在每个区域内采用ORB（oriented FAST and rotated BRIEF）方法提取特征点并生成描述子,由此构建图像特征点的分级分区管理模式。在实时跟踪阶段,对于当前摄像机获得的图像,首先定位该图像所对应的尺度范围,在相应尺度范围内确定与当前图像重叠度大的图像区域,然后将当前图像与模板图像对应的尺度与区域中的特征点集进行匹配,最后根据匹配点对计算摄像机的位姿。结果 利用公开图像数据库（stanford mobile visual search dataset）中不同分辨率的模板图像及更多图像进行实验,结果表明,本文算法性能稳定,配准误差在1个像素左右;系统运行帧率总体稳定在2030 帧/s。结论 与多种经典算法对比,新方法能够更好地定位图像匹配尺度与区域,采用这种局部特征点匹配的方法在配准精度与计算效率方面比现有方法有明显提升,并且当模板图像分辨率较高时性能更好,特别适合移动增强现实应用。     

The effects of motion and stereopsis on three-dimensional visualization

Previous studies have demonstrated that motion cues combined with stereoscopic viewing can enhance the perception of three-dimensional objects displayed on a two-dimensional computer screen. Using a variant of the mental rotation paradigm, subjects view pairs of object images presented on a computer terminal and judge whether the objects are the same or different. The effects of four variables on the accuracy and speed of decision performances are assessed: stereo vs. mono viewing, controlled vs. uncontrolled object motion, cube vs. sphere construction and wire frame vs. solid surface characteristic. Viewing the objects as three-dimensional images results in more accurate and faster decision performances. Furthermore, accuracy improves although response time increases when subjects control the object motion. Subjects are equally accurate comparing wire frame and solid images, although they take longer comparing wire frame images. The cube-based or sphere-based object construction has no impact on decision accuracy nor response time.     

Quick recognition of circular objects in a black-white picture

A method of circular objects recognition is presented that depends on converting input picture into binary image, next on tracing perpendicular chords along the object determining its maximum extension, and then on separation and analysis of a rectangular frame determined by the chords. The process can be performed under the assumption that neighboring objects are sufficiently distant from each other. Brightness, are and gravity center of its original gray-scale contents are calculated inside that rectangular frame. These parameters are used for specification of each separated object. Values of these parameters are used to mark arcs connected to a node into which the object is transformed. The third step of data processing is to compare the identity (automorphism) or similarity (isomorphism) of a graph obtained as the result of a recognition process with a set of reference (template) graphs stored in a memory. The nodes of the recognized image that have greatest weights are taken into account in the first place in the identification (matching) process.     

基于角仿射不变的特征匹配

同一场景的不同图像匹配是计算机视觉中的一个基本问题，在诸如三维重建、对象识别和分类、图像配准和相机自校正等应用中，特征匹配都是一个关键步骤。为解决三维场景重建问题，通过改进目前特征匹配的不足，提出了一种基于角仿射不变的特征匹配算法。该方法是使用角作为图像匹配选取的特征，通过仿射不变处理来消除图像缩放、扭曲、旋转和平移产生的影响，实验表明，该算法具有良好的匹配性能，可以对差异较大的图像对进行特征匹配。     

基于模型和区域相关融合的鲁棒跟踪算法

提出了一种模型部分匹配的相似度量方法,利用匹配的完整度、归一化的匹配点相对于模型的偏移量期望和方差的加权和作为相似性度量。在此基础上建立模型匹配算法,利用模型匹配和区域相关融合的方法进行目标跟踪。算法能够在摄像机静止和运动的情况下进行稳定的跟踪,能够适应目标的部分遮挡、光照和姿态的变化。利用参数化的模型能够在复杂的背景环境中实现实时的多目标跟踪。     

基于静止分割和运动矢量的对象跟踪

运动对象的分割和跟踪是视频图象处理的一个很重要和困难的部分。提出一种非常有效的对象跟踪算法,能够检测到当前帧给定区域的对象并跟踪,不需要事先了解此对象的空间－时域的信息,也不需要进行镜头运动补偿。静止分割分用Watershed算法,而运动矢量用块匹配法。尽管所要跟踪对象会经历某些形变,依旧能获得较好的结果。     

Matching ‘sticks,plates and blobs’ objects using geometric and relational constraints

A recognition scheme using relational and rough geometric information about three-dimensional man-made objects to recognize instances of the objects in single perspectivenormal views of scenes is described. Experiments performed using the matching scheme show that, in most cases, the object in the view can be identified correctly and reasonable estimates can be made of the unknown camera position responsible for generating the given view.The technique is based on the fact that the camera position constrains the appearance of the various parts of the object. The propagation of these constraints from one planar object surface to another through the projection equations is worked out. This constraint propagation guides the matching scheme in the development of the interpretation of the scene. The results provide an estimate of the camera position within 20° of the actual location.     

基于山体轮廓匹配的相机空间定位方法研究

相机空间定位是一个经典问题。本文提出了一种匹配图像轮廓线的相机空间定位方法。这种方法可以在没有标定物的情况下,利用已有的地理信息进行相机的空间定位。实验证明,该方法可以发展成为一种行之有效的计算机辅助空间定位工具。     

图像特征点匹配的强壮算法

同一场景的不同图像匹配是计算机视觉中的一个基本问题，在诸如三维重度，对象识别和分类、图像对齐和相机自校正等应用中，特征匹配都是一个关键步骤，其中特征点匹配是较为常用的一种方法，特征点匹配的效果受到很多因素的影响，如景物的遮挡，光照和噪声等，变化很大，文中对结指标派算法进行扩以解决全局优化问题，并利用场景深度局部连续的条件作为附加约束，提出一种新的特征点匹配算法，整个算法只用到两次优化，而且几乎全部使用矩阵运算，效率比已有的算法高，实验表明该算法的效果是令人满意的。     

Exact algorithms for single frame selection on multiaxis Satellites

New multi-axis satellites allow camera imaging parameters to be set during each time slot based on competing demand for images, specified as rectangular requested viewing zones over the camera's reachable field of view. The single frame selection (SFS) problem is to find the camera frame parameters that maximize reward during each time window. We formalize the SFS problem based on a new reward metric that takes into account area coverage and image resolution. For a set of n client requests and a satellite with m discrete resolution levels, we give an algorithm that solves the SFS problem in time O(n/sup 2/m). For satellites with continuously variable resolution (m=/spl infin/), we give an algorithm that runs in time O(n/sup 3/). We have implemented all algorithms and verify performance using random inputs. Note to Practitioners-This paper is motivated by recent innovations in earth imaging by commercial satellites. In contrast to previous methods that required waits of up to 21 days for desired earth- satellite alignment, new satellites have onboard pan-tilt-zoom cameras that can be remotely directed to provide near real-time response to requests for images of specific areas on the earth's surface. We consider the problem of resolving competing requests for images: Given client demand as a set of rectangles on the earth surface, compute camera settings that optimize the tradeoff between pan, tilt, and zoom parameters to maximize camera revenue during each time slot. We define a new quality metric and algorithms for solving the problem for the cases of discrete and continuous zoom values. These results are a step toward multiple frame selection which will be addressed in future research. The metric and algorithms presented in this paper may also be applied to collaborative teleoperation of ground-based robot cameras for inspection and videoconferencing and for scheduling astronomic telescopes.     

基于可变模型的目标实时跟踪

为了在图像序列中实现目标的快速定位和实时跟踪,该文提出了一种基于可变模型的快速目标跟踪算法,在已知模型条件下,利用区域模型相关匹配的思想对目标模型进行实时更新,充分利用目标莲续运动过程中目标形状在两个连续帧中变化不大、相邻两帧中目标的速度和位移变化不大的特点,以当前帧目标模型作为下一帧的先验模型;综合运用模型梯度信息、运动信息和模型区域特征匹配的方法来跟踪目标。由于算法综合考虑了目标模型的区域信息和轮廓信息,因此对背景干扰不太敏感。在头部跟踪实验过程中,该文算法跟踪移动目标的实时性和准确性比较好,抗干扰能力较强,基本上可以满足鲁棒性和快速性的要求。     

基于多目立体视觉的试件飞行运动速度测量方法研究

为了测量试件的飞行速度,提出了一种基于多目立体视觉技术的飞行运动速度测量方法。首先研究了多目相机的标定方法,然后通过图像匹配的方法来获取各个相机图像中目标点的图像位置,最后根据各个相机的内部和外部参数,重建得到被测试件的三维坐标,结合相机的拍摄速度,计算出试件的飞行速度。结果表明：该方法可以较为准确的测量出试件在整个飞行过程中的运动速度,且具使用灵活,操作方便等特点。     

Projection center calibration by motion

Camera calibration is the first step of three-dimensional machine vision. A fundamental parameter to be calibrated is the position of the camera projection center with respect to the image plane. This paper presents a method for the computation of the projection center position using images of a translating rigid object, taken by the camera itself.

Many works have been proposed in literature to solve the calibration problem, but this method has several desirable features. The projection center position is computed directly, independently of all other camera parameters. The dimensions and position of the object used for calibration can be completely unknown.

This method is based on a geometric relation between the projection center and the focus of expansion. The use of this property enables the problem to be split into two parts. First a suitable number of focuses of expansion are computed from the images of the translating object. Then the focuses of expansion are taken as landmarks to build a spatial back triangulation problem, the solution of which gives the projection center position.     

基于连接点的3D多角弧匹配

为了满足实际应用的要求，快速地进行多角弧匹配是必要的，因此，提出了一种快速的3D多角弧表示和匹配的方法。该方法是在分析多角弧几何形状基础上，引入连接点的概念，同时，通过在连接点处建立局部直角坐标系来得到每一连接点处的球面坐标。并用连接点的球面坐标集表示多角弧，因这一表示在旋转和平移变换下是不变的，所以可取该球面坐标集作为多角弧匹配的特征集，用该特征集可保持多角弧的几何属性和拓扑结构。这样3D多角弧匹配就降为1D数值串匹配，从而使使匹配变得简单快速。其测量函数为对应连接点间的均方差。实验结果表明，该匹配算法效果良好，并且对于数值污染具有健壮性。     

Spatial-temporal consistent labeling of tracked pedestrians across non-overlapping camera views

Tracking people across multiple cameras with non-overlapping views is a challenging task, since their observations are separated in time and space and their appearances may vary significantly. This paper proposes a Bayesian model to solve the consistent labeling problem across multiple non-overlapping camera views. Significantly different from related approaches, our model assumes neither people are well segmented nor their trajectories across camera views are estimated. We formulate a spatial-temporal probabilistic model in the hypothesis space that consists the potentially matched objects between the exit field of view (FOV) of one camera and the entry FOV of another camera. A competitive major color spectrum histogram representation (CMCSHR) for appearance matching between two objects is also proposed. The proposed spatial-temporal and appearance models are unified by a maximum-a-posteriori (MAP) Bayesian model. Based on this Bayesian model, when a detected new object corresponds to a group hypothesis (more than one object), we further develop an online method for online correspondence update using optimal graph matching (OGM) algorithm. Experimental results on three different real scenarios validate the proposed Bayesian model approach and the CMCSHR method. The results also show that the proposed approach is able to address the occlusion problem/group problem, i.e. finding the corresponding individuals in another camera view for a group of people who walk together into the entry FOV of a camera.     

Gradient orientation pattern matching with the Hamming distance

This paper presents a novel pattern matching technique that is robust to illumination changes and the occlusion problem. The technique is based on the matching of gradient orientations in place of traditional image features such as intensities or gradients. Gradient orientations depend on the texture in an image. They are known to be insensitive to changes of image intensities that are often caused by time-varying illuminations or the auto-gain control (AGC) function of the camera. Moreover,the proposed method employs a voting strategy in the process of matching gradient orientations. The method works remarkably well even when a large part of the pattern is occluded with a foreign object. Consequently, the proposed method is robust to both irregular lighting conditions and the occlusion problem.     

一种基于模板匹配的运动目标跟踪方法

为了提高运动目标跟踪算法在复杂场景下的稳定性,提出了一种将小波变换与模扳匹配相融合的跟踪方法。它首先对图像序列采用滤波器组实现运动目标分割,再通过对图像序列小波变换以确定目标匹配子图像,最终使用模板匹配求取最佳匹配点来实现实时跟踪。采用MATLAB仿真实验,对标准视频序列coastguard_cif实验测试结果表明,提出的方法具有良好的跟踪性能。     

无人机侦察视频超分辨率重建方法

目的 无人机摄像资料的分辨率直接影响目标识别与信息获取,所以摄像分辨率的提高具有重大意义。为了改善无人机侦察视频质量,针对目前无人机摄像、照相数据的特点,提出一种无人机侦察视频超分辨率重建方法。方法 首先提出基于AGAST-Difference与Fast Retina Keypoint (FREAK)的特征匹配算法对视频目标帧与相邻帧之间配准,然后提出匹配区域搜索方法找到目标帧与航片的对应关系,利用航片对视频帧进行高频补偿,最后采用凸集投影方法对补偿后视频帧进行迭代优化。结果 基于AGAST-Difference与FREAK的特征匹配算法在尺度、旋转、视点等变化及运行速度上存在很大优势,匹配区域搜索方法使无人机视频的高频补偿连续性更好,凸集投影迭代优化提高了重建的边缘保持能力,与一种简单有效的视频序列超分辨率复原算法相比,本文算法重建质量提高约4 dB,运行速度提高约5倍。结论 提出了一种针对无人机的视频超分辨率重建方法,分析了无人机视频超分辨率问题的核心所在,并且提出基于AGAST-Difference与FREAK的特征匹配算法与匹配区域搜索方法来解决图像配准与高频补偿问题。实验结果表明,本文算法强化了重建图像的一致性与保真度,特别是对图像边缘细节部分等效果极为明显,且处理速度更快。     

基于综合匹配的鸟类视频中运动物体的检测

鄱阳湖是中国最大的湿地。每年秋末冬初,会有成千上万只候鸟来此越冬,该地区的自然生态系统和这些鸟类的活动有着密切的联系,因此,研究该地区的鸟类是了解该地生态系统的一个重要方式。本文采用帧间差分法对该地所拍摄鸟类视频数据进行运动物体检测。由于视频在获取过程中存在摄像机的移动,所以在处理过程中首先需要估计背景的运动并加以补偿。背景运动的估计是在常用的块匹配方法的基础上作了一定的改进,通过多个匹配块的匹配结果来计算运动矢量。为提高正确率,块的匹配在差分图像上进行。最后,利用在鄱阳湖录取的视频对本文所述方法进行了实验,实验结果表明本文所述方法对背景的去除和运动物体的检测的有效性。     

基于单幅图像确定目标空间方位新方法的测距系统

提出了一种新的由单幅二维投影图像确定目标三维空间方位的的方法,即在照、摄象机内部参数未知的条件下,采用目标上共面四线与他们在二维图像上投影相匹配的策略,来实现目标的定位;并将其应用于测距系统。因此该方法与以前方法相比,更附和实际需要,从而具有广泛的实际应用推广价值。