基于多CPU的目标识别与跟踪系统设计

设计了一个实时图像采集、目标识别与跟踪系统;系统功能包括图像采集、运动估计、目标识别、摄像机云台控制等;系统功能主要由3片CPU完成,其中由2片DSP构成的图像采集处理单元实现两路图像采集、目标识别和运动估计,识别和估计结果通过系统总线送给跟踪控制系统;由1片ARM构成的目标跟踪控制系统对2路摄像机的云台和镜头等实现实时控制,使目标一直位于视场中;该系统采样率为10fps,当运动目标的距离在100 m以内,速度小于15 m/s时,可以实现实时识别与跟踪;该系统可以应用于视频监控等应用领域。     

视觉监控应用中多传感器协作的人脸检测系统

提出了一种新颖的由两个可控摄像机组成的多传感器视觉监控系统,旨在实现户外环境下的实时跟踪与特征化运动目标.特别地,该系统利用一个在多个缩放级别上可操作的移动摄像机在连续视频帧中自动获取与跟踪人脸.配合它的是一架能执行自动目标跟踪与分类的固定广域摄像机.     

基于主动视觉的运动目标检测跟踪方法

研究主动视觉运动目标检测跟踪系统。针对图像目标跟踪多为非连续动态过程,准确性差,通过混合高斯法建立背景模型,采用背景差分法,利用最大类间方差算法确定阈值,检测分割出运动目标,提出一种结合SURF算法的带宽自适应均值漂移跟踪算法实现目标跟踪,使用线程并行控制摄像机运动,确保跟踪目标在图像序列中的合适尺寸。实验表明,改进系统能够实现对场景中运动目标的准确检测,稳定跟踪,并能到达实时应用的要求。     

增强现实系统的设计与实现

研究了一种基于平面特征的视频动态跟踪方法,通过计算出初始帧图像的虚实坐标之间的单应矩阵,可以计算出任意一帧的虚实坐标之间的单应矩阵,可以实现动态跟踪的目的。在此基础之上设计并实现了基于平面特征的增强现实动态跟踪系统,实现了视频的动态跟踪功能。该增强现实跟踪系统具有实时性好、简单、方便的特点。     

一种基于平面模板的摄像机自定标方法

给出仿射坐标系下场景中平面与像平面的单应关系、绝对二次曲线及其图像的表示．通过对场景中一个平面模板获取3幅图像(该模板是由含内切圆的等边三角形构成)，利用上述单应关系并结合圆环点对摄像机内参数的约束，获得一组线性方程，进而确定摄像机的内参数．实验结果表明，所给出的方法切实可行，且具有较高的求解精度．     

一种用于视频监控的双摄像头系统实现

提出了一种新颖的用于视频监控的双摄像头系统,在此系统中全景摄像机与PTZ摄像机(云台摄像机)结合在一起,既能对大范围内的目标进行检测与跟踪又能对目标的详细图像进行捕捉。在全景摄像机获取的图像中进行运动检测,获取运动物体位置信息后利用PTZ摄像机对其进行检测分析,以实现二者的数据融合。设计了全景摄像机的反射镜面,对该双摄像头系统进行了标定,在实验室环境下的进行实验验证了系统的性能。     

一种五自由度视觉伺服机器人的跟踪控制研究

提出了一种基于图像的视觉伺服机器人系统的结构，以及该系统跟踪平面运动目标的算法. 该系统有5个自由度，包括一个3自由度的机器人和一个2自由度的手腕，手腕安装在机器人末端，而摄像机安装在手腕末端. 由于具有较小的运动惯量，手腕可快速旋转，以实现对运动目标的跟踪. 而在需要时，3自由度的机器人可将摄像机移动到适当的位置， 对目标进行更为仔细的观察. 该系统实现了对运动目标的跟踪. 此外，还提出了提高系统性能的方法，实验证实这些方法是有效的.     

基于Camshift算法的运动目标检测

CamShift算法是一种实时的跟踪算法,它是利用目标的颜色直方图模型得到每帧图像的颜色投影图,并根据上一帧跟踪的结果自适应调整搜索窗口的位置和大小,从而得到当前图像中目标的尺寸和中心位置。本系统主要是基于CamShift的算法设计一个对运动目标跟踪检测系统,本系统既可以对室内环境的运动目标进行跟踪,也可以对视频流中的运动目标进行跟踪。     

基于图像误差的机器人运动目标自适应跟踪

讨论了机械手运动目标跟踪问题，直接利用图像误差达到注视目的。利用手部摄像机于期望位置获取待跟踪物体图像，以此作为期望图像，而后可以对同为运动物体进行注视跟踪，使实时采样图像收敛于期望图像。     

基于云台摄像的实时车速检测算法

针对采用固定摄像的路况监视系统无法观看自如的缺点,提出了基于云台摄像的实时车速检测算法．建立了简化的摄像机参数模型,提取了线性拟合后的车道图像特征参数,并利用Kluge曲线模型和随机霍夫变换实现了像平面车道分割线的二维重建和云台摄像机的标定;应用自适应背景减除、扩展Kalman滤波器等方法,提取了帧运动域及域中目标轮廓,从而实现了车辆的精确定位、跟踪,以至实时速度检测．该算法已试用于工程实践,具有较好的鲁棒性．     

基于视图不确定关系模型的地面目标位置估计和跟踪

为了实现地面上目标的位置估计和跟踪,本文提出了一种摄像机平面视图与地面位置估计之间关系的建模理论。首先分析了随机变量(摄像机图像平面上的位置估计和地面上的位置估计)在投影变换下的变换方式,表明了当某些几何性质满足时,投影变换会将正态分布映射为正态分布；其次采用无迹变换来计算得到变换后的随机变量的矩；最后采用得到的建模相关性设计了一种用于多个摄像机位置估计的最小方差估计器,并应用于跟踪地面上动态环境中的多个目标；实验结果表明,本文提出的模型不仅具有较好的组合位置估计能力,而且还能够利用这种模型得到的最小方差估计器有效地呈现和跟踪地面目标。     

An efficient continuous tracking system in real-time surveillance application

A tracking object must present a proper field of view (FOV) in a multiple active camera surveillance system; its clarity can facilitate smooth processing by the surveillance system before further processing, such as face recognition. However, when pan–tilt–zoom (PTZ) cameras are used, the tracking object can be brought into the FOV by adjusting its intrinsic parameters; consequently, selection of the best-performing camera is critical. Performance is determined by the relative positions of the camera and the tracking objects, image quality, lighting and how much of the front side of the object faces the camera. In a multi-camera surveillance system, both camera hand-off and camera assignment play an important role in automated and persistent tracking, which are typical surveillance requirements. This study investigates the use of automatic methods for tracking an object across cameras in a surveillance network using PTZ cameras. An automatic, efficient continuous tracking scheme is developed. The goal is to determine the decision criteria for hand-off using Sight Quality Indication (SQI) (which includes information on the position of the object and the proportion of the front of object faces the camera), and to perform the camera handoff task in a manner that optimizes the vision effect associated with monitoring. Experimental results reveal that the proposed algorithm can be efficiently executed, and the handoff method for feasible and continuously tracking active objects under real-time surveillance.     

Continuous localization and mapping of a pan–tilt–zoom camera for wide area tracking

Pan–tilt–zoom (PTZ) cameras are well suited for object identification and recognition in far-field scenes. However, the effective use of PTZ cameras is complicated by the fact that a continuous online camera calibration is needed and the absolute pan, tilt and zoom values provided by the camera actuators cannot be used because they are not synchronized with the video stream. So, accurate calibration must be directly extracted from the visual content of the frames. Moreover, the large and abrupt scale changes, the scene background changes due to the camera operation and the need of camera motion compensation make target tracking with these cameras extremely challenging. In this paper, we present a solution that provides continuous online calibration of PTZ cameras which is robust to rapid camera motion, changes of the environment due to varying illumination or moving objects. The approach also scales beyond thousands of scene landmarks extracted with the SURF keypoint detector. The method directly derives the relationship between the position of a target in the ground plane and the corresponding scale and position in the image and allows real-time tracking of multiple targets with high and stable degree of accuracy even at far distances and any zoom level.     

People counting via multiple views using a fast information fusion approach

Real-time estimates of a crowd size is a central task in civilian surveillance. In this paper we present a novel system counting people in a crowd scene with overlapping cameras. This system fuses all single view foreground information to localize each person present on the scene. The purpose of our fusion strategy is to use the foreground pixels of each single views to improve real-time objects association between each camera of the network. The foreground pixels are obtained by using an algorithm based on codebook. In this work, we aggregate the resulting silhouettes over cameras network, and compute a planar homography projection of each camera’s visual hull into ground plane. The visual hull is obtained by finding the convex hull of the foreground pixels. After the projection into the ground plane, we fuse the obtained polygons by using the geometric properties of the scene and on the quality of each camera detection. We also suggest a region-based approach tracking strategy which keeps track of people movements and of their identities along time, also enabling tolerance to occasional misdetections. This tracking strategy is implemented on the result of the views fusion and allows to estimate the crowd size dependently on each frame. Assessment of experiments using public datasets proposed for the evaluation of counting people system demonstrates the performance of our fusion approach. These results prove that the fusion strategy can run in real-time and is efficient for making data association. We also prove that the combination of our fusion approach and the proposed tracking improve the people counting.

     

Augmented reality camera tracking with homographies

To realistically integrate 3D graphics into an unprepared environment, camera position must be estimated by tracking natural image features. We apply our technique to cases where feature positions in adjacent frames of an image sequence are related by a homography, or projective transformation. We describe this transformation's computation and demonstrate several applications. First, we use an augmented notice board to explain how a homography, between two images of a planar scene, completely determines the relative camera positions. Second, we show that the homography can also recover pure camera rotations, and we use this to develop an outdoor AR tracking system. Third, we use the system to measure head rotation and form a simple low-cost virtual reality (VR) tracking solution.     

Learning the Semantic Landscape: embedding scene knowledge in object tracking

The accuracy of object tracking methodologies can be significantly improved by utilizing knowledge about the monitored scene. Such scene knowledge includes the homography between the camera and ground planes and the occlusion landscape identifying the depth map associated with the static occlusions in the scene. Using the ground plane, a simple method of relating the projected height and width of people objects to image location is used to constrain the dimensions of appearance models. Moreover, trajectory modeling can be greatly improved by performing tracking on the ground-plane tracking using global real-world noise models for the observation and dynamic processes. Finally, the occlusion landscape allows the tracker to predict the complete or partial occlusion of object observations. To facilitate plug and play functionality, this scene knowledge must be automatically learnt. The paper demonstrates how, over a sufficient length of time, observations from the monitored scene itself can be used to parameterize the semantic landscape.     

混合线性模型在模板跟踪中的应用

模板跟踪在计算机视觉上已经有了很广泛的应用。利用图像的单应性特征,构建目标的运动模型,找出观察数据与目标运动参数的关系,估计目标的运动参数,实现目标跟踪的目的。本文提出了一种基于混合线性模型的模板跟踪方法,提取目标的运动参数和表观特征,建立数据集,利用全监督学习的方法计算出两者的映射关系,从而实现对目标进行有效跟踪。这种方法既克服了由单一线性模型造成的非线性误差,又减少了由于计算非线性模型的计算量,提高了目标跟踪的精度。此外,本文还提出了一种快速学习的计算方法,克服了混合模型中每个子空间由于学习样本少而容易受到噪声影响的缺点,不仅增加了系统的鲁棒性,而且减少了计算量。实验结果表明该算法具有良好地跟踪效果。     

Extensions of Plane-Based Calibration to the Case of Translational Motion in a Robot Vision Setting

In this paper, a technique for calibrating a camera using a planar calibration object with known metric structure, when the camera (or the calibration plane) undergoes pure translational motion, is presented. The study is an extension of the standard formulation of plane-based camera calibration where the translational case is considered as degenerate. We derive a flexible and straightforward way of using different amounts of knowledge of the translational motion for the calibration task. The theory is mainly applicable in a robot vision setting, and the calculation of the hand–eye orientation and the special case of stereo head calibration are also being addressed. Results of experiments on both computer-generated and real image data are presented. The paper covers the most useful instances of applying the technique to a real system and discusses the degenerate cases that needs to be considered. The paper also presents a method for calculating the infinite homography between the two image planes in a stereo head, using the homographies estimated between the calibration plane and the image planes. Its possible usage and usefulness for simultaneous calibration of the two cameras in the stereo head are discussed and illustrated using experiments.     

A computer vision system for the detection and classification of vehicles at urban road intersections

The paper presents a real-time vision system to compute traffic parameters by analyzing monocular image sequences coming from pole-mounted video cameras at urban crossroads. The system uses a combination of segmentation and motion information to localize and track moving objects on the road plane, utilizing a robust background updating, and a feature-based tracking method. It is able to describe the path of each detected vehicle, to estimate its speed and to classify it into seven categories. The classification task relies on a model-based matching technique refined by a feature-based one for distinguishing between classes having similar models, like bicycles and motorcycles. The system is flexible with respect to the intersection geometry and the camera position. Experimental results demonstrate robust, real-time vehicle detection, tracking and classification over several hours of videos taken under different illumination conditions. The system is presently under trial in Trento, a 100,000-people town in northern Italy.