M2Tracker: A Multi-View Approach to Segmenting and Tracking People in a Cluttered Scene

When occlusion is minimal, a single camera is generally sufficient to detect and track objects. However, when the density of objects is high, the resulting occlusion and lack of visibility suggests the use of multiple cameras and collaboration between them so that an object is detected using information available from all the cameras in the scene.In this paper, we present a system that is capable of segmenting, detecting and tracking multiple people in a cluttered scene using multiple synchronized surveillance cameras located far from each other. The system is fully automatic, and takes decisions about object detection and tracking using evidence collected from many pairs of cameras. Innovations that help us tackle the problem include a region-based stereo algorithm capable of finding 3D points inside an object knowing only the projections of the object (as a whole) in two views, a segmentation algorithm using bayesian classification and the use of occlusion analysis to combine evidence from different camera pairs.The system has been tested using different densities of people in the scene. This helps us determine the number of cameras required for a particular density of people. Experiments have also been conducted to verify and quantify the efficacy of the occlusion analysis scheme.     

Semi-supervised vision-based maritime surveillance system using fused visual attention maps

This paper presents a vision-based system for maritime surveillance, using moving PTZ cameras. The proposed methodology fuses a visual attention method that exploits low-level image features appropriately selected for maritime environment, with appropriate tracker, without making any assumptions about environmental or visual conditions. The offline initialization is based on large graph semi-supervised technique. System’s performance was evaluated with videos from cameras placed at Limassol port and Venetian port of Chania. Results suggest high detection ability, despite dynamically changing visual conditions and different kinds of vessels, all in real time.     

Direct range measurement by linear stereovision for real-time obstacle detection in road traffic

This paper describes an obstacle detection method based on a passive 3D sensor using two line-scan cameras instead of standard video cameras. This approach permits good precision as well as low computational requirements, which allows a real-time implementation on a small, low cost computer, as required for obstacle detection on a car. Real-world examples are presented, that show the efficiency of the system.     

基于多传感器的智能车系统设计

主要介绍电磁、光电、CMOS摄像头和测速传感器在智能车控制系统中的应用.以MC9S12XS128单片机作为系统的控制核心,设计了能够自主循迹的智能车,着重叙述信号检测模块.信号检测包括路径和反馈速度检测,分别使用了电磁、光电、CMOS摄像头和编码器等传感器,并运用PID算法计算PWM对电机和舵机的控制.实际测试表明,智...     

Toward a sentient environment: real-time wide area multiple human tracking with identities

In this paper, we presented a fully integratedreal-time computer vision system that can detect and track multiple humans in a wide-area using a network of stereo cameras. Continuous human identities are achieved by fusing video tracking with different kinds of biometric devices. The system also provides immersive visualization which enables the users to conveniently navigate through space and time and query useful events. The key innovations include stereo-based multi-object detection and tracking, a unified approach for fusing multiple sensors of different modalities, visualization and user interface design.     

Real-time multi-camera video analytics system on GPU

In this article, parallel implementation of a real-time intelligent video surveillance system on Graphics Processing Unit (GPU) is described. The system is based on background subtraction and composed of motion detection, camera sabotage detection (moved camera, out-of-focus camera and covered camera detection), abandoned object detection, and object-tracking algorithms. As the algorithms have different characteristics, their GPU implementations have different speed-up rates. Test results show that when all the algorithms run concurrently, parallelization in GPU makes the system up to 21.88 times faster than the central processing unit counterpart, enabling real-time analysis of higher number of cameras.     

基于网络摄像机的入侵监视系统的设计

利用网络摄像机和个人电脑，提出了1种低廉的方法来实现入侵监测系统（IDS），使入侵监测系统不仅具备基本的监视、录像、回放和入侵监测等功能，由于该系统使用因特网，从而克服设备间的距离限制；另外，由于网络摄像机使用TCP／IP协议组，使该系统的安装费用也比CCTV或DVR大大减少。     

一种基于特征匹配的目标入侵检测方法

视频监控中常用云台摄像机监控视场较大的区域.对于云台摄像机跟随拍摄的情况,提出了一种基于特征匹配的目标入侵检测方法.通过提取的尺度不变特征变换(SIFT)特征点对,将当前图像和全景图像进行匹配,从而得到当前图像和全景图像投影关系,再将当前图像的坐标系变换到全景图像下,最后运用差分法,找到入侵目标.实验结果表明,即使当前图像与全景图像存在尺度、缩放、形变等差异,通过本方法也可正确地检测出入侵目标.     

Video fire detection – Review

This is a review article describing the recent developments in Video based Fire Detection (VFD). Video surveillance cameras and computer vision methods are widely used in many security applications. It is also possible to use security cameras and special purpose infrared surveillance cameras for fire detection. This requires intelligent video processing techniques for detection and analysis of uncontrolled fire behavior. VFD may help reduce the detection time compared to the currently available sensors in both indoors and outdoors because cameras can monitor “volumes” and do not have transport delay that the traditional “point” sensors suffer from. It is possible to cover an area of 100 km² using a single pan-tilt-zoom camera placed on a hilltop for wildfire detection. Another benefit of the VFD systems is that they can provide crucial information about the size and growth of the fire, direction of smoke propagation.     

Human detection using a mobile platform and novel features derived from a visual saliency mechanism

Human detection is a key ability to an increasing number of applications that operates in human inhabited environments or needs to interact with a human user. Currently, most successful approaches to human detection are based on background substraction techniques that apply only to the case of static cameras or cameras with highly constrained motions. Furthermore, many applications rely on features derived from specific human poses, such as systems based on features derived from the human face which is only visible when a person is facing the detecting camera. In this work, we present a new computer vision algorithm designed to operate with moving cameras and to detect humans in different poses under partial or complete view of the human body. We follow a standard pattern recognition approach based on four main steps: (i) preprocessing to achieve color constancy and stereo pair calibration, (ii) segmentation using depth continuity information, (iii) feature extraction based on visual saliency, and (iv) classification using a neural network. The main novelty of our approach lies in the feature extraction step, where we propose novel features derived from a visual saliency mechanism. In contrast to previous works, we do not use a pyramidal decomposition to run the saliency algorithm, but we implement this at the original image resolution using the so-called integral image. Our results indicate that our method: (i) outperforms state-of-the-art techniques for human detection based on face detectors, (ii) outperforms state-of-the-art techniques for complete human body detection based on different set of visual features, and (iii) operates in real time onboard a mobile platform, such as a mobile robot (15 fps).     

基于立体视觉运动速度检测系统的研究及实现

介绍了一种基于立体视觉的运动速度检测系统的结构框架。系统在采集卡自带的软件开发包的基础上进行二次软件开发,加入了摄像机标定和图像处理分析部分。整个检测系统主要包括图像采集和运动检测两大环节;涵盖摄像机标定、图像获取及预处理、目标分割、3D定位、速度求取5个功能模块,并具有友好的操作界面,方便用户使用。文章重点针对目标分割和定位中所采用的技术方法展开了讨论。该系统可以具体应用在车辆和游乐设施等的运动速度检测上,在设备的安全运行以及交通监管方面有重要意义。     

基于Otsu算法和Sobel算子的连接件图像边缘检测

着重研究基于机器视觉的薄片连接件检测系统中的图像边缘检测方法。该方法首先采用Otsu算法对CCD工业相机获取的连接件灰度图像进行阈值分割,然后再用Sobel算子进行边缘检测。整个流程采用MatLab进行仿真测试。测试结果表明,该方法改善了单一采用Sobel算子检测的准确性,能提高边缘检测的整体性能,检测精度较好,该方法是实用可行的。     

人脸识别技术在医院挂号管理系统中的应用

文章提出了一种在现有挂号管理系统中增加面部识别功能的方案,该方法能通过挂号窗口的摄像头检测到可疑的挂号人员,从根本上杜绝或减少＂号贩子＂的存在,增加挂号的成功率。该系统采用了经典的K-L特征提取方法,具有较高的识别率。由于该系统结构简单,所需设备均为常用设备,因此具有较好的应用前景。     

Stereo Video Surveillance Multi-agent System: New Solutions for Human Motion Analysis

This article presents a distributed agent-based system that can process the visual information obtained by stereoscopic cameras. The system is embedded within a global project whose objective is to develop an intelligent environment for location and identification within dependent environments that merges with other types of technologies. In this kind of environments, vision algorithms are very costly and require a lot of time to produce a response, which is highly inconvenient since many applications can require action to be taken in real time. A multi-agent system (MAS) can automate the process of analyzing images obtained by cameras, and optimize the procedure. This study presents a MAS that can process stereoscopic images to detect and classify people by combining a series of novel techniques. The article shows in detail the combination of techniques used to perform the detection process. The process can be subdivided into human detection, human tracking, and human behavior understanding. With the addition of a case-based reasoning (CBR) model, the system can also incorporate reasoning capabilities. The system was tested under different conditions and environments.     

基于全景视觉的监控系统设计

设计了一个基于全景视觉的多摄像机监控网络。全景相机视野广,可以实现大范围的目标检测与跟踪。云台摄像机视角具有一定的自由度,可以捕捉目标的高分辨率图像。将全景相机与云台相机相互配合,通过多传感器的数据融合,分层次的跟踪算法及多相机调度算法,实现了大范围的多个运动目标的检测与跟踪,并能捕获目标的清晰图像。实验验证了该系统的有效性和合理性。     

A multi-camera image processing and visualization system for train safety assessment

In this paper we present a machine vision system to efficiently monitor, analyse and present visual data acquired from a railway overhead gantry equipped with multiple cameras. This solution aims to improve the safety of daily life railway transportation in a two-fold manner: (1) by estimating multiple safety requirements using image analysis algorithms that can process large imagery of trains (2) by helping train safety operators to detect any possible malfunction on a train. The system exploits high-rate visible and thermal cameras that observe a train passing under a railway overhead gantry. The machine vision system is composed of three principal modules: (1) an automatic wagon identification system, recognizing the wagon ID according to the UIC classification of railway coaches; (2) a system for the detection and localization of the pantograph of the train; (3) a temperature monitoring system. These three machine vision modules process batch trains sequences and their resulting analysis are presented to an operator using a multitouch user interface.     

仿生复眼式全景探测及跟踪策略

为解决传统相机不能在全景范围内快速连续跟踪运动物体的弊端,本文提出一种仿生复眼式全景探测思想,以及配套的跟踪策略。在硬件方面,采用多个子眼相机进行全景实时探测,中心采用一个大孔径主眼相机,并且将其安装于云台上面,通过云台控制器接收的不同指令码进行精确定位。在软件方面,本文采用自动加窗采集的思想,对于运动区域的图像进行多层窗口采集,非运动区域则减少窗口层数,然后将采集的图像进行高斯运动目标检测,而检测方法本文在重叠区采用了仿生复眼的侧抑制算法,得到了比较清晰的运动目标轮廓。按照上述软硬件思想本文搭建了实际实验装置,并且进行了重复性实验。由于实时探测特点,以及加窗采集和侧抑制算法的结合,相比传统相机的跟踪效果,在视场和灵敏度上得到了很大的提高。     

Principal axis-based correspondence between multiple cameras for people tracking

Visual surveillance using multiple cameras has attracted increasing interest in recent years. Correspondence between multiple cameras is one of the most important and basic problems which visual surveillance using multiple cameras brings. In this paper, we propose a simple and robust method, based on principal axes of people, to match people across multiple cameras. The correspondence likelihood reflecting the similarity of pairs of principal axes of people is constructed according to the relationship between "ground-points" of people detected in each camera view and the intersections of principal axes detected in different camera views and transformed to the same view. Our method has the following desirable properties; 1) camera calibration is not needed; 2) accurate motion detection and segmentation are less critical due to the robustness of the principal axis-based feature to noise; 3) based on the fused data derived from correspondence results, positions of people in each camera view can be accurately located even when the people are partially occluded in all views. The experimental results on several real video sequences from outdoor environments have demonstrated the effectiveness, efficiency, and robustness of our method.     

基于FIC8120和PoE的IP-Camera设计

为满足分布式单摄像机远距传输的需求，加快当今数字化网络化的现代化步伐，提出了创新的基于FIC8120（ARM-SoC）和PoE的全数字实时IP—Camem的实现方案，并详细阐述了系统组成结构及软硬件设计。该系统具有实时录像、移动侦测、以太网供电、低功耗低成本等诸多优点，适合下一代的视频监控要求，具有较好的应用前景。