单对立色流运动下的抠图跟踪

当目标与周围背景相似性较高,且目标运动形式复杂时,很难精确跟踪目标。针对传统目标跟踪方法因目标外观的不精确建模致使模型退化而产生漂移的问题,提出了一种单对立色流特征下的抠图跟踪方法。首先,根据彩色视频帧包含的丰富颜色信息,将单对立色颜色编码方式与Lo G兴趣点检测器结合,获取颜色兴趣点作为目标表示集合;其次,在目标运动预测阶段,通过估计相邻帧兴趣点的流匹配关系,获得预测帧的前景目标兴趣点估计;最后,利用获得的前景兴趣点估计进行抠图,重新划分当前帧的前背景标记,并对模型进行更新。该算法在Segtrack视频跟踪数据集上进行验证,定性定量分析了跟踪目标快速运动,目标形变和光照干扰下的跟踪效果。实验结果表明该算法可有效提高形变目标跟踪的准确性,优于当前目标跟踪的先进算法。     

人体运动实时捕捉仪器设计与应用

将人体运动实时捕捉下来 ,实现数字化处理与同步图像显示 ,将在影视广告制作、体育运动分析、康复效果跟踪等许多方面具有潜在的应用前景。本文系统介绍人体运动实时捕捉仪器的设计原理、数据处理与相关算法 ,并对该仪器的应用前景进行分析。     

基于监控视频的异常事件识别

提出了一种基于监控视频的异常事件识别模型,该模型可以实时监测视频中的前景目标,并通过分析目标的运动信息判断是否有异常事件的发生。首先,采用背景建模的混合高斯算法提取前景目标;然后,用金字塔迭代的L-K特征点跟踪算法得到前景的光流运动信息,并通过分析前景的面积比例、速度方差、整体熵判断视频中是否有异常事件的发生;最后,利用爆炸、人群短时聚集和分散两种异常事件做仿真实验。结果表明,该模型可以准确提取前景目标区域,并可以快速、精准地判断监控视频中的异常事件,可以为管理部门及时发现和控制异常事件提供有效的帮助。     

Estimation of moving information for tracking of moving objects

Tracking of moving objects within video streams is a complex and time-consuming process. Large number of moving objects increases the time for computation of tracking the moving objects. Because of large computations, there are real-time processing problems in tracking of moving objects. Also, the change of environment causes errors in estimation of tracking information. In this paper, we present a new method for tracking of moving objects using optical flow motion analysis. Optical flow represents an important family of visual information processing techniques in computer vision. Segmenting an optical flow field into coherent motion groups and estimating each underlying motion are very challenging tasks when the optical flow field is projected from a scene of several moving objects independently. The problem is further complicated if the optical flow data are noisy and partially incorrect. Optical flow estimation based on regulation method is an iterative method, which is very sensitive to the noisy data. So we used the Combinatorial Hough Transform (CHT) and Voting Accumulation for finding the optimal constraint lines. To decrease the operation time, we used logical operations. Optical flow vectors of moving objects are extracted, and the moving information of objects is computed from the extracted optical flow vectors. The simulation results on the noisy test images show that the proposed method finds better flow vectors and more correctly estimates the moving information of objects in the real time video streams.     

Fast and Simple Motion Tracking Unit with Motion Estimation

Surveillance system using active tracking camera has no distance limitation of surveillance range compared to supersonic or sound sensors. However, complex motion tracking algorithm requires huge amount of computation, and it often requires expensive DSPs or embedded processors. This paper proposes a novel motion tracking unit based on different image for fast and simple motion tracking. It uses configuration factor to avoid noise and inaccuracy. It reduces the required computation significantly, so as to be implemented on Field Programmable Gate Array(FPGAs) instead of expensive Digital Signal Processing(DSPs). It also performs calculation for motion estimation in video compression, so it can be easily combined with surveillance system with video recording functionality based on video compression. The proposed motion tracking system implemented on Xilinx Vertex-4 FPGA can process 48 frames per second, and operating frequency of motion tracking unit is 100 MHz.     

Three-dimensional particle tracking in microfluidic channel flow using in and out of focus diffraction

Three-dimensional particle tracking is important to accurately understand the motion of particles within complex flow fields. We show that three-dimensional trajectories of particles within microfluidic flow can be extracted from two-dimensional bright field video microscopy. The method utilizes the defocusing that occurs as particles move out of the objective focal plane when viewed through a high numerical aperture objective lens. A fast and simple algorithm based on cross correlation to a set of reference images taken at prescribed amounts of defocus is used to extract out-of-plane particle position. In-plane particle position is determined through center point detection and therefore the particle position in all three dimensions can be constructed at each time point. Particle trajectories at high flow velocity of greater than 2 mm/s can be tracked by utilizing a high speed camera to obtain unblurred images. Three dimensional computational fluid simulations are used to validate the particle tracking methods.     

基于线性时变模型预测控制的自主车辆轨迹跟踪控制器设计与验证

随着自动驾驶技术的快速发展,精确的轨迹跟踪已经成为汽车工业和学术领域公认的实现自主车辆运动控制的核心技术之一。为提高自主车辆轨迹跟踪的实时性与准确性,提出一种应用于自主车辆的线性时变模型预测跟踪控制器（Linear time-varying model predictive controller,LTV-MPC）设计方法。根据运动学原理建立某自主无人小车的二自由度运动学模型,其次,基于该模型构建车辆轨迹跟踪系统的误差模型并利用线性参数化理论对其进行离散化,在模型预测控制框架内将该轨迹跟踪控制器的设计转化为一个线性二次规划最优问题。在一个实际搭建的自主车辆试验平台上对所提出控制器的有效性进行不同预设参考路径轨迹下的实车验证,结果表明,该自主车辆能够对所预设的实际参考道路轨迹进行快速、准确的轨迹跟踪控制,且具有较好的行驶稳定性能。     

Multidepth, multiparticle tracking for active microrheology using a smart camera

The quantitative measurement of particle motion in optical tweezers is an important tool in the study of microrheology and can be used in a variety of scientific and industrial applications. Active microheology, in which the response of optically trapped particles to external driving forces is measured, is particularly useful in probing nonlinear viscoelastic behavior in complex fluids. Currently such experiments typically require independent measurements of the driving force and the trapped particle's response to be carefully synchronized, and therefore the experiments normally require analog equipment. In this paper we describe both a specialized camera and an imaging technique which make high-speed video microscopy a suitable tool for performing such measurements, without the need for separate measurement systems and synchronization. The use of a high-speed tracking camera based on a field programmable gate array to simultaneously track multiple particles is reported. By using this camera to simultaneously track one microsphere fixed to the wall of a driven sample chamber and another held in an optical trap, we demonstrate simultaneous optical measurement of the driving motion and the trapped probe particle response using a single instrument. Our technique is verified experimentally by active viscosity measurements on water-ethylene glycol mixtures using a phase-shift technique.     

Motion compensation for in vivo subcellular optical microscopy

In this review, we focus on the impact of tissue motion on attempting to conduct subcellular resolution optical microscopy, in vivo. Our position is that tissue motion is one of the major barriers in conducting these studies along with light induced damage, optical probe loading as well as absorbing and scattering effects on the excitation point spread function and collection of emitted light. Recent developments in the speed of image acquisition have reached the limit, in most cases, where the signal from a subcellular voxel limits the speed and not the scanning rate of the microscope. Different schemes for compensating for tissue displacements due to rigid body and deformation are presented from tissue restriction, gating, adaptive gating and active tissue tracking. We argue that methods that minimally impact the natural physiological motion of the tissue are desirable because the major reason to perform in vivo studies is to evaluate normal physiological functions. Towards this goal, active tracking using the optical imaging data itself to monitor tissue displacement and either prospectively or retrospectively correct for the motion without affecting physiological processes is desirable. Critical for this development was the implementation of near real time image processing in conjunction with the control of the microscope imaging parameters. Clearly, the continuing development of methods of motion compensation as well as significant technological solutions to the other barriers to tissue subcellular optical imaging in vivo, including optical aberrations and overall signal‐to‐noise ratio, will make major contributions to the understanding of cell biology within the body.     

Identification of two-phase flow pattern in porous media based on signal feature extraction

The statistical analysis methods based on differential pressure signals of two-phase flow are employed in the present study to identify the flow patterns in packed porous bed. The typical flow pattern images of two-phase flow in the packed porous beds are recognized and the corresponding differential pressure signals are recorded based on the visualization experiments. Then the statistical analysis methods, including probability density function (PDF), power spectral density (PSD), and wavelet energy spectrum (WES), are employed to extract the features of differential pressure signals in the time domain, frequency domain, and time-frequency domain respectively. The dimensionless parameters are proposed as the evaluation index to quantify the differences among flow patterns. The results show that the PDF, PSD, and WES methods can effectively characterize different flow patterns in the time, frequency, and time-frequency domain, respectively. The comprehensive recognition efficiency is about 88.5% using the introduced dimensionless parameters.     

The FAST module: an add-on unit for driving commercial scanning probe microscopes at video rate and beyond

We present the design and the performance of the FAST (Fast Acquisition of SPM Timeseries) module, an add-on instrument that can drive commercial scanning probe microscopes (SPM) at and beyond video rate image frequencies. In the design of this module, we adopted and integrated several technical solutions previously proposed by different groups in order to overcome the problems encountered when driving SPMs at high scanning frequencies. The fast probe motion control and signal acquisition are implemented in a way that is totally transparent to the existing control electronics, allowing the user to switch immediately and seamlessly to the fast scanning mode when imaging in the conventional slow mode. The unit provides a completely non-invasive, fast scanning upgrade to common SPM instruments that are not specifically designed for high speed scanning. To test its performance, we used this module to drive a commercial scanning tunneling microscope (STM) system in a quasi-constant height mode to frame rates of 100 Hz and above, demonstrating extremely stable and high resolution imaging capabilities. The module is extremely versatile and its application is not limited to STM setups but can, in principle, be generalized to any scanning probe instrument.     

Background removal in scanning tunneling spectroscopy of single atoms and molecules on metal surfaces

Scanning tunneling spectroscopy has developed into a powerful spectroscopic technique that has found wide application in the atomic scale characterization of the electronic properties of clean surfaces as well as adsorbates and defects at surfaces. However, it still lacks the standard methods for data treatment and removal of artifacts in spectra as they are, e.g., common in photoemission spectroscopy. The properties of the atomic scale tip apex--the probe of the instrument--tend to introduce spurious background signals into tunneling spectra. We present and discuss two methods which permit to extract tip-independent information from low temperature tunneling spectra acquired on single atoms and molecules on single crystal surfaces by background subtraction. The methods rely on a characterization of the tip on the clean metal surface. The performance of both methods is demonstrated and compared for simulated and experimental tunneling spectra.     

改进隐马氏模型的运动人体模型学习

基于人体模型的跟踪方法易于实现视频的运动人体跟踪,而且利用较少的视频帧数即可学习获得人体模型。本文针对给出的视频提出了学习人体模型的学习算法。利用片图模型表示未经学习的人体,改进的隐马尔可夫模型(HMM)模拟人体在视频序列各帧间的运动,并使用机器学习方法对该改进的HMM进行推理,获取改进HMM的参数,从而获得所需的人体模型。学习得到的人体模型由包含颜色信息的各人体肢体模板组成。实验显示只用80~90帧包含有人体运动的序列图像,便可学习得到该运动人体的人体模型。结果表明,该学习框架效果明显,可用于快速学习视频序列中的运动人体模型,且可用于学习一人或多人的人体模型。     

一种基于视觉注意力的快速运动估计算法

运动估计在视频编码中占据十分重要的地位,因为它能有效地去除图像序列的时域冗余,大大提高编码效率,但往往算法复杂,占用整个编码过程较多的时间.针对智能视频监控等领域的应用,提出一种基于视觉注意力的快速运动估计算法.该算法的核心思想是利用视觉注意力模型将关注的运动区域提取出来作为显著性区域,然后利用快速运动估计算法在显著性区域采用较高的预测精度,而非显著性区域采用较低的预测精度.实验结果表明在峰值信噪比几乎不变的情况下,该算法比其他经典运动估计算法的运算时间有明显减少.     

一种视频流数据的处理与自动负载方法

近年来,大数据技术的发展使得实时视频流处理成为可能.实时视频流数据属于典型的大数据,从这些非结构化的数据中提取有价值的信息非常困难,因此需要利用大数据与视频流处理技术,通过实时处理模组从中提取有用的信息.由于视频流的大数据特性,传统的数据存储方法成本较高,需要配合云存储技术来实现视频流的高效处理与运算.云存储服务提供了...     

尾随运动车辆识别与超车检测方法研究

针对尾随车辆由于类型、尺寸、颜色、环境等非确定因素导致识别不稳定、不可靠的问题,提出基于时空域纵向投影跟踪滤波和相对运动检测的车辆识别与超车行为检测算法。首先在对比度空间对序列图像进行定向滤波,采用概率Hough变换估计车辆横向边缘,通过时间域投影方法过滤环境噪声,得到尾随车辆跟踪轨迹,同时使用光流法对序列图像特征角点进行跟踪检测,通过目标运动方向矢量将车辆和背景予以区分。在此基础上,采用车辆置信度函数对上述两种方法的识别结果进行综合决策,提出基于行为检测的超车检测算法。试验结果表明,该方法在结构化道路环境中能够快速准确提取近视场运动尾随车辆,对环境干扰和目标车辆类型变化具有较强的免疫能力。       

激光电子经纬仪动态跟踪引导系统的设计

设计了一种基于视觉的激光电子经纬仪跟踪引导系统来提高电子经纬仪工作效率,实现其在大空间范围内目标点的动态测量.介绍了跟踪引导系统结构组成并分析了外置扫描设备以及激光电子经纬仪的运动特性.建立扫描设备运动学模型,说明了利用空间坐标转换关系,通过光轴搜索法实现了经纬仪激光点自动引导的策略.然后,给出了镜头的变焦控制方法.最...     

全局运动序列的视频对象分割算法

针对全局运动视频序列，本文提出一种快速有效的基于边缘均灰度投影匹配的全局运动估计与补偿算法，将连续几帧图像的相同背景稳定在同一幅图像的相同位置上，从而能够沿用静止背景序列的视频对象分割算法。实验结果证明，该方法能够从背景变化的视频序列中较好地提取运动对象，具有较强的鲁棒性。     

Polarized fluorescence correlation spectroscopy of DNA-DAPI complexes

We discuss the use of fluorescence correlation spectroscopy for the measurement of relatively slow rotations of large macromolecules in solution or attached to other macromolecular structures. We present simulations and experimental results to illustrate the range of rotational correlation times and diffusion times that the technique can analyze. In particular, we examine various methods to analyze the polarization fluctuation data. We have found that by first constructing the polarization function and then calculating the autocorrelation function, we can obtain the rotational motion of the molecule with very little interference from the lateral diffusion of the macromolecule, as long as the rotational diffusion is significantly faster than the lateral diffusion. Surprisingly, for common fluorophores the autocorrelation of the polarization function is relatively unaffected by the photon statistics. In our instrument, two-photon excitation is used to define a small volume of illumination where a few molecules are present at any instant of time. The measurements of long DNA molecules labeled with the fluorescent probe DAPI show local rotational motions of the polymers in addition to translation motions of the entire polymer. For smaller molecules such as EGFP, the viscosity of the solution must be increased to bring the relaxation due to rotational motion into the measurable range. Overall, our results show that polarized fluorescence correlation spectroscopy can be used to detect fast and slow rotational motion in the time scale from microsecond to second, a range that cannot be easily reached by conventional fluorescence anisotropy decay methods.     

具有三维力反馈的原子力显微镜纳米操作系统

在基于原子力显微镜的纳米操作过程中，由于缺乏实时反馈信息，造成纳米操作效率低下且灵活性差，同时探针因受力过大而损坏。为此，本文通过对探针受力-悬臂变形进行建模，并根据实时检测到的悬臂变形信号、新的参数获取与校准方法，从而获取探针所受的实时三维纳米力。将此三力经比例放大后送人力／触觉设备进行感知，操作者就可以实时调节施加在探针上力的大小及探针的运动轨迹，使得操作的效率及灵活性明显提高，且可以避免探针因受力过大而造成损坏。纳米刻画和多壁碳纳米管的操作实验验证了系统的有效性。