基于非刚体运动光流算法的面部表情识别

本文讨论了基于光流法的面部表情识别。由于面部表情运动是一非刚体运动,容易产生形变,因此标准光流法估计不准确。为此,本文通过引入div-curl样条函数作为扩展光流约束方程的附加约束条件,推导了非刚体光流算法,并给出了一阶和二阶div-curl样条约束下光流的数值解。最后将该算法用于面部表情特征提取,构建了HMM与BP神经网络混合分类器。实验结果表明面部表情识别率得到显著提高。     

基于运动优化语义分割的变分光流计算方法

针对光照变化和大位移运动等复杂场景下图像序列变分光流计算的边缘模糊与过度分割问题,文中提出基于运动优化语义分割的变分光流计算方法.首先,根据图像局部区域的去均值归一化匹配模型,构建变分光流计算能量泛函.然后,利用去均值归一化互相关光流估计结果,获取图像运动边界信息,优化语义分割,设计运动约束语义分割的变分光流计算模型....     

Determination of Horizontal Motion through Optical Flow Computations

For intelligent/autonomous subsea vehicles,reliable short-range horizontal positioning is difficult to achieve,particularly over flat bottom topography.A potential solution proposed in this paper utilized a passive optical sensing method to estimate the vehicle displacement using the bottom surface texture.The suggested optical flow method does not require any feature correspondences in images and it is robust in allowing brightness changes between image frames.Fundamentally,this method is similar to correlation methods attempting to match images and compute the motion disparity.However,in correlation methods,searching a neighbor region blindly for best match is lengthy.Main contributions of this paper come from the analysis showing that optical flow computation based on the general model cannot avoid errors except for null motion although the sign of optical flow keeps correct,and from the development of an iterative shifting method based on the error characteristics to accurately determine motions.Advantages of the proposed method are verified by real image experiments.     

一种针对大尺度运动的快速光流算法

传统的光流法必须满足一致连贯性假设,不适用于大幅度运动目标的跟踪。为克服复杂场景下,大尺度运动中目标位移量超出特征跟踪窗口带来的光流计算问题,提出了一种针对大尺度运动的快速光流计算方法。引入图像金字塔模型,利用基于多尺度分层的金字塔结构和光流映射变换,实现小窗口捕获大运动。同时,采用非极大值抑制方法保留图像自相关矩阵的大特征值,得到的强角点作为特征点,降低了光流计算的时间开销。实验结果表明,提出的方法在复杂场景和运动条件下,可准确快速地计算出表征目标运动方向和速率的光流矢量,具有较高的鲁棒性和实时性。     

图象光流场计算技术研究进展

时变图象光流场计算技术是计算机视觉中的重要研究内容，也是当今研究的热点问题。为了使人们对该技术有一个较全面的了解，因而对时变图象光流场计算技术的研究和进展做了较系统的论述，首先分别列举了灰度时变图象和彩色时变图象的光流场计算方法，并对这些方法进行了分类，然后总结了出目前图象光流场计算中存在的几个问题，最后对光流场计算技术的研究发展及其应用前景指出了一些可能的方向。     

On the Geometry of Visual Correspondence

Image displacement fields—optical flow fields, stereo disparity fields, normal flow fields—due to rigid motion possess a global geometric structure which is independent of the scene in view. Motion vectors of certain lengths and directions are constrained to lie on the imaging surface at particular loci whose location and form depends solely on the 3D motion parameters. If optical flow fields or stereo disparity fields are considered, then equal vectors are shown to lie on conic sections. Similarly, for normal motion fields, equal vectors lie within regions whose boundaries also constitute conics. By studying various properties of these curves and regions and their relationships, a characterization of the structure of rigid motion fields is given. The goal of this paper is to introduce a concept underlying the global structure of image displacement fields. This concept gives rise to various constraints that could form the basis of algorithms for the recovery of visual information from multiple views.     

Determining shape and motion from non-overlapping multi-camera rig: A direct approach using normal flows

In this paper, we explore how a wide field-of-view imaging system that consists of a number of cameras in a network arranged to approximate a spherical eye can reduce the complexity of estimating camera motion. Depth map of the imaged scene can be reconstructed once the camera motion is there. We present a direct method to recover camera motion from video data, which neither requires establishment of feature correspondences nor recovery of optical flow, but from normal flow which is directly observable. With a wide visual field, the inherent ambiguities between translation and rotation disappear. Several subsets of normal flow pairs and triplets can be utilized to constraint the directions of translation and rotation separately. The intersection of solution spaces arising from normal flow pairs or triplets yields the estimate on the direction of motion. In addition, the larger number of normal flow measurements so resulted can be used to combat the local flow extraction error. Rotational magnitude is recovered in a subsequent stage. This article details how motion recovery can be improved with the use of such an approximate spherical imaging system. Experimental results on synthetic and real image data are provided. The results show that the accuracy of motion estimation is comparable to those of the state-of-the-art methods that require to use explicit feature correspondences or full optical flows, and our method has a much faster computational speed.     

A Low Dimensional Fluid Motion Estimator

In this paper we propose a new motion estimator for image sequences depicting fluid flows. The proposed estimator is based on the Helmholtz decomposition of vector fields. This decomposition consists in representing the velocity field as a sum of a divergence free component and a vorticity free component. The objective is to provide a low-dimensional parametric representation of optical flows by depicting them as deformations generated by a reduced number of vortex and source particles. Both components are approximated using a discretization of the vorticity and divergence maps through regularized Dirac measures. The resulting so called irrotational and solenoidal fields consist of linear combinations of basis functions obtained through a convolution product of the Green kernel gradient and the vorticity map or the divergence map respectively. The coefficient values and the basis function parameters are obtained by minimization of a functional relying on an integrated version of mass conservation principle of fluid mechanics. Results are provided on synthetic examples and real world sequences.     

基于纹理约束和参数化运动模型的光流估计

提出了一种基于局部小平面运动的光流估计新方法。目的是获得精确致密的光流估计结果。与以往采用亮度一致性区域作为假设平面的算法不同，本算法利用序列图像的纹理信息，在纹理分割区域的基础上，进行运动估计。该算法首先通过微分法计算粗光流，可以得到参数化光流模型的初始估计，然后通过区域迭代算法，调整初始估计，从而得到精细的平面分割及其对应的参数化光流模型。基于纹理信息的部分拟合算法被用于算法的每一步当中，保证了纹理边缘位置的光流估计值的准确性。实验采用了标准图像序列，结果表明，可以得到更为精细的光流估计结果，特别是对于那些有着丰富纹理信息的室外环境的图像序列，而且在运动边界处的结果改善尤为明显。     

综合图像分割与光流计算的连续处理方法

本文提出了利用多通道将图像分割和光流计算相综合的方法，使连续处理方法适用于多物体有遮挡的运动场景．     

基于改进光流法的旋转运动背景下对地运动目标实时检测

针对战机对地侦查视频图像中地面旋转运动背景下运动目标检测高虚警、低实时性的问题,提出了一种基于改进光流法的旋转运动背景下对地运动目标实时检测算法。首先提取图像的特征点,在特征点处计算光流运动矢量,并通过光流矢量场估算背景运动矢量。根据战机飞行高度自适应计算目标像素尺寸,网格化分块待检测图像;然后将各个特征点光流矢量与背景运动矢量相比较,获得备选目标特征点。最后统计分块备选目标特征点密度,判断目标位置区域。对2组实验视频中央360像素×432像素区域进行目标检测实验,结果表明该算法能够准确地检测出地面运动目标,虚警率低。平均每帧检测耗时分别为29.460 ms和31.505 ms,满足战机对地运动目标检测的实时性。     

Non Uniform Multiresolution Method for Optical Flow and Phase Portrait Models: Environmental Applications

In this paper we define a complete framework for processing large image sequences for a global monitoring of short range oceanographic and atmospheric processes. This framework is based on the use of a non quadratic regularization technique for optical flow computation that preserves flow discontinuities. We also show that using an appropriate tessellation of the image according to an estimate of the motion field can improve optical flow accuracy and yields more reliable flows. This method defines a non uniform multiresolution approach for coarse to fine grid generation. It allows to locally increase the resolution of the grid according to the studied problem. Each added node refines the grid in a region of interest and increases the numerical accuracy of the solution in this region. We make use of such a method for solving the optical flow equation with a non quadratic regularization scheme allowing the computation of optical flow field while preserving its discontinuities. The second part of the paper deals with the interpretation of the obtained displacement field. For this purpose a phase portrait model used along with a new formulation of the approximation of an oriented flow field allowing to consider arbitrary polynomial phase portrait models for characterizing salient flow features. This new framework is used for processing oceanographic and atmospheric image sequences and presents an alternative to complex physical modeling techniques.     

Accurate optical flow computation under non-uniform brightness variations

In this paper, we present a very accurate algorithm for computing optical flow with non-uniform brightness variations. The proposed algorithm is based on a generalized dynamic image model (GDIM) in conjunction with a regularization framework to cope with the problem of non-uniform brightness variations. To alleviate flow constraint errors due to image aliasing and noise, we employ a reweighted least-squares method to suppress unreliable flow constraints, thus leading to robust estimation of optical flow. In addition, a dynamic smoothness adjustment scheme is proposed to efficiently suppress the smoothness constraint in the vicinity of the motion and brightness variation discontinuities, thereby preserving motion boundaries. We also employ a constraint refinement scheme, which aims at reducing the approximation errors in the first-order differential flow equation, to refine the optical flow estimation especially for large image motions. To efficiently minimize the resulting energy function for optical flow computation, we utilize an incomplete Cholesky preconditioned conjugate gradient algorithm to solve the large linear system. Experimental results on some synthetic and real image sequences show that the proposed algorithm compares favorably to most existing techniques reported in literature in terms of accuracy in optical flow computation with 100% density.     

基于遮挡修补的TV-L1光流算法

当前比较流行的TV-L1光流算法,在不失精确度的前提下,能够利用双向求解机制来降低运算量,但无法有效地处理由间断、遮挡等因素造成的错误光流分量的缺陷。通过前向光流和后向光流的运动一致性理论来判断遮挡区域的光流分量,通过单调递减函数对遮挡区域进行处理,抑制了遮挡区域错误光流对邻域的扩散,提出了同帧邻域光流的横向修补和相邻帧光流的纵向修补。实验表明,该方法能够很好地处理遮挡情况,提高了光流的计算精度。     

基于相位光流法的结构振动微小位移测量

随着数码相机的成本降低和普及,基于计算机视觉的非接触式结构健康监测技术越来越受到重视.传统的接触式测量仪器可能导致轻质结构上的质量负荷,并且在大型土木结构上安装和维护成本高且耗时,特别是对于长期应用.作为一种替代的非接触方法,使用数码相机的计算机视觉方法成本相对较低、灵活.针对传统光流方法在微小位移测量精度和稳定性不足...     

联合特征在行人检测中的应用

提出一种基于动态和静态联合特征的行人检测方法,用于运动背景下的行人检测。运动背景的检测难度在于背景与目标的分离,该方法采用一种改进的Nagel二阶梯度光流算法生成图像的光流场,从中提取行人运动特征(MBH)和IMH(internal motion histograms),增强特征重复性以提高鉴别能力。实验中使用Libsvm训练线性SVM(support vector machine)分类器,使用Mean Shift算法优化分类结果。实验在1 093组图像上获得98%的识别率,证明该方法可以在运动背景下的图像序列上获得较出色的检测效果。     

一种基于精确度的降分辨率视频转码运动矢量合成算法

针对现有的降分辨率视频转码运动矢量合成算法没有考虑输入运动矢量的精确度,从而使得合成误差较高的问题,提出了一种基于精确度的降分辨率视频转码运动矢量合成算法。该算法分为两次合成,首先基于绝对差值和（SAD）对转码输入流中的运动矢量进行平均合成,然后再基于率失真函数,对转码输出流中的相邻运动矢量和第1次合成得到的运动矢量进行选择合成。仿真结果表明,与现有算法相比,该算法在保持较低计算复杂度的情况下,显著降低了运动矢量合成的误差。     

Estimate Large Motions Using the Reliability-Based Motion Estimation Algorithm

Detecting and estimating motions of fast moving objects has many important applications. However, most existing motion estimation techniques have difficulties in handling large motions in the scene. In this paper, we extend our recently proposed reliability-based stereo vision technique to solving large motion estimation problem. Compared with our stereo vision approach, the new algorithm removes the constant penalty assumption and explicitly enforces the inter-scanline consistency constraint. The resulting algorithm can handle sequences that contain large motions and can produce optical flows with 100% density over the entire image domain. The experimental results indicate that it can generate more accurate optical flows than existing approaches.     

Face authentication for multiple subjects using eigenflow

In this paper, we present a novel scheme for face authentication. To deal with variations, such as facial expressions and registration errors, with which traditional intensity-based methods do not perform well, we propose the eigenflow approach. In this approach, the optical flow and the optical flow residue between a test image and an image in the training set are first computed. The optical flow is then fitted to a model that is pre-trained by applying principal component analysis to optical flows resulting from facial expressions and registration errors for the subject. The eigenflow residue, optimally combined with the optical flow residue using linear discriminant analysis, determines the authenticity of the test image. An individual modeling method and a common modeling method are described. We also present a method to optimally choose the threshold for each subject for a multiple-subject authentication system. Experimental results show that the proposed scheme outperforms the traditional methods in the presence of facial expression variations and registration errors.     

Motion detail preserving optical flow estimation

A common problem of optical flow estimation in the multiscale variational framework is that fine motion structures cannot always be correctly estimated, especially for regions with significant and abrupt displacement variation. A novel extended coarse-to-fine (EC2F) refinement framework is introduced in this paper to address this issue, which reduces the reliance of flow estimates on their initial values propagated from the coarse level and enables recovering many motion details in each scale. The contribution of this paper also includes adaptation of the objective function to handle outliers and development of a new optimization procedure. The effectiveness of our algorithm is demonstrated by Middlebury optical flow benchmarkmarking and by experiments on challenging examples that involve large-displacement motion.