武打片中的动作场景检测方法

本文提出了一种简单有效的方法检测武打片中的动作场景:首先根据动作场景的节奏特点,从影片层次出发,使用镜头长度和MPEG-7运动活力描述符定义了镜头的步调函数来度量节奏,由此定位快节奏区域,找到动作场景的大体位置;之后根据动作场景的内容发展特点,从镜头层次出发,分析快节奏区域及周边的镜头的内容,根据视觉特征确定动作场景的边界点.两个层次(影片和镜头)信息的充分利用使得方法简单易操作,基于压缩视频的处理方法提高了运算速度,实验结果表明了该检测方法的有效性.     

压缩域中基于支持向量机的镜头边界检测算法

针对如何进一步提高镜头边界检测精度问题,本文提出了一个基于支持向量机SVM (Support Vector Machine)的镜头边界检测算法.该算法利用视频压缩域中特征,如宏块类型,帧间对应宏块DC系数差和帧类型将视频帧分为发生切变的帧、发生渐变的帧和非镜头变换帧三类,从而实现视频的镜头分割.实验结果表明该算法对摄像机的运动和大物体的进入具有很好的鲁棒性,且没有大多数算法中阈值选择的困难,将我们的算法与2001 TREC评估中最佳指标进行了比较,在综合度量查全率和查准率的性能指标F1上,比2001 TREC评估中最佳指标高约8％.     

基于类内和类间损失的场景构造方法

为了便于在不同结构层次上对视频进行检索和浏览。可以把视频序列分为不同层次的逻辑单元。逻辑单元的层次由上到下可以分成序列、场景、镜头和帧。其中场景是时间上具有一定顺序关系的相似镜头的集合。文章提出了基于类内和类间损失的场景构造算法。首先利用时间约束和颜色直方图求得镜头距离；然后基于类内和类间损失对相似镜头进行聚类，得到镜头类；最后在分析镜头类的基础上构造场景。实验证明，构造的场景比较好的反映了视频的内容。     

一种基于模糊逻辑的MPEG压缩视频场景转换检测方法

镜头边界的自动检测是实现基于内容的视频检索必不可少的第一步,目前大多数的场景转换检测方法都是基于非压缩视频的,而越来越多的视频数据却以压缩形式存在。本主文提出了一咱新的针对ＭＰＥＧ压缩视频的场景转换检测算法,它利用ＤＣ序列和运动向量计算像素差、直方图差、统计差和具有“真实”运动向量的宏块所占的比例,然后用模糊逻辑对上述参量加以综合隶属度用自适应的方法确定。实验表明这种镜头检测算法具有较高的检出率和     

Shot boundary detection in the presence of illumination and motion

Detection of gradual transition and the elimination of disturbances caused by illumination change or fast object and camera motion are the major challenges to the current shot boundary detection techniques. These disturbances are often mistaken as shot boundaries. Therefore, it is a challenging task to develop a method that is not only insensitive to various disturbances but also sensitive enough to capture a shot change. To address these challenges, we propose an algorithm for shot boundary detection in the presence of illumination change, fast object motion, and fast camera motion. This is important for accurate and robust detection of shot boundaries and in turn critical for high-level content-based analysis of video. First, the propose algorithm extracts structure features from each video frame by using dual-tree complex wavelet transform. Then, spatial domain structure similarity is computed between adjacent frames. The declaration of shot boundaries are decided based on carefully chosen thresholds. Experimental study is performed on a number of videos that include significant illumination change and fast motion of camera and objects. The performance comparison of the proposed algorithm with other existing techniques validates its effectiveness in terms of better Recall, Precision, and F1 score.     

使用线性分割和序列合并的视频镜头分割方法

本文提出一种双向帧距离模型,基于帧距离双向对比,采用较低的全局阈值,使用线性遍历的方法对视频内容进行粗镜头划分成碎片序列集合和边界序列集合.然后通过比对每一个边界序列相邻的碎片序列内容的相似度,对粗划分的内容进行再合并,从而实现了用线性方法同时解决突变类镜头切换和渐变类镜头切换的镜头分割问题.     

基于模糊粗糙集的新闻视频镜头边界检测方法

镜头边界检测是实现基于内容的视频检索的一个重要步骤.为了将视频分割成镜头,现有的方法大都是首先提取大量的特征然后构造相异性测度函数.然而,太多的特征就会降低算法的效率.因此,有必要对镜头边界检测的规则进行特征约简.本文将粗糙集中的属性重要性和模糊粗糙集中的分类精度相结合定义了模糊粗糙算子,并构造了相异度检测函数.最后给出了镜头边界检测的一般性规则.由于本文检测方案的自适应性,因此适合于各种类型的新闻视频.用来自中央电视台的3个多小时的新闻视频所做的镜头边界检测实验获得了95.4%的查全率和96.1%的准确率.     

Video scene clustering by graph partitioning

A new video scene clustering method using graph partitioning is proposed. In the method, the shots of a video are grouped into clusters of similar scenes based on shot colour attributes; the number of scene clusters is not required to be known a priori. Experimental results are presented to show the effectiveness of the proposed method.     

A new pyramidal opponent color-shape model based video shot boundary detection

Video shot boundary detection (VSBD) is one of the most essential criteria for many intelligent video analysis-related applications, such as video retrieval, indexing, browsing, categorization and summarization. VSBD aims to segment big video data into meaningful fragments known as shots. This paper put forwards a new pyramidal opponent colour-shape (POCS) model which can detect abrupt transition (AT) and gradual transition (GT) simultaneously, even in the presence of illumination changes, huge object movement between frames, and fast camera motion. First, the content of frames in the video subjected to VSBD is represented by the proposed POCS model. Consequently, the temporal nature of the POCS model is subjected to a suitable segment (SS) selection procedure in order to minimize the complexity of VSBD method. The SS from the video frames is examined for transitions within it using a bagged-trees classifier (BTC) learned on a balanced training set via parallel processing. To prove the superiority of the proposed VSBD algorithm, it is evaluated on the TRECVID 2001, TRECVID2007 and VIDEOSEG2004 data sets for classifying the basic units of video according to no transition (NT), AT and GT. The experimental evaluation results in an F₁-score of 95.13%, 98.13% and 97.11% on the TRECVID 2001, TRECVID2007 and VIDEOSEG2004 data sets, respectively.     

A perceptual scheme for fully automatic video shot boundary detection

In this paper, we propose a novel and robust modus operandi for fast and accurate shot boundary detection where the whole design philosophy is based on human perceptual rules and the well-known “Information Seeking Mantra”. By adopting a top–down approach, redundant video processing is avoided and furthermore elegant shot boundary detection accuracy is obtained under significantly low computational costs. Objects within shots are detected via local image features and used for revealing visual discontinuities among shots. The proposed method can be used for detecting all types of gradual transitions as well as abrupt changes. Another important feature is that the proposed method is fully generic, which can be applied to any video content without requiring any training or tuning in advance. Furthermore, it allows a user interaction to direct the SBD process to the user's “Region of Interest” or to stop it once satisfactory results are obtained. Experimental results demonstrate that the proposed algorithm achieves superior computational times compared to the state-of-art methods without sacrificing performance.     

一种自动选取阈值的视频镜头边界检测算法

镜头边界检测是实现基于内容的视频检索的一个重要步骤.文中介绍了现有的镜头边界检测的基本方法,并针对其不足提出了一种自动选取阈值的、综合考虑颜色和空间特征的镜头边界检测算法.该方法能较好地检测出镜头突变和物体运动以及光线变化等情况,对渐变镜头也能达到检测的目的.实验结果表明算法能够有效地检测出视频镜头边界.     

基于累积直方图的视频镜头边界检测方法

提出了一种基于累积直方图的视频镜头边界检测方法,以累积直方图来代表视频帧图像的特征,其帧差充分反映了视频帧图像间的差异性;结合滑动窗的局部阈值分割处理,获得镜头边界检测对物体/摄像机的运动和光线变化的不敏感性。实验结果表明,本方法在镜头突变边界检测中达到95.97%的查全率和96.75%的查准率。     

一种快速有效的视频镜头边界检测方法

本文在分析现有的镜头边界检测方法的基础上,提出了一种层次化镜头边界检测方法.首先我们利用小波变换对信号奇异点的检测能力和对噪声具有较强的鲁棒性,实现了镜头边界的预检测.然后我们通过对候选镜头边界的虚警分析,有效地降低了闪光灯和快速运动对镜头边界检测产生的影响,并实现了镜头突变检测.在渐变类型分类中,我们分别实现了淡入淡出、扫换和溶解等三种重要镜头边界类型的检测.实验结果表明,本文方法能够快速、有效地实现视频镜头边界类型的检测,对运动和光线变化有较强的鲁棒性.     

Modified Kolmogorov-Smirnov metric for shot boundary detection

A new metric extended from the existing Kolmogorov-Smirnov measure is proposed for detecting shot boundaries of video. Exploiting more fine-grained differences between the cumulative histograms of two successive frames, the proposed metric improves both the recall and precision of shot boundary detection. Experiments conducted on a comprehensive video set show that the new metric outperforms other widely-used histogram-based metrics.     

级联手工特征与深度特征的视频关键帧检测方法

关键帧检测是有效的视频内容分析的关键环节。常用的基于手工特征的方法运行效率高但很难有效表征关键帧特征,因而性能不好。基于深度特征的方法因为网络结构复杂,导致效率不高。在体育比赛类视频中,关键帧常为比赛转播中镜头变化的最后一帧。但广播视频中除了包含比赛视频还包括很多其他类型的镜头如中场休息、渐变镜头等。因此检测最后一帧包含很多比赛无关内容。针对这一问题,本文提出了一种手工特征与深度特征相结合的视频关键帧检测方法。首先基于颜色直方图特征进行镜头边界检测获取最后一帧。进一步基于直方图相似性提出一种类似聚类的方法得到候选关键帧。最后,基于深度神经网络对候选关键帧进行分类,得到真正的关键帧。在冰壶比赛视频和篮球比赛视频上的对比实验结果表明,相对于传统的背景差分法、光流法等,本文提出方法能够快速、可靠地提取关键帧。      

用非监督式聚类进行视频镜头分割

镜头边界检测是基于内容的视频检索首先要解决的问题。研究人员通常将镜头转换分为突变和渐变,并根据各种转换的特点采用不同的检测算法。在研究中发现,视频镜头的抽象程度与对其进行边界划分的精度相关。为此,提出采用非监督式聚类算法,按照给定的相似尺度对视频数据进行自组织和动态分析,完成层次化的镜头分割。该算法侧重于揭示视频的层次结构,能实现不同精度的视频抽象要求。     

Video Shot Boundary Detection in MPEG Compressed Sequences Using SVM Learning

A number of automated video shot boundary detection methods for indexing a videosequence to facilitate browsing and retrieval have been proposed in recent years.Among these methods,the dissolve shot boundary isn't accurately detected because it involves the camera operation and objectmovement.In this paper,a method based on support vector machine (SVM) is proposed to detect thedissolve shot boundary in MPEG compressed sequence.The problem of detection between the dissolveshot boundary and other boundaries is considered as two-class classification in our method.Featuresfrom the compressed sequences are directly extracted without decoding them,and the optimal classboundary between two classes are learned from training data by using SVM.Experiments,whichcompare various classification methods,show that using proposed method encourages performance ofvideo shot boundary detection.     

Hierarchical structuring of video previews by Leading-Cluster-Analysis

Clustering of shots is frequently used for accessing video data and enabling quick grasping of the associated content. In this work we first group video shots by a classic hierarchical algorithm, where shot content is described by a codebook of visual words and different codebooks are compared by a suitable measure of distortion. To deal with the high number of levels in a hierarchical tree, a novel procedure of Leading-Cluster-Analysis is then proposed to extract a reduced set of hierarchically arranged previews. The depth of the obtained structure is driven both from the nature of the visual content information, and by the user needs, who can navigate the obtained video previews at various levels of representation. The effectiveness of the proposed method is demonstrated by extensive tests and comparisons carried out on a large collection of video data.     

基于运动区域检测的会议视频清晰度增强处理

视频会议场景对视频增强的实时性有较高的要求.针对现有视频增强算法(如BM3D等)存在的耗时长的问题,基于变化区域检测提出一种基于运动区域检测的视频增强技术.对时序帧数据进行颜色空间转换,快速地将视频场景分为静止区域和运动区域,之后对静止区域进行时域降噪和视频增强.在视频帧集合的实验结果表明,该算法可以显著地增强图像纹理...