A Supervised Learning Approach to Flashlight Detection

Shot boundary detection is a fundamental step of video indexing. One crucial issue of this step is the discrimination of abrupt shot change from flashlight, because flashlight often induces a false shot boundary. Support vector machine (SVM) is a supervised learning technique for data classification. In this paper, we propose a SVM-based technique to detect flashlights in video. Our approach to flashlight detection is based on the facts that the duration of flashlight is short and the video contents before and after a flashlight should be similar. Therefore, we design a sliding window in temporal domain to monitor the instantaneous video variation and extract color and edge features to compare the visual contents between two video segments. Then, a SVM is employed to classify the luminance variation into flashlight or shot cut. Experimental results indicate that the proposed approach is effective and outperforms some existing techniques.     

基于聚类的镜头边界检测算法

镜头边界检测是基于内容视频检索的重要组成部分。为从不同类型的视频中有效地检测出视频镜头边界,提出一种视频镜头边界检测算法。通过视频帧图像的颜色特征,得到视频的相似性矩阵,根据突变镜头和渐变镜头在Affinity Propagation聚类结果中的不同特点,运用双阈值法检测镜头边界。实验结果表明,该算法从视频的本身信息分布出发,能自动快速地检测出镜头边界。     

一种精确定位镜头边缘的方法

提出了一种针对MPEG视频的精确定位镜头边缘的方法，结合视频非压缩域和压缩域中相关视频帧的信息来定位镜头边缘。首先利用解压后的I帧信息来粗略定位镜头边缘，然后利用视频序列压缩域中的B帧的运动趋势来精确定位镜头边缘，而不用对其解压缩。实验结果表明此方法能精确地检测到视频的镜头边缘。     

一种精确定位镜头边缘的方法

提出了一种针对MPEG视频的精确定位镜头边缘的方法,结合视频非压缩域和压缩域中相关视频帧的信息来定位镜头边缘。首先利用解压后的I帧信息来粗略定位镜头边缘,然后利用视频序列压缩域中的B帧的运动趋势来精确定位镜头边缘,而不用对其解压缩。实验结果表明此方法能精确地检测到视频的镜头边缘。     

基于基色调的镜头边界检测方法

视频结构化组织是建立视频检索和浏览系统的基础，而镜头边界检测是视频结构化的第一步. 在本文中，我们提出了基于基色调的镜头边界检测方法. 该方法首先利用 I 帧的比特数信息，减少参与检测的 I 帧；然后在考虑基色调的基础上得到局部的自适应阈值；最后用双阈值方法检测镜头边界. 实验证明，该方法可以对长视频序列进行较好的镜头突变和渐变检测，并且减少了计算量，同时能够排除大物体运动和摇镜头对镜头检测的影响.     

基于流形特征的镜头边界检测后处理算法

镜头是视频分析和检索的基础,为了有效检测镜头边界,并对镜头边界进行分类,提出一种新的镜头边界描述子：镜头边界流形．视频流可以看做一个高雏空间,镜头边界流形是隐含在该空间中的局部结构,它能够有效区分镜头边界和非镜头边界,以及区分不同类型的镜头边界．采用这种特征,提出一种后处理算法,一方面去除预检测镜头边界的虚警,另一方面将真正的镜头边界分类．实验结果证实了镜头边界流行的有效性以及后处理算法的优异性能．     

基于粗糙集和模糊聚类的新闻视频镜头边界检测方法

为了将视频分割成镜头,目前的方法都是提取某些特征然后构造不同的相异性函数。然而,太多的特征就会降低镜头分割算法的效率。因此,有必要对每一个镜头检测决策进行特征约简。基于此,提出了基于粗糙集和模糊聚类的分类方法并得到了相应的决策规则。针对新闻场景的特殊性,将镜头分割成突变过渡、渐变过渡以及无场景变化3类。用超过2个小时的新闻视频所做的实验获得了96.5%的查全率和97.9%的准确率。     

Fast video shot boundary detection framework employing pre-processing techniques

Video shot boundary detection is the initial and fundamental step towards video indexing, browsing and retrieval. Great efforts have been paid on developing accurate shot boundary detection algorithms. However, the high computational cost in shot detection becomes a bottleneck for real-time applications. The problem of making a balance between detection accuracy and speed is addressed in this paper, and a novel fast detection framework is presented. The general framework that employs pre-processing techniques can improve both detection speed and precision. In the pre-processing stage, adaptive local thresholding is adopted to classify non-boundary segments and candidate segments that may contain shot boundaries. The candidate segments are refined using bisection-based comparisons to eliminate non-boundary frames. Only refined candidate segments are preserved for further detections; hence, the speed of shot detection is improved by reducing detection scope. Moreover, prior knowledge about each possible shot boundary such as its type and duration can be obtained in the pre-processing stage, which can accelerate the consequent hard cut and gradual transition detections. Experimental results indicate that the proposed framework is effective in accelerating the shot detection process, and it can also achieve excellent detection accuracies.     

一种新的视频镜头分割算法

镜头是视频分析和索引的基础，但是自动的镜头分割，尤其是渐变切换的检测还是一个很有挑战性的课题。本文提出了一种利用直方图与模板匹配相结合来进行视频镜头切变检测的算法和一种利用图象灰度级平均(MGL)来进行渐变检测的算法，该渐变检测算法能有效区分摄象机镜头的运动和渐变。实际测试证明，利用本文算法进行视频镜头检测
能取得比较好的效果。     

Video shot boundary detection: Seven years of TRECVid activity

Shot boundary detection (SBD) is the process of automatically detecting the boundaries between shots in video. It is a problem which has attracted much attention since video became available in digital form as it is an essential pre-processing step to almost all video analysis, indexing, summarisation, search, and other content-based operations. Automatic SBD was one of the tracks of activity within the annual TRECVid benchmarking exercise, each year from 2001 to 2007 inclusive. Over those seven years we have seen 57 different research groups from across the world work to determine the best approaches to SBD while using a common dataset and common scoring metrics. In this paper we present an overview of the TRECVid shot boundary detection task, a high-level overview of the most significant of the approaches taken, and a comparison of performances, focussing on one year (2005) as an example.     

Shot Change Detection via Local Keypoint Matching

Shot change detection is an essential step in video content analysis. However, automatic shot change detection often suffers from high false detection rates due to camera or object movements. To solve this problem, we propose an approach based on local keypoint matching of video frames. This approach aims to detect both abrupt and gradual transitions between shots without modeling different kinds of transitions. Our experiment results show that the proposed algorithm is effective for most kinds of shot changes.      

基于宏块运动信息的镜头边界检测

镜头边界检测是视频处理与检索中最重要的第一步。对视频流直接在压缩域中部分解压I帧,提取其DC图像的特征,利用连续I帧的DC图像的特征差异粗略定位镜头的边界,再根据压缩域中P、B帧的各种类型的宏块数量变化精确定位镜头边界。实验结果表明,本算法能高效而精确地对突变镜头和渐变镜头进行检测,弥补了压缩域中镜头定位精确性不高的缺点。     

基于梯度向量角法的视频序列中镜头渐变检测

镜头边界检测是进行视频内容分析的首要步骤。本文提出一种新的基于梯度向量角的镜头边界检测方法。首先进行小波变换,提取第二层分解的低频系数,再求出梯度系数,然后计算连续帧梯度系数之间的绝对距离,得到两帧之间的不连续值,最后采用自适应阈值分割,检测出镜头边界。     

基于相邻尺度小波变换乘积的镜头渐变检测

镜头边界检测是进行视频内容分析的首要步骤。提出一种基于相邻尺度小波变换乘积的镜头边缘检测方法。对镜头内的每帧视频图像进行小波变换,求出各帧图像相邻尺度小波变换尺度积的模和方向。计算连续帧图像尺度积与模之间的绝对距离,得到2帧图像间的不连续值。通过自适应阈值分割,检测出镜头边界。     

A shot detection technique using linear regression of shot transition pattern

Video segmentation acts as the fundamental step for various applications like, archiving, content based retrieval, copy detection and summarization of video data. Shot detection is first level of segmentation. In this work, a shot detection methodology is presented that evolves around a simple shot transition model based on the similarity of the frames with respect to a reference frame. Frames in an individual shot are very similar in terms of their visual content. Whenever a shot transition occurs a change in similarity values appears. For an abrupt transition, the rate of change is very high, while for gradual it is not so apparent. To overcome the effect of noise in similarity values, line is fit over a small window using a linear regression. Thus slope of this line exhibits the underlying pattern of transition. A novel algorithm for shot detection, hence, is developed based on the variation pattern of the similarity values of the frames with respect to a reference frame. First an algorithm is proposed, which is direct descendant of the underlying transition model and applies a threshold on the similarity values to detect the transitions. Then this algorithm is improved by utilizing the slope of linear approximation of variation in similarity values rather than the absolute values, following least square regression. Threshold on the slope is determined with a bias towards minimizing false rejection rate at the cost of false acceptance rate. Finally, a simple post-processing technique is adopted to reduce the false detection. Experiment is done with the video sequences taken from TRECVID 2001 database, action type movie video, recorded sports and news video. Comparison with few other systems indicates that the performance of the proposed scheme is quite satisfactory.     

视频检索中镜头分割方法综述

视频序列的镜头分割亦称镜头变化检测是视频检索中的关键技术之一。镜头变化是指视频序列中场景内容的变化。该文介绍了目前镜头分割的常用方法,包括灰度分割法、边缘分割法、彩色直方图分割法、MPEG视频的分割方法、块匹配镜头分割方法、统计判决镜头分割方法、基于聚类的镜头分割方法、镜头渐变的检测等,指出了研究场景内容的表征方法、特征提取方法、特征的检测尺度以及稳健可靠的实用镜头分割方法是目前主要的研究方向。     

A motion-tolerant dissolve detection algorithm

Gradual shot change detection is one of the most important research issues in the field of video indexing/retrieval. Among the numerous types of gradual transitions, the dissolve-type gradual transition is considered the most common one, but it is also the most difficult one to detect. In most of the existing dissolve detection algorithms, the false/miss detection problem caused by motion is very serious. In this paper, we present a novel dissolve-type transition detection algorithm that can correctly distinguish dissolves from disturbance caused by motion. We carefully model a dissolve based on its nature and then use the model to filter out possible confusion caused by the effect of motion. Experimental results show that the proposed algorithm is indeed powerful.     

AVCD-FRA: A novel solution to automatic video cut detection using fuzzy-rule-based approach

Video shot boundary detection (SBD) is a fundamental step in automatic video content analysis toward video indexing, summarization and retrieval. Despite the beneficial previous works in the literature, reliable detection of video shots is still a challenging issue with many unsolved problems. In this paper, we focus on the problem of hard cut detection and propose an automatic algorithm in order to accurately determine abrupt transitions from video. We suggest a fuzzy rule-based scene cut identification approach in which a set of fuzzy rules are evaluated to detect cuts. The main advantage of the proposed method is that, we incorporate spatial and temporal features to describe video frames, and model cut situations according to temporal dependency of video frames as a set of fuzzy rules. Also, while existing cut detection algorithms are mainly threshold dependent; our method identifies cut transitions using a fuzzy logic which is more flexible. The proposed algorithm is evaluated on a variety of video sequences from different genres. Experimental results, in comparison with the most standard cut detection algorithms confirm our method is more robust to object and camera movements as well as illumination changes.     

Novel automatic video cut detection technique using Gabor filtering

Video shot transition identification constitutes an important computer vision research field, being applied, as an essential step, in many other digital video analysis domains: video scene detection, video compression, video indexing, video content retrieval and video object tracking. This paper approaches the video cut transition detection domain, providing a novel feature-based automatic identification method. We propose a feature extraction technique that uses 2D Gabor filtering, computing tridimensional image feature vectors for the video frames. Most shot cut detection techniques use a thresholding operation to discriminate between the inter-frame difference metric values and thus identify the video break points. Our identification approach is not threshold-based, using an automatic unsupervised distance classification procedure instead of a threshold. Thus, we provide a region-growing based classification approach, that proves to be very efficient in clustering the distances between feature vectors of consecutive frames. The two resulted distance classes determine a satisfactory video shot detection.     

一种基于特征跟踪的视频镜头检测算法

将视频切分为镜头是视频内容分析及基于内容的视频检索和浏览的第一步。针对视频镜头边界检测,提出了一种基于特征跟踪的新算法。该算法从镜头起始帧中提取出一组角点特征,然后在后续帧中基于Kalman滤波进行特征窗跟踪,最后根据对应特征窗内的像素特征变化规律,得到镜头边界检测所需的测度,判断镜头切换的性质和渐变镜头的起止时间。实验结果表明该算法运算复杂度低,且具有较强的鲁棒性。