Efficient MPEG compressed video analysis using macroblock typeinformation

Efficient indexing methods are required to handle the rapidly increasing amount of visual information within video databases. Video analysis that partitions the video into clips or extracts interesting frames is an important preprocessing step for video indexing. We develop a novel method for video analysis using the macroblock (MB) type information of MPEG compressed video bitstreams. This method exploits the comparison operations performed in the motion estimation procedure, which results in specific characteristics of the MB type information when scene changes occur or some special effects are applied. Only a simple analysis on MB types of frames is needed to achieve very fast scene change, gradual transition, flashlight, and caption detection. The advantages of this novel approach are its direct extraction from the MPEG bitstreams after VLC decoding, very low complexity analysis, frame-based detection accuracy and high sensitivity     

一种基于运动特征的快速镜头边界检测方法

提出了一种基于MPEG视频流运动特征的镜头边界检测模糊推理方法。首先提取MPEG视频流中每帧的宏块信息，然后分析这些信息分别得到相似度、相似度差、运动活动性强度差、运动集中度差等，并将它们作为隶属度函数的输入量，按照一定的推理规则得到突变、渐变、无镜头变换三种情况的隶属度值，值最大者决定该帧是何种类型。实验结果表明该方法具有较高的检测精度，而且由于该方法不用对MPEG视频流进行解压缩，因此处理速度快，适合于实时应用场合。     

基于DC系数和运动矢量的快速场景分割算法

场景分割技术是动态视频分析和基于内容的视频检索的基础，以检测出来的场景作为基本单元，可以进一步对视频内容进行分析和建立索引．本文旨在提出一种基于MPEG压缩视频流的场景分割算法，利用MPEG数据流中已有的DCT DC系数和运动矢量，来检测场景的变换，从而实现场景分割，针对实际视频流中场景突变和渐变两类变换．本文提出两种方法分别处理不同情况，对于突变检测，该算法可以定位到帧，由于该算法进行最小程度的解码，降低了计算复杂度，因而大大提高了检测速度．     

一种基于模型的扫换检测方法

视频自动分割是实现视频数据库检索必不可少的一个过程,其基础是镜头边界检测.当前已有的算法能够较准确地检测出镜头突变,但对于镜头的渐变则常常会漏检,这是由于镜头渐变时帧间差没有一个明显的峰值,因而其检测比突变检测要困难得多.扫换是一种常用的视频空间编辑手段,用于实现多种镜头变化.通过分析各种类型的扫换,提出了一种新的基于视频空间编辑模型的扫换检测算法,其性能优于Alattar提出的基于统计特征的算法.对用AdobePremiere5.1生成的各种扫换视频进行检测.实验结果表明,这种扫换检测算法能够较好地适应     

基于模式模板的MPEG压缩视频序列的划变转换检测

为了在进行视频分段时，对一些复杂的和奇异的Wipe转换模式进行检测，得出了一种基于模式模板的MPEG压缩视频序列的划变转换检测方法。该方法是在刻画划变转换时，用一种视频帧间图象特征变化信息的模式模板；并用一个基于该模式模板的算法，来检测包括各种奇异转换在内的划变转换，同时为了消除运动干扰，还引入了Hough变换。实验结果显示，该方法能精确检测划变转换区的位置和识别相应的转换模式，另外，无论是已存在的或将来出现的划变转换模式，该算法都同样适用。     

Sudden scene change detection in compressed video using interpolated macroblocks in B-frames

This paper addresses an important area in video processing, namely compressed domain processing. For video indexing, video scene transition detection is an essential step to segment the video. Current techniques for scene change detection tend to suffer from a major limitation as most of them cannot identify scene transitions in the compressed domain. Since most video is expected to be stored in the compressed domain, scene transition detection in this domain is highly desirable. In this paper an algorithm for video scene change detection is proposed to overcome this limitation. In this scheme, properties of the B-frames are used as it is capable of measuring the correlation between two adjacent reference frames. The results show that this scheme performs better than schemes based on P-frames. Proposed scheme can be directly applied with compressed data with minimum decompression and hence it is computationally efficient and makes real time implementations possible. Results show that video scene transitions can be identified satisfactorily with the proposed scheme.     

Scene-effect detection and insertion MPEG encoding scheme for video browsing and error concealment

For an MPEG coding scheme, the encoder can do more than video compression. In this paper, a novel MPEG codec embedded with scene-effect information detection and insertion is proposed to provide more functionality at the decoder end. Based on the macroblock (MB) type of information that is generated simultaneously in the encoding process, a single-pass automatic scene-effect insertion MPEG coding scheme can be achieved. Using the USER/spl I.bar/DATA of picture header, the video output bitstreams by our method still conform to the conventional MPEG decoding system. The proposed method provides a solution toward upgrading the existing MPEG codec with low complexity to accomplish at least two major advantages. Precise and effective video browsing resulting from the scene-effect extraction can significantly reduce the user's time to look up what they are interested in. For video transmission, the bitstreams containing scene-effect information can obtain better error concealment performance when scene changes are involved. Compared with the gain it achieves, the payout of our algorithm is very worthy with comparatively small efforts.     

一种新的基于运动矢量的MPEG VIDEO码流cut检出算法

介绍了一种对ＭＰＥＧ ＶＩＤＥＯ码流中场景切换点进行高速检出的新方法,在计算各帧相对于预测帧的类似度之后进行了类似度的归一化,降低了ｃｕｔ检出算法的复杂度,提高了检出的速度。     

Fast scene change detection using direct feature extraction fromMPEG compressed videos

In order to process video data efficiently, a video segmentation technique through scene change detection must be required. This is a fundamental operation used in many digital video applications such as digital libraries, video on demand (VOD), etc. Many of these advanced video applications require manipulations of compressed video signals. So, the scene change detection process is achieved by analyzing the video directly in the compressed domain, thereby avoiding the overhead of decompressing video into individual frames in the pixel domain. In this paper, we propose a fast scene change detection algorithm using direct feature extraction from MPEG compressed videos, and evaluate this technique using sample video data, First, we derive binary edge maps from the AC coefficients in blocks which were discrete cosine transformed. Second, we measure edge orientation, strength and offset using correlation between the AC coefficients in the derived binary edge maps. Finally, we match two consecutive frames using these two features (edge orientation and strength). This process was made possible by a new mathematical formulation for deriving the edge information directly from the discrete cosine transform (DCT) coefficients. We have shown that the proposed algorithm is faster or more accurate than the previously known scene change detection algorithms     

一种快速的压缩域视频流场景分段算法

提出了一种快速的压缩域视频流场景分段算法，对视频流进行两次分析：第一次分析（粗略分析）只分析P-帧中宏块统计信息，检测出可能存在的镜头边界；第二次分析（精确分析）再对粗略分析找出的边界邻近的B-帧和P-帧的宏块类型进行分析。从而对场景变换进行精确分析和定位，实验结果表明，粗略分析可以满足实时检测的速度要求，帧定位误差控制在10帧之内，精确分析可以进一步把帧定位误差控制在2帧之内。     

基于Rough Set的镜头分割方法

综合利用了MPEG视频流P帧的运动特征、像素差和直方图差特征,提出了一种基于Rough Set的镜头分割方法。该方法首先提取视频流中P帧的宏块信息,然后分析得到其运动活力性、宏块类型和运动空间分布,再结合这些帧的像素差特征和直方图差特征,利用Rough Set对这些特征进行约减后,对镜头切换处进行识别。实验表明,该方法能有效地区分镜头的突变,对渐变也能很好地检测。     

视频检索中镜头分割方法综述

视频序列的镜头分割亦称镜头变化检测是视频检索中的关键技术之一。镜头变化是指视频序列中场景内容的变化。该文介绍了目前镜头分割的常用方法,包括灰度分割法、边缘分割法、彩色直方图分割法、MPEG视频的分割方法、块匹配镜头分割方法、统计判决镜头分割方法、基于聚类的镜头分割方法、镜头渐变的检测等,指出了研究场景内容的表征方法、特征提取方法、特征的检测尺度以及稳健可靠的实用镜头分割方法是目前主要的研究方向。     

基于宏块类型信息的自适应场景变换检测算法

提出了一种压缩域中利用B帧的宏块类型信息自适应场景变换检测算法,采取滑窗方式自适应地检测场景突变和场景渐变的准确位置。利用电影、动画、新闻等素材作为实验视频库,并利用MPEG 2作为实验平台,取得了较高的查全率和查准率。     

一种从MPEG视频流中快速分割镜头的算法

镜头分割算法是实现视频检索的关键,本文提出一种针对MPEG视频流的快速分割镜头的算法,介绍了该算法的基本原理与实现过程。该算法利用压缩视频中的可用信息,通过计算帧的内编码宏块数量的比例作为是否需要进行镜头分割判别的标识,进而计算MPEG视频流B帧各宏块编码类型来检测发生镜头分割的帧住置,并进行了相关的实验。实验
结果表明,该算法能快速有效地检测镜头分割,且计算量较小。     

基于压缩域的关键帧快速提取方法

关键帧提取技术是基于内容检索和视频分析的基础。关键帧的使用减少了视频索引的数据量,同时也为视频摘要和检索提供了一个组织框架。首先介绍了目前的关键帧提取技术,然后提出了一种基于运动特征利用模糊推理算法从MPEG视频流中提取关键帧的方法。由于处理过程是直接从MPEG的压缩视频提取,不需对其解压,所以计算复杂度低,提高了提取速度。实验证明该方法效率高,可以比较好地代表视频内容。     

MPEG压缩域多尺度镜头切变检测算法

如何在压缩域进行镜头的切变检测一直是视频自动索引和检索中的难点。提出了一种MPEG压缩域多尺度镜头切变检测算法,在GOP、slot和B帧三个尺度上对MPEG视频流进行分析。通过对相邻I帧的检测,确定一个GOP中是否存在镜头切变;通过对slot的分析,确定镜头切变在GOP中所处的区域;通过对B帧的检测,确定镜头切变发生的确切位置。     

Statistical sequential analysis for real-time video scene change detection on compressed multimedia bitstream

The increased availability and usage of multimedia information have created a critical need for efficient multimedia processing algorithms. These algorithms must offer capabilities related to browsing, indexing, and retrieval of relevant data. A crucial step in multimedia processing is that of reliable video segmentation into visually coherent video shots through scene change detection. Video segmentation enables subsequent processing operations on video shots, such as video indexing, semantic representation, or tracking of selected video information. Since video sequences generally contain both abrupt and gradual scene changes, video segmentation algorithms must be able to detect a large variety of changes. While existing algorithms perform relatively well for detecting abrupt transitions (video cuts), reliable detection of gradual changes is much more difficult. A novel one-pass, real-time approach to video scene change detection based on statistical sequential analysis and operating on a compressed multimedia bitstream is proposed. Our approach models video sequences as stochastic processes, with scene changes being reflected by changes in the characteristics (parameters) of the process. Statistical sequential analysis is used to provide an unified framework for the detection of both abrupt and gradual scene changes.     

H．264压缩域中利用Biased-SVM检测镜头边界

为了直接从H．264码流中检测镜头边界,提出了利用H．264压缩域多特征和Biased—SVM（不平衡支持向量机）分类算法的检测方法。分析帧类型、宏块类型、运动矢量、帧内预测模式等信息,以获得发生镜头突变和渐变的特征。针对镜头边界帧的数量远少于视频帧总数的特点,用Biased—SVM分类方法将视频帧分为突变帧、渐变帧和非镜头边界帧。在TRECVID视频集上的实验结果表明,与其他H．264压缩域的算法相比,该算法有更好的性能。     

基于三维整数小波变换的视频水印算法

随着计算机和网络技术的快速发展,数字水印技术正成为一种保护数字作品知识产权的有效方法.针对数字视频的版权保护,提出一种基于三维整数小波变换的视频水印算法.利用视频场景分割将视频信号切分成不同场景,然后随机选择一场景中视频序列进行三维整数小波变换.采用对小波系数进行均值量化的方法嵌入水印信息,水印提取过程中不需要原始视频信号.该算法实现简单,可满足实时性要求.实验结果表明,该水印方案对于帧丢失、帧插入等时间域去同步攻击以及MEPG有损压缩等具有很好的鲁棒性.     

一种用于自动视频分段的WIPE转换检测和模式识别方法

自动视频分段是视频分类、组织和索引的基本步骤 ,其目标是检测和识别出各种镜头转换边界 .划变(Wipe)被认为是其中最难以检测和识别的镜头转换模式 .提出了一种新的基于模式模板的 Wipe转换区检测和模式识别方法 ,在该方法中 ,首先提出了一种模式模板的概念用于对各种 Wipe转换建立模式模板库 ,然后在模式模板库的基础上设计了一个通用的匹配算法 ,最后 ,通过对匹配结果进行 Hough变换 ,使得在存在相当大的运动干扰情况下 ,仍能精确检测转换区位置和识别转换模式 ,具有很好的鲁棒性 .该方法解决了对目前存在的各种复杂和奇异 Wipe转换模式的检测和识别问题 ,对以后出现的 Wipe转换模式同样适用 ,为此类问题的解决提供了一种新的思路