首页 | 本学科首页   官方微博 | 高级检索  
     


Exploring video content structure for hierarchical summarization
Authors:Email author" target="_blank">Xingquan?ZhuEmail author  Xindong?Wu  Jianping?Fan  Ahmed?K?Elmagarmid  Walid?G?Aref
Affiliation:(1) Department of Computer Science, University of Vermont, VT 05405 Burlington, USA;(2) Department of Computer Science, University of North Carolina, NC 28223 Charlotte, USA;(3) Department of Computer Science, Purdue University, IN 47907 W. Lafayette, USA
Abstract:In this paper, we propose a hierarchical video summarization strategy that explores video content structure to provide the users with a scalable, multilevel video summary. First, video-shot- segmentation and keyframe-extraction algorithms are applied to parse video sequences into physical shots and discrete keyframes. Next, an affinity (self-correlation) matrix is constructed to merge visually similar shots into clusters (supergroups). Since video shots with high similarities do not necessarily imply that they belong to the same story unit, temporal information is adopted by merging temporally adjacent shots (within a specified distance) from the supergroup into each video group. A video-scene-detection algorithm is thus proposed to merge temporally or spatially correlated video groups into scenario units. This is followed by a scene-clustering algorithm that eliminates visual redundancy among the units. A hierarchical video content structure with increasing granularity is constructed from the clustered scenes, video scenes, and video groups to keyframes. Finally, we introduce a hierarchical video summarization scheme by executing various approaches at different levels of the video content hierarchy to statically or dynamically construct the video summary. Extensive experiments based on real-world videos have been performed to validate the effectiveness of the proposed approach.Published online: 15 September 2004 Corespondence to: Xingquan ZhuThis research has been supported by the NSF under grants 9972883-EIA, 9974255-IIS, 9983248-EIA, and 0209120-IIS, a grant from the state of Indiana 21th Century Fund, and by the U.S. Army Research Laboratory and the U.S. Army Research Office under grant DAAD19-02-1-0178.
Keywords:Hierarchical video summarization  Video content hierarchy  Video group detection  Video scene detection  Hierarchical clustering
本文献已被 SpringerLink 等数据库收录!
设为首页 | 免责声明 | 关于勤云 | 加入收藏

Copyright©北京勤云科技发展有限公司  京ICP备09084417号