Exploring video content structure for hierarchical summarization |
| |
Authors: | Email author" target="_blank">Xingquan?ZhuEmail author Xindong?Wu Jianping?Fan Ahmed?K?Elmagarmid Walid?G?Aref |
| |
Affiliation: | (1) Department of Computer Science, University of Vermont, VT 05405 Burlington, USA;(2) Department of Computer Science, University of North Carolina, NC 28223 Charlotte, USA;(3) Department of Computer Science, Purdue University, IN 47907 W. Lafayette, USA |
| |
Abstract: | In this paper, we propose a hierarchical video summarization strategy that explores video content structure to provide the users with a scalable, multilevel video summary. First, video-shot- segmentation and keyframe-extraction algorithms are applied to parse video sequences into physical shots and discrete keyframes. Next, an affinity (self-correlation) matrix is constructed to merge visually similar shots into clusters (supergroups). Since video shots with high similarities do not necessarily imply that they belong to the same story unit, temporal information is adopted by merging temporally adjacent shots (within a specified distance) from the supergroup into each video group. A video-scene-detection algorithm is thus proposed to merge temporally or spatially correlated video groups into scenario units. This is followed by a scene-clustering algorithm that eliminates visual redundancy among the units. A hierarchical video content structure with increasing granularity is constructed from the clustered scenes, video scenes, and video groups to keyframes. Finally, we introduce a hierarchical video summarization scheme by executing various approaches at different levels of the video content hierarchy to statically or dynamically construct the video summary. Extensive experiments based on real-world videos have been performed to validate the effectiveness of the proposed approach.Published online: 15 September 2004
Corespondence to: Xingquan ZhuThis research has been supported by the NSF under grants 9972883-EIA, 9974255-IIS, 9983248-EIA, and 0209120-IIS, a grant from the state of Indiana 21th Century Fund, and by the U.S. Army Research Laboratory and the U.S. Army Research Office under grant DAAD19-02-1-0178. |
| |
Keywords: | Hierarchical video summarization Video content hierarchy Video group detection Video scene detection Hierarchical clustering |
本文献已被 SpringerLink 等数据库收录! |
|