基于播音员识别的新闻视频故事分割方法

新闻视频的语义单元分割是基于内容的新闻视频检索和情报挖掘的重要步骤,受到众多研究者的关注。提出了一种基于播音员识别的新闻视频故事单分割的新方法,首先从新闻节目中提取各播音员的声学感知特征的作为其声纹,训练出其相应的混合高斯模型(GMM),并采用KL差异法从视频镜头中探测出各播音员和非播音员音频镜头,最后结合视频字幕帧事件和新闻节目特殊的结构知识对新闻节目进行故事单元分割。在2个多小时的CCTV和CNN新闻视频实验中获得96.02%查准率和92.58%的查全率。

Segmentation method of news video stories based on announcer identification

As an important step of content based news video retrieving and information mining，semantic unit segmentation has attracted many researchers’ interests.This paper focuses on a new method of news video stories segmentation which is based on the announcer identification.Firstly，the voiceprints including acoustic perception characteristics of each announcer are extracted，and their Gaussian mixture models are trained，then the audio shots of announcer and not-announcer are detected by the KL divergence method，at last the unit segmenting is carried on under the guidance of video topic caption frames and special structure knowledge of news program.Finally the 92.58% recall and the 96.02% precision are achieved during more than 2 hours’ experiment.