Multi-Scale Spoken Document Retrieval for Cantonese Broadcast News

This paper presents the application of a multi-scale paradigm to Chinese spoken document retrieval (SDR) for improving retrieval performance. Multi-scale refers to the use of both words and subwords for retrieval. Words are basic units in a language that carry lexical meaning, and subword units (such as phonemes, syllables or characters) are building components for words. Retrieval using subword indexing units is better than retrieval using words because of the robustness of subword units to out-of-vocabulary (OOV) words during speech recognition and ambiguities in word segmentation. Experimental results have demonstrated that subword bigrams can bring improvement in retrieval performance over words (～9.56%). Application of multi-scale fusion to SDR aims at combining the lexical information of words and the robustness of subwords. This work presents the first detailed investigation for a Cantonese broadcast news retrieval task using two different multi-scale fusion approaches: pre-retrieval fusion and post-retrieval fusion. Multi-scale retrieval using both words and syllable bigrams achieves improvement in retrieval performance (～1.90%) over retrieval on the composite scales.     

电视台新闻制作直播网络系统的设计

随着我国电视台新闻制播网络化的大力发展,很多省份的电视台都对新闻制作网络系统进行了设计。主要对我国电视台新闻制播网络系统设计进行了具体分析,并对新闻直播指挥系统技术需求进行了总结,提出一种融合各种技术手段的新闻直播指挥系统方案。     

The ISL View4You Broadcast News Transcription System

In this paper, we introduce the Interactive Systems Laboratories multimedia data indexing and retrieval system 'View4You'. The main components of the system, namely the segmenter, the speech recognizer and the information retrieval engine, are described in detail. In the View4You system, public television newscasts are recorded on a daily basis. The newscasts are automatically segmented and an index is created for each of the segments by means of automatic speech recognition. The user can query the system in natural language. The system returns a list of segments which is sorted by relevance with respect to the user query. By selecting a segment, the user can watch the corresponding part of the news show on his or her computer screen. Several end to end evaluations on real world data, using questions from naive users, are described. By substituting each of the components of the system with a perfect (manually simulated) one, the effect of the components' imperfection on the end to end result can be determined. We show that the information retrieval component has the largest impact on the system performance, followed by the segmentation. The quality of the speech recognizer, as long as its error rate is below approximately 25%, is shown to have only a relatively small importance.     

面向Web的新闻视频检索系统

本文针对人们通过网络点播新闻的需求,开发了面向Web的新闻视频检索系统NeWeb.该系统由Web服务系统及查询系统组成,前者与客户端交互,将客户端的检索需求传递给查询系统,并将结果以适当的形式返回给用户;后者负责组织新闻视频的内容并执行查询任务.NeWeb集成了基于内容的视频检索技术及Web技术,提高了检索效率,扩展了应用范围.     

NewsVideoCAR:一个基于内容的视频新闻节目浏览检索系统

介绍了ＮｅｗｓＶｉｄｅｏＣＡＲ系统的构成,核心技术的基本思想和浏览界面的设计要点．     

新闻视频显著人脸检索系统

该文针对新闻视频设计并实现了一个显著人脸检索系统。首先将新闻视频分割成镜头序列,利用训练好的CascadeAdaboost人脸检测器对每个镜头检测出一定数目的候选人脸,按照一些规则选取可信度高的作为样本,用于提取该镜头内的肤色模型。接着对肤色分割后的区域进行位置、大小分析和模板匹配,以淘汰非人脸区域,确定待跟踪的对象列表。为了做精确的跟踪和识别,系统对每个跟踪对象建立更细致的肤色模型。跟踪过程中每间隔一定帧数重新进行人脸检测,以减少误差积累和探测是否有新人脸出现。最后从每个人脸序列挑选最适合进行人脸识别的图像建立其特征脸空间,结合肤色信息和PCA算法判断其是否为要检索的目标人脸。     

Personalcasting: Tailored Broadcast News

Broadcast news sources and newspapers provide society with the vast majority of real-time information. Unfortunately, cost efficiencies and real-time pressures demand that producers, editors, and writers select and organize content for stereotypical audiences. In this article we illustrate how content understanding, user modeling, and tailored presentation generation promise personalcasts on demand. Specifically, we report on the design and implementation of a personalized version of a broadcast news understanding system, MITRE’s Broadcast News Navigator (BNN), that tracks and infers user content interests and media preferences. We report on the incorporation of Local Context Analysis to both expand the user’s original query to the most related terms in the corpus, as well as to allow the user to provide interactive feedback to enhance the relevance of selected newsstories. We describe an empirical study of the search for stories on ten topics from a video corpus. By personalizing both the selection of stories and the form in which they are delivered, we provide users with tailored broadcast news. This individual news personalization provides more fine-grained content tailoring than current personalized television program level recommenders and does not rely on externally provided program metadata.     

Can High-Level Concepts Fill the Semantic Gap in Video Retrieval? A Case Study With Broadcast News

A number of researchers have been building high-level semantic concept detectors such as outdoors, face, building, to help with semantic video retrieval. Our goal is to examine how many concepts would be needed, and how they should be selected and used. Simulating performance of video retrieval under different assumptions of concept detection accuracy, we find that good retrieval can be achieved even when detection accuracy is low, if sufficiently many concepts are combined. We also derive suggestions regarding the types of concepts that would be most helpful for a large concept lexicon. Since our user study finds that people cannot predict which concepts will help their query, we also suggest ways to find the best concepts to use. Ultimately, this paper concludes that "concept-based" video retrieval with fewer than 5000 concepts, detected with a minimal accuracy of 10% mean average precision is likely to provide high accuracy results in broadcast news retrieval.     

一个基于内容的数字新闻检索系统的设计与实现

论述了一种在基于内容的多媒体管理技术基础上的数字新闻管理和检索系统的设计和实现,其特点是通过多媒体信号分析提取图像,视频中的视觉特征、如颜色、纹理、形状等,再结合现有的文字信息,进而达到对相关媒体有效的管理和检索。     

Person Browser System Based on Named Entity Recognition for Broadcast News Interview Videos

This work introduces a novel approach to extract meaningful content information from video by collaborative integration of image understanding and natural language processing. We developed a person browser system that associates faces and overlaid name texts in videos. This approach takes news videos as a knowledge source, then automatically extracts face and assoicated name text as content information. The proposed framework consists of the text detection module, the face detection module, and the person indexing database module. The successful results of person extraction reveal that the proposed methodology of integrated use of image understanding techniques and natural language processing technique is headed in the right direction to achieve our goal of accessing real content of multimedia information.

     

网络广告播放系统的设计

随着当前互联网络信息传播情况的发展，以互联网为传播媒介的网络广告影响迅速扩大，本文针对当前网络广告播放系统的特点和构成进行了详细的分析，指出了当前网络广告播放系统所存在的问题，并给出了一种新型的网络广告播放系统模型的实现技术。     

网络广告播放系统的设计

随着当前互联网络信息传播情况的发展,以互联网为传播媒介的网络广告影响迅速扩大,本文针对当前网络广告播放系统的特点和构成进行了详细的分析,指出了当前网络广告播放系统所存在的问题,并给出了一种新型的网络广告播放系统模型的实现技术。     

盲汉转换系统的研究与实现

介绍了中文现行盲文和汉字相互转换中自然语言处理技术的研究与应用。在双拼盲文和汉字转换模型”研究的基础上,利用包含多知识的语言模型成功地实现了歧义程度更高的现行盲文和汉字的高精度转换。     

基于语义的新闻视频检索研究

通过研究基于注释的视频检索和和基于内容的视频检索的优缺点以及认知学关于人对视频相似性的理解特征,对新一代基于语义的视频检索进行了探索。以视频数据的一个大类——新闻视频为研究对象,采用层次处理思想和综合利用新闻视频各组成媒质的内容特征及其所表达的丰富语义,设计实现了一个基于语义的新闻视频检索原型系统。实验表明该系统自动化程度高、语义客观、检索灵活。     

基于领域本体的新闻视频检索

新闻视频作为视频数据中有代表性的一种媒体,受到人们的广泛关注,对新闻视频的检索要求也越来越高.传统的新闻视频检索大多是非语义层面的,采用的是基于关键词的检索方法，难于获得令人满意的查准率和查全率．本文提出一种基于领域本体的新闻视频检索框架，定义了新闻视频检索中的新闻视频对象，使用语义表达能力强的领域本体来指导视频语义对象的标注，并针对“一词多义”问题提出了“概念域-概念”两阶段概念消歧算法；针对自然语言检索问题，使用领域本体进行查询优化和查询扩展，并提出了查询语句自动生成方法．实验表明，基于领域本体的新闻视频检索方法可以有效的提高检索性能．     

Design and Performance Evaluation of Broadcast Algorithms for Time-Constrained Data Retrieval

We refer "time-constrained services" to those requests that have to be replied to within a certain client-expected time duration. If the answer cannot reach the client within this expected time, the value of the information may seriously degrade or even become useless. On-demand channels may not be able to handle all time-constrained services without degrading the performance. How to handle these services in broadcast channels becomes crucial to balance the load of wireless systems. In this paper, we study this problem and find the minimum number of broadcast channels required for such a task. Also, we propose solutions for this problem when the available channels are insufficient. Our performance result reveals that only a moderate number of channels is required to promote these time-constrained services     

中文普通话电话语音数据库的研制

叙述了“中文普通话电话语音数据库”的开发背景和设计，着重介绍了语音数据库的内容、结构和特点。