音频信息检索综述

随着多媒体和Internet技术的广泛应用和深入普及，多媒体数据的数量正在飞速增长，音频数据作为多媒体数据的重要组成部分，其信息量也在不断膨胀。如何有效的对音频信息进行检索成为现代信息检索的一个重要的研究领域。然而，音频数据同传统的文本数据不同，文本检索中的相关技术不能简单地应用到音频信息检索中，因为后者往往是基于语义的，所以不可避免地要用到音频数据的特征提取和模式匹配等技术。本文将对音频数据检索相关技术和系统做一综述性的介绍。     

面向用户的多媒体检索中的多模态界面框架设计

本文提出并设计了一种面向用户的多媒体信息检索中的多模态界面框架。该框架将知识指导、语义概念学习、自然语言处理及用户特性分析等技术于一体，从而为设计通用多媒体信息检索系统奠定了基础。     

多媒体信息查询和检索系统MIRc

多媒体信息的内容管理是信息化社会的重要基础技术之一,多媒体信息查询和检索系统ＭＩＲｃ是我们设计和实现的一种原型系统。本文首先介绍ＭＩＲｃ系统的体系结构,它能够有效地支持多媒体信息库的建立、操纵和维护;阐述能够描述多媒体内容和时空结构特征,以及信息线索的数据模型;最后介绍用于ＭＩＲｃ的基于内容检索技术及其设计和实现的用户查询接口。     

Information retrieval and hypertext: competing technologies or complementary access methods

Abstract. Information retrieval typically involves accessing textual information from a database in response to a user's vague information need. Hypertext or hypermedia, on the other hand, involves a user browsing through a database of textual or multimedia information in response to a variety of types of information need. Thus information retrieval can be said to have a searching metaphor while hypertext has a browsing analogy. Initially, these two technologies for information access appear to be very different, almost competitive in nature. In this paper information retrieval systems are briefly reviewed and hypertext systems are also examined. These two techniques for accessing information have been integrated into a prototype system which is described. The system dynamically generates guided tours in response to a user's query and the tour guides the user through the hypertext. Some experiments reporting on the effectiveness of this as an information access strategy are given.     

多媒体查询语言及其评价准则

随着多媒体技术和多媒体相关应用的发展,对有效检索多媒体信息的要求越来越迫切.查询语言作为信息检索的有效工具,其研究也越来越受到关注.对现有的多媒体查询语言进行了全面的综述,将它们分为两类:专用语言和通用语言.尽管查询语言对多媒体信息系统提供有效的查询服务至关重要,但目前仍没有较好的多媒体查询语言评价准则.因此,针对多媒体查询语言的查询表达能力设计准则共16条,并根据这些准则对多媒体查询语言进行了评价.评价结果表明,这些语言能满足用户的基本查询要求,但在高级语义查询和不确定查询等方面还有欠缺.最后展望了多媒体查询语言的未来研究方向.     

多媒体救援通信系统应用管理软件设计

针对现有矿山救援软件存在信息量有限、存储数据分散、功能单一等问题,提出了一种与多媒体救援通信系统的前端设备相配合、可及时处理并存储救援信息的多媒体救援通信系统应用管理软件的设计方案;分析了该软件的设计要求,详细介绍了该软件功能模块的设计,并给出了该软件所采用的多媒体信息融合及检索技术的实现原理。实际应用表明,该软件具有视频显示及存储、多方通话、环境参数显示及报警等功能,满足了救援工作对信息多样化及救援资料共享的需求。     

多媒体信息检索研究与展望

对近几年在多媒体信息检索领域的研究成果进行分析,总结了多媒体信息检索的研究现状,指出了该研究领域的发展方向,最后提出了多媒体信息检索技术研究面临的挑战.     

CORE: a content-based retrieval engine for multimedia information systems

Rapid advances in multimedia technology necessitate the development of a generic multimedia information system with a powerful retrieval engine for prototyping multimedia applications. We develop a content-based retrieval engine (CORE) that makes use of novel indexing techniques for multimedia object retrieval. We formalize the concepts related to multimedia information systems such as multimedia objects and content-based retrieval. We bring out the requirements and challenges of a multimedia information system. The architecture of CORE is described in detail along with the associated retrieval mechanisms and indexing techniques. Various modules developed for efficient retrieval are presented with some APIs. The efficacy of CORE is demonstrated in the development of two multimedia systems, a computer-aided facial image inference and retrieval (CAFIIR) system and a system for trademark archival and retrieval (STAR), which have been developed at the Institute of Systems Science (ISS). We expect that CORE will be useful for effective prototyping of other such multimedia applications.Mainly supported by National Science & Technology Board of SingaporePartly working in Real World Computing Partnership, Novel Function Institute of Systems Science Laboratory since April 1994.     

基于本体的智能信息检索系统

近年来,基于本体的智能信息检索系统已成为智能信息检索系统领域最为活跃的研究方向之一.如何利用本体进一步提高其检索性能和智能性,成为基于本体的智能信息检索系统的主要研究目标.从面向过程的角度,对近几年基于本体的智能信息检索系统的研究进展进行了综述,对其框架、所需本体知识的获取和使用、关键技术、性能评测等进行了前沿概括、比较和分析.最后,对基于本体的智能信息检索系统有待深入研究的难点和热点进行了展望.     

An Experimental Ontology Server for an Information Grid Environment

Semantic web and grid technologies offer a promising approach to facilitate semantic information retrieval based on heterogeneous document repositories. In this paper the authors describe the design and implementation of an Ontology Server (OS) component to be used in a distributed contents management grid system. Such a system could be used to build collection document repositories, mutually interoperable at the semantic level. From the contents point of view, the distributed system is built as a collection of multimedia documents repository nodes glued together by an OS. A set of methodologies and tools to organize the knowledge space around the notion of contents community is developed, where each content provider will publish a set of ontologies to collect metadata information organized and published through a knowledge community, built on top of the OS. These methodologies were deployed while setting up a prototype to connect about 20 museums in the city of Naples (Italy).     

A generic, object-oriented case-knowledge representation scheme, and its integration into a wider information management scenario

Abstract: A knowledge base management system (KBMS) realises a combination of techniques found in database management systems and knowledge-based systems. At the data model and knowledge representation level, many systems of this kind constitute a marriage of the relational data model and the rule-based reasoning. Experience has shown that either approach is restricted in the way it can express the demanding information and knowledge structures required for applications like decision support systems. Two new technologies offer an exciting new integrated approach to knowledge management. Object-oriented database management systems (OODBMS) provide an object model that supports powerful abstraction mechanisms to facilitate the modelling of highly structured information. Whereas case-based reasoning (CBR) systems are knowledge bases which organise their capabilities around a memory of past cases and the notion of similarity. Both types of system are built upon two fundamental concepts: 1) the retrieval of entities with potentially complex structure, called objects in the former, and cases in the latter type of system; 2) the organisation of those entities in collections with common characteristics. In an OODBMS such collections are termed extents, and in CBR they are usually called categories. In either system, the conceptual meta notion to represent both, objects as well as extents, and cases as well as categories, is the class.
Revolving around a Conceptual Case Class and extending a standard object model, this paper proposes a novel and general approach to represent case-knowledge and to build KBMSs. The work presented here is a spin-off of the design of an object query language within the ESPRIT project Lynx.     

Synchronization-Oriented Placement and Retrieval Strategies for Delay-Sensitive Media Streams

Multimedia data include text,image,audio and video,etc.Recent developments and advances in the areas of mass storage technology and high speed networks make it feasible for multimedia computing systems to offer services such as multimedia e-mial,teleconferencing and various vivid games.The storage and retrieval of multimedia data are two of the most important technologies in the futre multimedia systems.This paper analyzes the synchronization requirements of the delay-sensitive media streams,classifies the synchronization hierarchically and proposes several effective strategies for the intra-media and inter-media data placement problems.     

Fuzzy reasoning framework to improve semantic video interpretation

A video retrieval system user hopes to find relevant information when the proposed queries are ambiguous. The retrieval process based on detecting concepts remains ineffective in such a situation. Potential relationships between concepts have been shown as a valuable knowledge resource that can enhance the retrieval effectiveness, even for ambiguous queries. Recent researches in multimedia retrieval have focused on ontology modeling as a common framework to manage knowledge. Handling these ontologies has to cope with issues related to generic knowledge management and processing scalability. Considering these issues, we suggest a context-based fuzzy ontology framework for video content analysis and indexing. In this paper, we focused on the way in which we modeled our fuzzy ontology: First, we populate automatically the generated ontology by gathering various available video annotation datasets. Then, the ontology content was used to infer enhanced video semantic interpretation. Finally, considering user feedback, the content of the ontology was improved. Experimental results showed that our approach achieves the goal of scalability while at the same time allowing better video content semantic interpretation.     

支持基于内容检索的多媒体特征模型

信息系统的多媒体化给检索带来了新的挑战。本文从分析基于内容的多媒体信息检索的特点出发,研究并提出了一个多媒体信息特征模型。最后,结合基于特征模型的多媒体信息检索系统总体框架,讨论特征获取、特征管理以及特征学习等相关问题。     

Content-based retrieval in digital libraries

With the recent developments in multimedia and telecommunication technologies, content-based information is becoming increasingly important for various areas such as digital libraries, interactive video and multimedia publishing. Multimedia data refers to simple structured data (such as numbers and short strings), large unstructured data (such as text documents, images, audio and video data) and complex structured data (such as maps, graphs, charts and tables). In this article, we briefly address content-based retrieval and the issues of representation, storage and retrieval of multimedia objects in digital libraries. We then very briefly identify some open areas of research     

基于Oracle Text电子政务全文检索技术的应用

全文检索技术是智能信息管理的关键技术之一,Oracle Text作为Oracle的一个组件,提供了强大的全文检索功能,用Oracle做后台数据库,就可以充分利用其全文检索技术,构建复杂的大型文档管理系统。本文主要介绍了Oracle Text的体系结构及其在电子政务系统中的应用与实现,讨论了采用Oracle Text为组件进行电子政务全文检索应用系统的设计思想,并着重讨论了Oracle Text体系架构,在Oracle Text上如何实现全文检索做了某些研究,结合电子政务典型业务流程实例进行了具体实践的描述,对以后电子政务全文检索开发设计有一定的现实意义。