“多媒体高校信息查询系统”的设计和实现

“高校多媒体信息查询系统”是高等学校信息系统建设的重要内容。本文探讨了高校多媒体信息查询系统的基本信息结构,分析多媒体应用系统的开发环境,结合“南京气象学院多媒体信息查询系统”的研制,提出了采用先进的网络多媒体技术开发多媒体信息查询系统的技术方案,并开发出相应软件     

一种分布式多媒体数据仓库模型

多媒体数据采掘是从大型多媒体数据库中提取高层的多媒体信息及知识。介绍一种分布式多媒体数据仓库模型──ＣＭＳ模型的体系结构及存储结构,并构造了具有综合处理各种媒体数据,能够对这些媒体数据进行修改、查询的军用多媒体数据仓库原型系统。     

多媒体GIS词典的设计与开发

本文介绍了如何利用Ｖｉｓｕａｌ Ｂａｓｉｃ５．０开发多媒体的ＧＩＳ词典，尤其是实现了词库的快速查询、多媒体信息的管理与访问 。     

商业导购多媒体信息系统的设计与实现

本文以研制一个商业导购多媒体信息系统为例，讨论了基于FoxPro for Windows系统开发多媒体信息系统的技术和方法。内容包括：结合地理信息平台（MapInfo）的地图查询，通用逐级过滤查询，文本显示处理，MPEG、MI－DI、Sound等多媒体信息处理技术。     

基于内容的多媒体数据递进目标搜索

为了有效提高移动终端多媒体信息的能力,讨论了一种新的多媒体信息查询方法——基于内容的递进目标搜索,提出了“查询流”的技术,通过多媒体查询方法（MQF）与XML片断请求单元及片断更新单元的结合,使得用户对多媒体信息的查询逐步进行,先查询相关的元数据描述,然后查询最终结果。这样有效降低了查询的数据通信量,非常适合于配置较低、信道有限的移动终端实现多媒体信息的查询。     

Active X控件在AUTHORWARE中的应用

ＡｃｔｉｖｅＸ是Ｍｉｃｒｏｓｏｆｔ公司提供给软件编程人员的开发工具,它能够将计算机桌面系统与Ｉｎｔｅｒｎｅｔ及其大量资源的环境集成起来,同时又保护在Ｗｉｎｄｏｗｓ技术中现有的开发资源。ＡｃｔｉｖｅＸ以往只有高级程序语言才能够使用。目前多媒体著作系统最新的版本ＡＵＴＨＯＲＷＡＲＥ５．０也已支持任何ＡｃｔｉｖｅＸ控件的应用。１应用ＡｃｔｉｖｅＸ控件实现Ｆｌａｓｈ４动画的播放随着互联网上新技术的发展,使得在窄带网的基础上传输多媒体信息的质量有了较大改善。其中Ｍａｃｒｏｍｅｄｉａ公司的Ｓｈｏｃｋｗａｖｅ…     

多媒体查询语言及其评价准则

随着多媒体技术和多媒体相关应用的发展,对有效检索多媒体信息的要求越来越迫切.查询语言作为信息检索的有效工具,其研究也越来越受到关注.对现有的多媒体查询语言进行了全面的综述,将它们分为两类:专用语言和通用语言.尽管查询语言对多媒体信息系统提供有效的查询服务至关重要,但目前仍没有较好的多媒体查询语言评价准则.因此,针对多媒体查询语言的查询表达能力设计准则共16条,并根据这些准则对多媒体查询语言进行了评价.评价结果表明,这些语言能满足用户的基本查询要求,但在高级语义查询和不确定查询等方面还有欠缺.最后展望了多媒体查询语言的未来研究方向.     

企业多媒体信息系统的设计与实现

本文以研制一个企业多媒体信息系统为例，讨论了基于FoxProfor Windows系统开发多媒体信息系统的一般方法。内容包括：与地图相结合的直观查询、企业在地图上的定位和动态标注、多媒体的显示与录入以及企业空间定位数据的可视化录入等技术。     

基于面向对象技术的多媒体开发工具YH－MMDT

ＹＨ－ＭＭＤＴ（ＭｕｌｔｉＭｅｄｉａＤｅｖｅｌｏｐｍｅｎｔＴｏｏｌｋｉｔ）是针对多媒体作品的特点，并基于面向对象技术而设计的一个多媒体开发工具包。我们提出了一个新的多媒体作品管理模型ＷＮＣＨ，该模型以作者／读者辩证统一的观点为基本观点，以结点对象为基本信息单位，以内容对象处理多媒体信息，以热区对象处理超链接功能，进而形成了一组完整的多媒体开发工具。本文首先分析了多媒体作品的特点，然后介绍了ＹＨ－ＭＭＤＴ的体系结构，并详细描述了超媒体作品管理模型ＷＮＣＨ，最后讨论了ＹＨ－ＭＭＤＴ系统的主要管理功能（如创作、阅读、导航等）和技术。     

类汉语组合查询驱动工具的设计与实现

本文讨论面向多媒体数据对象的、可按照类汉语方式进行条件组合的多功能查询模式驱动工具的ＦＩＭＳＦＩＮＤ的用户操作界面的综合设置、主要设计目标、查询模式驱动的基本思想、系统总体的逻辑结构、自学习式查询的优化技术以及编程实现技术等方面的相关问题,ＦＩＭＳＦＩＮＤ已分别由Ｔｕｒｂｏｃ Ｃ和ＶＣ＋＋编程实现,并被成功地应用于数十余个中文信息系统的研制开发之中。     

基于内容的多媒体数据库系统引擎CDB

CDB(Content-based DataBase)是一种基于内容的多媒体数据库引擎，可以嵌入到通用的对象一关系数据库中，使数据库系统综合支持对多媒体数据的常规和基于内容的壹询．本文首先阐述CDB的体系结构，它把信息检索和数据检索结合到数据库中，支持多媒体数据库的基于内容的建立、操纵和维护；然后给出其层次型内容模型，描述多媒体内容的时空结构特征以及信息线索；最后描述用于CDB的基于内容信息检索技术及其设计和实现的用户壹询和操纵接口，包括示例壹询、主观颜色壹询、视频概要和浏览、扩展SQL内容壹询等．     

Extracting semantic knowledge from web context for multimedia IR: a taxonomy,survey and challenges

Since its invention, the Web has evolved into the largest multimedia repository that has ever existed. This evolution is a direct result of the explosion of user-generated content, explained by the wide adoption of social network platforms. The vast amount of multimedia content requires effective management and retrieval techniques. Nevertheless, Web multimedia retrieval is a complex task because users commonly express their information needs in semantic terms, but expect multimedia content in return. This dissociation between semantics and content of multimedia is known as the semantic gap. To solve this, researchers are looking beyond content-based or text-based approaches, integrating novel data sources. New data sources can consist of any type of data extracted from the context of multimedia documents, defined as the data that is not part of the raw content of a multimedia file. The Web is an extraordinary source of context data, which can be found in explicit or implicit relation to multimedia objects, such as surrounding text, tags, hyperlinks, and even in relevance-feedback. Recent advances in Web multimedia retrieval have shown that context data has great potential to bridge the semantic gap. In this article, we present the first comprehensive survey of context-based approaches for multimedia information retrieval on the Web. We introduce a data-driven taxonomy, which we then use in our literature review of the most emblematic and important approaches that use context-based data. In addition, we identify important challenges and opportunities, which had not been previously addressed in this area.

     

MCSOSA: multimedia content share using ontology and secure access agent in mobile cloud

Mobile cloud is not just a traditional cloud, but a concept of virtualization that has expanded into mobile technology. It provides access to the data created and used by a user and content service by cloud platform. A feature of mobile cloud is supported that is the convenience of multimedia content sharing by mobile devices. However, there is a problem of inaccuracy of information retrieval in the process of sharing as well as personal information leakage and service inability status due to the malicious access to the mobile terminal in the retrieval process. This paper suggests the model to which the protective technique of multimedia content retrieval & access in mobile cloud is applied. The model stores and manages the individually different forms of content, and constructs the multimedia ontology in order to enhance the reliability in mismatched problems occurring in the retrieval process, and also suggests the response technique to security vulnerability occurring in the content access.     

Exploring context and content links in social media: a latent space method

Social media networks contain both content and context-specific information. Most existing methods work with either of the two for the purpose of multimedia mining and retrieval. In reality, both content and context information are rich sources of information for mining, and the full power of mining and processing algorithms can be realized only with the use of a combination of the two. This paper proposes a new algorithm which mines both context and content links in social media networks to discover the underlying latent semantic space. This mapping of the multimedia objects into latent feature vectors enables the use of any off-the-shelf multimedia retrieval algorithms. Compared to the state-of-the-art latent methods in multimedia analysis, this algorithm effectively solves the problem of sparse context links by mining the geometric structure underlying the content links between multimedia objects. Specifically for multimedia annotation, we show that an effective algorithm can be developed to directly construct annotation models by simultaneously leveraging both context and content information based on latent structure between correlated semantic concepts. We conduct experiments on the Flickr data set, which contains user tags linked with images. We illustrate the advantages of our approach over the state-of-the-art multimedia retrieval techniques.     

A multimedia retrieval framework based on semi-supervised ranking and relevance feedback

We present a new framework for multimedia content analysis and retrieval which consists of two independent algorithms. First, we propose a new semi-supervised algorithm called ranking with Local Regression and Global Alignment (LRGA) to learn a robust Laplacian matrix for data ranking. In LRGA, for each data point, a local linear regression model is used to predict the ranking scores of its neighboring points. A unified objective function is then proposed to globally align the local models from all the data points so that an optimal ranking score can be assigned to each data point. Second, we propose a semi-supervised long-term Relevance Feedback (RF) algorithm to refine the multimedia data representation. The proposed long-term RF algorithm utilizes both the multimedia data distribution in multimedia feature space and the history RF information provided by users. A trace ratio optimization problem is then formulated and solved by an efficient algorithm. The algorithms have been applied to several content-based multimedia retrieval applications, including cross-media retrieval, image retrieval, and 3D motion/pose data retrieval. Comprehensive experiments on four data sets have demonstrated its advantages in precision, robustness, scalability, and computational efficiency.     

XML Schema制导的多媒体检索系统设计与实现

针对基于内容的检索技术在高层语义检索方面的不足,论文提出了一种通过XML大纲(schema)制导进行多媒体标注和检索的方法,即首先以schema来定义多媒体数据的结构,然后以schema制导的方法对多媒体内容进行标注和检索,并尝试采用基于SMIL的技术来实现检索结果的超媒体合成。为实现通用性,提出了schema制导树生成的一般算法,以及检索条件到XQuery查询语句的转换方法,最后描述了一个该方法的具体实现——Schema制导的多媒体标注和检索系统SDMMRS。     

Multimedia displays for conceptual discovery: information seeking with strand maps

This article explores the use of a multimedia search interface for digital libraries based on strand maps developed by the American Association for the Advancement of Science. As semantic-spatial displays, strand maps provide a visual organization of relevant conceptual information that may promote the use of science content during digital library use. A study was conducted to compare users' cognitive processes during information seeking tasks when using a multimedia strand maps interface, versus the textual search interface currently implemented in the Digital Library for Earth System Education. Quantitative and qualitative data from think-aloud protocols revealed that students were more likely to engage with science content (e.g., analyzing the relevance of science concepts with regard to task needs) during search when using the strand maps interface compared to those using textual searching. In contrast, students using a textual search interface engaged more frequently with surface-level information (e.g., the type of a resource regardless of its science content) during search and retrieval. As a multimedia search interface for digital libraries, strand maps appear to be promising tools to promote conceptual discovery and learning through content-based processes that promote learner engagement with relevant science knowledge.     

Intelligent multimedia data: data + indices + inference

In this paper, we present a novel approach for multimedia data indexing and retrieval that is machine independent and highly flexible for sharing multimedia data across applications. Traditional multimedia data indexing and retrieval problems have been attacked using the central data server as the main focus, and most of the indexing and query-processing for retrieval are highly application dependent. This precludes the use of created indices and query processing mechanisms for multimedia data which, in general, have a wide variety of uses across applications. The approach proposed in this paper addresses three issues: 1. multimedia data indexing; 2. inference or query processing; and 3. combining indices and inference or query mechanism with the data to facilitate machine independence in retrieval and query processing. We emphasize the third issue, as typically multimedia data are huge in size and requires intra-data indexing. We describe how the proposed approach addresses various problems faced by the application developers in indexing and retrieval of multimedia data. Finally, we present two applications developed based on the proposed approach: video indexing; and video content authorization for presentation.     

Heterogeneous SoC-based acceleration of MPEG-7 compliance image retrieval process

With the growing amount of multimedial content over the internet and broadcast systems, mechanisms for efficient information organization, manipulation and transmission are becoming indispensable. Optimization of the multimedia search and retrieval processes is nowadays an important area of development due to the difficulty to browse, filter and manage that big amount of data. The adoption of the MPEG-7 standard has a significant importance to simplify the image retrieval process. However, performance issues are still relevant when the retrieval must be accomplished in real time. This work presents an innovative and efficient approach of a Content-Based Retrieval Process using metric spaces implemented in heterogeneous resources according to the demand of computational power. Several implementations were made and comparative results are shown evidencing the benefits of the proposed approach.     

基于多模态信息挖掘融合的视频检索技术

基于内容的多媒体检索特别是视频检索,由于多媒体数据本身具有复杂的语义,所以极大地提高了检索的难度.算法着眼于视频本身挖掘出充分的资源信息并且将这些信息加以融合来提高视频检索的性能.基于这种思想,提出一种多模态视频检索模型以及相应的手动式搜索和交互式搜索的算法方案.搜索策略在TRECVID视频检索比赛中取得了不错的成绩.