基于概念的多媒体数据语义检索模型*

基于概念的检索是多媒体数据语义检索的解决途径之一。对概念进行了语义扩展,提出了基于概念的多媒体数据语义检索模型,包括人机接口、知识获取、数据获取、概念检索以及语义获取等模块,并对各模块所涉及到的问题进行了分析和探讨。     

Security and privacy for multimedia database management systems

This paper describes security and privacy issues for multimedia database management systems. Multimedia data includes text, images, audio and video. It describes access control for multimedia database management systems and describes security policies and security architectures for such systems. Privacy problems that result from multimedia data mining are also discussed.

WESONet: Applying semantic web technologies and collaborative tagging to multimedia web information systems

The publication of different media types, like images, audio and video in the World Wide Web is getting more importance each day. However, searching and locating content in multimedia sites is challenging. In this paper, we propose a platform for the development of multimedia web information systems. Our approach is based on the combination between semantic web technologies and collaborative tagging. Producers can add meta-data to multimedia content associating it with different domain-specific ontologies. At the same time, users can tag the content in a collaborative way. The proposed system uses a search engine that combines both kinds of meta-data to locate the desired content. It will also provide browsing capabilities through the ontology concepts and the developed tags.     

A standard reference model for intelligent multimedia presentation systems

This article summarizes the main results of a joint endeavor towards a standard reference model (SRM) for intelligent multimedia presentation systems (IMMPSs). After a brief motivation, we give basic definitions for media terms and presentation systems. The core of this contribution is a generic reference architecture that reflects an implementation-independent view of the processes required for the generation of multimedia presentations. The reference architecture is described in terms of layers, components, and knowledge servers. Our SRM focuses on the functions assigned to the layers and components, rather than on the methods or communication protocols that may be employed to realize this functionality. Finally, we point to some possible extensions of the reference model.     

A computation-oriented multimedia data streams model for content-based information retrieval

Multimedia applications nowadays are becoming prevalent. In the past the relational database model was generalized to the multimedia database model. More recently the relational database model was generalized to the data streams model, as the technology advanced and data became bulky and unbounded in size due to the utilization of sensor networks. In this paper we take one more step of generalization by providing a multimedia data streams model. The objective is to furnish a formal framework to design multimedia data streams (MMDS) schema for efficient content based information retrieval. We also extend the functional dependency theory and the normalization framework to handle multimedia data streams. Finally we present algorithmic methods of generating continuous multimedia queries along with examples for illustration.     

A model for secure multimedia document database system in a distributed environment

The Internet provides a universal platform for large-scale distribution of information and supports inter-organizational services, system integration, and collaboration. Use of multimedia documents for dissemination and sharing of massive amounts of information is becoming a common practice for Internet-based applications and enterprises. With the rapid proliferation of multimedia data management technologies over the Internet, there is growing concern about security and privacy of information. Composing multimedia documents in a distributed heterogeneous environment involves integrating media objects from multiple security domains that may employ different access control policies for media objects. In this paper, we present a security model for distributed document management system that allows creation, storage, indexing, and presentation of secure multimedia documents. The model is based on a time augmented Petri-net and provides a flexible, multilevel access control mechanism that allows clearance-based access to different levels of information in a document. In addition, the model provides detailed multimedia synchronization requirements including deterministic and non-deterministic temporal relations and incomplete timing information among media objects.     

A computational model for developing semantic web-based educational systems

Recently, some initiatives to start the so-called semantic web-based educational systems (SWBES) have emerged in the field of artificial intelligence in education (AIED). The main idea is to incorporate semantic web resources to the design of AIED systems aiming to update their architectures to provide more adaptability, robustness and richer learning environments. However, the construction of such systems is highly complex and faces several challenges in terms of software engineering and artificial intelligence aspects. This paper presents a computational model for developing SWBES focusing on the problem of how to make the development easier and more useful for both developers and authors. In order to illustrate the features of the proposed model, a case study is presented. Furthermore, a discussion about the results regarding the computational model construction is available.     

PressBase : a presentation synchronization database for distributed multimedia systems

Multimedia presentations are the basic objects of multimedia databases. Since a multimedia presentation is not an instant display of a query result, the control knowledge (or synchronization requirements) has to be incorporated into the database and necessary precautions have to be taken for a lengthy presentation. Active databases provide a mechanism for incorporation of control knowledge by using event-condition-action (ECA) rules. In this paper, we describe how multimedia synchronization can be handled within a database using ECA rules. We present a prototype presentation synchronization database, named as PressBase, for distributed multimedia systems. We have adopted one of the synchronization models, SynchRuler, and then incorporated into a relational database system.     

Mutual authentication scheme for multimedia medical information systems

Multimedia Tools and Applications - For Multimedia Medical Information System (MMIS), security and privacy are the significant measures. For the guarantee of MMIS significant measures, several...     

Modeling spatio-temporal constraints for multimedia objects

The presentation of multimedia data is not only characterized by precise temporal constraints; also spatial constraints must be taken into account. An important requirement in multimedia systems is thus the integrated modeling of spatio-temporal constraints. Moreover, it is important to devise methods for checking the consistency of the specified constraints. In this paper, we first propose a spatio-temporal object graph (STOG) model that provides an integrated and graphical representation of spatio-temporal constraints. Second, we investigate consistency conditions between spatial and temporal constraints expressed in the STOG model. Then, we present a prototype system implementing the proposed model.     

Concept-concept association information integration and multi-model collaboration for multimedia semantic concept detection

The recent development of the digital camera technology and the popularity of social network websites such as Facebook and Youtube have created huge amounts of multimedia data. Multimedia information is ubiquitous and essential in many applications. In order to fill the gap between data and application requirements (or the so-called semantic gap), advanced methods and tools are needed to automatically mine and annotate high-level concepts to assist in associating the low-level features to the high-level concepts directly. It has been shown that concept-concept association can be effective in bridging the semantic gap in multimedia data. In this paper, a concept-concept association information integration and multi-model collaboration framework is proposed to enhance high-level semantic concept detection from multimedia data. Several experiments are conducted and the comparison results demonstrate that the proposed framework outperforms those approaches in the comparison in terms of the Mean Average Precision (MAP) values.     

A spatio-temporal geometry-based model for digital documentation of historical living systems

Representations used in digital documentation applications today usually assume a world that only exists in the present. Information contained within a database may be added-to or modified over time, but change through time is seldom maintained. This limitation of current IT has recently received attention, given the increasingly urgent need to understand geographical processes and cause-and-effect inter-relationships between human activities and the environment. Models proposed for the representation of spatio-temporal data are extensions of traditional raster and vector representations that can be seen as location- or feature-based, respectively, and are therefore best organized for performing, either location- or feature-based queries. In this paper, a new spatio-temporal data model suitable for digital documentation of historical living systems (artefacts, monuments and sites) is defined: it is based on 3D geometry and intended to facilitate analysis of temporal relationships and patterns of 3D modeling changes through time. This is particularly useful to both IT and IS managers, researchers and practitioners. It is shown that time-based queries related to 3D models of objects can be processed in an efficient and straightforward manner using the model. Finally, analytical time efficiency estimations are given, showing that the model is also an efficient and compact representation of spatio-temporal information.     

A model for integrating multimedia information around 3D graphics hierarchies

We present a model for organizing multimedia information especially suitable for applications with three-dimensional content. The model relies on the hierarchical nature of 3D objects, which are utilized as centralizing structure to give coherence to the organization and access of all other medium types. Techniques have been developed to facilitate the manipulation of all medium types through a consistent user interace paradigm. The modeling of space and time constraints as applied to the animation of graphical objects and their synchronization with video has also been explored. Two industrial training applications have been developed to demonstrate the usability of the system.     

A semantic model for general purpose content-based image retrieval systems

The ‘semantic gap’ is the main challenge in content-based image retrieval. To overcome this challenge, we propose a semantic-based model to retrieve images efficiently with considering user-interested concepts. In this model, an interactive image segmentation algorithm is carried out on the query image to extract the user-interested regions. To recognize the image objects from regions, a neural network classifier is used in this model. In order to have a general-purpose system, no priori assumptions should be made regarding the nature of images in extracting features. So a large number of features should be extracted from all aspect of the image. The high dimensional feature space, not only increases the complexity and required memory, but also may reduce the efficiency and accuracy. Hence, the ant colony optimization algorithm is employed to eliminate irrelevant and redundant features. To find the most similar images to the query image, the similarity between images is measured based on their semantic objects which are defined according to a predefined ontology.     

Topic correlation model for cross-modal multimedia information retrieval

In this paper, we present a simple and effective topic correlation model (TCM) for cross-modal multimedia retrieval by jointly modeling the text and image components in multimedia documents. In this model, the image component is represented by the bag-of-features model based on local scale-invariant feature transform features, meanwhile the text component is described by a topic distribution learned from a latent topic model. Statistical correlations between these two mid-level features are investigated by mapping them into a semantic space. These cross-modality correlations are used to calculate the conditional probabilities of answers in one modality while given query in the other modality. The model is tested on three cross-modal retrieval benchmark problems including Wikipedia documents in both English and Chinese. Experimental results have demonstrated that the new TCM model achieves the best performance compared to recent state-of-the-art cross-modal retrieval models on the given benchmarks.     

Designing hypermedia information retrieval systems for multimedia art catalogues

Abstract

Multimedia art catalogues present a number of recurring characteristics in both the type of data and the users involved, and in the type of operations required. Typical data include textual catalogue cards manageable through an information retrieval system (IRS), as well as textual captions, images, video, and speech, organizable as a hypermedia network. In this paper we propose a model for the design of these applications, and discuss its effectiveness in improving the quality of the application. The model exploits a multi-level design approach to organize data and access structures of the IRS, while the Entity-Relationship (E-R) approach, tailored to model hypermedia applications, is adopted to describe the structure of the documents and their links.     

A unified multimedia and semantic perspective for data retrieval in the semantic web

In recent years, the emerging diffusion of peer-to-peer networks is going beyond the single-domain paradigm like, for instance, the mono-thematic file sharing one (e.g. Napster for music). Peers are more and more heterogeneous data sources which need to share data with commercial, educational, and/or collaboration purposes, just to mention a few. Moreover, in current information processing applications data cannot be meaningfully searched by precise database queries that would return exact matches (e.g. when dealing with multimedia, proteomic, statistical data).