MING-I: a distributed interactive multimedia document development mechanism

The next generation of interactive multimedia documents can contain both static media, e.g., text, graph, image, and continuous media, e.g., audio and video, and can provide user interactions in distributed environments. However, the temporal information of multimedia documents cannot be described using traditional document structures, e.g., Open Document Architecture (ODA) and Standard Generalized Mark-up Language (SGML); the continuous transmission of media units also raises some new synchronization problems, which have not been met before, for processing user interactions. Thus, developing a distributed interactive multimedia document system should resolve the issues of document model, presentation control architecture, and control scheme. In this paper, we (i) propose a new multimedia document model that contains the logical structure, the layout structure, and the temporal structure to formally describe multimedia documents, and (ii) point out main interaction-based synchronization problems, and propose a control architecture and a token-based control scheme to solve these interaction-based synchronization problems. Based on the proposed document model, control architecture, and control scheme, a distributed interactive multimedia document development mechanism, which is called MING-I, is developed on SUN workstations.     

ZYX-a multimedia document model for reuse and adaptationof multimedia content

Advanced multimedia applications require adequate support for the modeling of multimedia content by multimedia document models. More and more this support calls for not only the adequate modeling of the temporal and spatial course of a multimedia presentation and its interactions, but also for the partial reuse of multimedia documents and adaptation to a given user context. However, our thorough investigation of existing standards for multimedia document models such as HTML, MHEG, SMIL, and HyTime leads to us the conclusion that these standard models do not provide sufficient modeling support for reuse and adaptation. Therefore, we propose a new approach for the modeling of adaptable and reusable multimedia content, the Z_YX model. The model offers primitives that provide-beyond the more or less common primitives for temporal, spatial, and interaction modeling-a variform support for reuse of structure and layout of document fragments and for the adaptation of the content and its presentation to the user context. We present the model in detail and illustrate the application and effectiveness of these concepts by samples taken from our Cardio-OP application in the domain of cardiac surgery. With the Z_YX model, we developed a comprehensive means for advanced multimedia content creation: support for template-driven authoring of multimedia content and support for flexible, dynamic composition of multimedia documents customized to the user's local context and needs. The approach significantly impacts and supports the authoring process in terms of methodology and economic aspects     

A Scalable Toolkit for Designing Multimedia Authoring Environments

This paper introduces Kaomi, a scalable toolkit for designing authoring environments of multimedia documents. The underlying concept is to provide the designer of multimedia applications with a fast method to get an authoring system based on a set of synchronized views (the presentation view for displaying the document, the scenario view for showing the temporal organization of the document, ...) so that each view is the support of editing actions. Kaomi is flexible enough to support a variety of multimedia documents declarative formats. It is indeed a scalable toolkit since it provides facilities for extending and/or for modifying the resulting authoring environment. In addition, cross-platform portability is provided which allows operation in the heterogenous Internet environment. The use of Kaomi is mainly described through the design of two authoring environments: one for authoring a sub-set of the Smil standard of the W3C and the other one for Madeus, a constraint based multimedia language.     

一种类ODA的多媒体文档结构模型

ＩＳＯ的办公文档结构ＯＤＡ较好地解决了传统的文档结构定义问题，但是多媒体文档还必须增加一项新需求。文中给出一种描述多媒体文档结构的类ＯＤＡ模型，并着理讨论逻辑结构和样式结构的表示方法。     

协同多媒体菱工具中演示文档的同步模型

多媒体演示文档的协同菱对文档本身的结构与同步模型提出了一定的要求。为了便于面向对象的实现以及灵活多粒度的共享，提出了一个协同多媒体著作工具中分布交互式多媒体文档的同步模型。在此模型中，文档结构分为三层：页面层、对象组层及单媒体对象层，根据各层的特点，其同步分别采用基于跳转、基于事件及基于时间的策略。     

多媒体对象的组织与结构化检索

多媒体的结构化检索具有广泛的应用前景，但多媒体的检索技术尚不成熟。多媒体数据模型的复杂性，连续媒体基于内容检索的低效，以及缺乏适用的查询语言，都使得多媒体检索困难重重。英国肯特大学新近研制的多媒体检索系统在多媒体检索的相关领域取得了一定的突破。这个系统把用户视图中的多媒体对象组织成具有层次结构的虚拟数据库，使用属性来标识数据库中多媒体对象索引的特征；查询代理机允许用户直观地构造查询过程－包括一个结     

An ODA-like Multimedia Document System

A multimedia document is composed of different media objects. ISO's Open Document Architecture (ODA) proposes a standard multimedia document model. However, the current ODA profile only includes static media, e.g. text, geometric graphics and images. Because the future multimedia documents not only include static media but also continuous media, e.g. video and audio, continuous media document parts should be added to have a complete multimedia document model. In this paper, we propose a multimedia document model, which is derived from ODA's concept. The proposed model is based on the object-oriented approach. Objects in the proposed document model are divided into two types: data objects and pseudo objects. Data objects are data structures of a document; pseudo objects are used to manage data objects. Based on the proposed model, a multimedia document authoring and presenting system (MMDS) is also developed on SUN SPARC workstations using the Solaris 2.X operating system     

Authoring of scalable multimedia documents

With the diversity of usage conditions affecting the consumption of multimedia content, the adaptation of dynamic and interactive multimedia presentations is essential. The challenge consists in allowing a multimedia presentation to adapt in all its dimensions: spatially, temporally and interactively, without lessening its attractiveness and still giving the author the control over adapted versions. Additionally, the authoring of adaptable content should not increase the complexity of authoring. To address this challenge, we propose to transpose the concept of scalability to the world of multimedia documents by introducing the so-called Scalable MSTI model. In this paper, we show the properties of this model and how, from an authoring point of view, scalable multimedia documents can be created to address a wide range of usage conditions.     

Semantic processing of multimedia data for e-government applications

Knowledge management has become a challenge for almost all e-government applications where the efficient processing of large amounts of data is still a critical issue. In the last years, semantic techniques have been introduced to improve the full automatic digitalization process of documents, in order to facilitate the access to the information embedded in very large document repositories. In this paper, we present a novel model for multimedia digital documents aiming at improve effectiveness of digitalization activities within an information system supporting e-government organizations. At the best of our knowledge, the proposed model is one of the first attempts to give a single and unified characterization of multimedia documents managed by e-government applications, whereas semantic procedures and multimedia facilities are used for the transformation of unstructured documents into structured information. Furthermore, we define an architecture for the management of multimedia documents “life cycle”, which provides advanced functionalities for information extraction, semantic retrieval, indexing, storage, presentation, together with long-term preservation. Preliminary experiments concerning an e-health scenario are finally presented and discussed.     

Multimedia Document Models: Sealed Fate or Setting Out for New Shores?

Existing multimedia document models like HTML, MHEG, SMIL, and HyTime lack appropriate modeling primitives to fit the needs of next generation multimedia applications which bring up requirements like reusability of multimedia content in different presentations and contexts, and adaptation to user preferences. In this paper, we motivate and present new requirements stemming from advanced multimedia applications and the resulting consequences for multimedia document models. Along these requirements, we discuss the document model standards HTML, HyTime, MHEG, SMIL, and Z_YX, a new model that has been developed with special focus on reusability and adaptation. The analysis and comparison of the models show the limitations of existing models, point the way to the need for new flexible multimedia document models, and throw light on the many implications on authoring systems, multimedia content management, and presentation.     

A model for secure multimedia document database system in a distributed environment

The Internet provides a universal platform for large-scale distribution of information and supports inter-organizational services, system integration, and collaboration. Use of multimedia documents for dissemination and sharing of massive amounts of information is becoming a common practice for Internet-based applications and enterprises. With the rapid proliferation of multimedia data management technologies over the Internet, there is growing concern about security and privacy of information. Composing multimedia documents in a distributed heterogeneous environment involves integrating media objects from multiple security domains that may employ different access control policies for media objects. In this paper, we present a security model for distributed document management system that allows creation, storage, indexing, and presentation of secure multimedia documents. The model is based on a time augmented Petri-net and provides a flexible, multilevel access control mechanism that allows clearance-based access to different levels of information in a document. In addition, the model provides detailed multimedia synchronization requirements including deterministic and non-deterministic temporal relations and incomplete timing information among media objects.     

A Model of Collaborating Agents for Content-Based Electronic Document Filtering

The huge volume of distributed information that is nowadays available in electronic multimedia documents forces a lot of people to consume a significant percentage of their time looking for documents that contain information useful to them. The filtering of electronic documents seems hard to automate, partly because of document heterogeneity, but mainly because it is difficult to train computers to have an understanding of the contents of these documents and make decisions based on user-subjective criteria. In this paper, we suggest a model for the automation of content-based electronic document filtering, supporting multimedia documents in a wide variety of forms. The model is based on multi-agent technology and utilizes an adaptive knowledge base organized as a set of logical rules. Implementations of the model using the client-server architecture should be able to efficiently access documents distributed over an intranet or the Internet.     

Semantic adaptation of multimedia documents

Multimedia documents have to be played on multiple device types. Hence, usage and platform diversity requires document adaptation according to execution contexts, not generally predictable at design time. In an earlier work, a semantic framework for multimedia document adaptation was proposed. In this framework, a multimedia document is interpreted as a set of potential executions corresponding to the author specification. To each target device corresponds a set of possible executions complying with the device constraints. In this context, adapting requires to select an execution that satisfies the target device constraints and which is as close as possible from the initial composition. This theoretical adaptation framework does not specifically consider the main multimedia document dimensions, i.e., temporal, spatial and hypermedia. In this paper, we propose a concrete application of this framework on standard multimedia documents. For that purpose, we first define an abstract structure that captures the spatio-temporal and hypermedia dimensions of multimedia documents, and we develop an adaptation algorithm which transforms in a minimal way such a structure according to device constraints. Then, we show how this can be used for adapting concrete multimedia documents in SMIL through converting the documents in the abstract structure, using the adaptation algorithm, and converting it back in SMIL. This can be used for other document formats without modifying the adaptation algorithm.     

A Multimedia Presentation Toolkit for the World Wide Web

This paper describes the design and implementation of MPRES, a Multimedia Presentation Toolkit for the WWW. The WWW has seen phenomenal growth over the last couple of years. It has become a vast repository of multimedia information that is accessible to virtually anyone having a browser. MPRES is a multimedia presentation system that allows a user to compose and render a presentation consisting of objects referenced by their URLs (Uniform Resource Locators). It uses the concept of dynamic documents to render on a WWW browser, a sequence of multimedia scenarios, having objects of types such as audio, image, plaintext, HTML (Hypertext Markup Language) document and animation. MPRES Author, the authoring subsystem, allows the user to interactively test and compose such a presentation, using the Netscape Navigator to collect multimedia resources from the WWW. A presentation database stores the presentations and provides a convenient frontend for accessing them. © 1997 John Wiley & Sons,Ltd.     

基于数字水印的多媒体公文安全架构

定义了多媒体公文的新概念,在分析传统电子政务安全架构的基础上,提出利用数字水印技术来提高多媒体公文的安全性,并以PDF文档为例介绍了如何利用数字水印技术来维护信息内容的创作权,弥补了电子政务系统对数字作品版权保护的不足,设计了一种新的基于数字水印的多媒体公文安全架构。     

XTemplate 3.0: spatio-temporal semantics and structure reuse for hypermedia compositions

The use of declarative languages in digital TV systems, as well as IPTV systems, facilitates the creation of interactive applications. However, when an application becomes more complex, with many user interactions, for example, the hypermedia document that describes that application becomes bigger, having many lines of XML code. Thus, specification reuse is crucial for an efficient application development process. This paper proposes the XTemplate 3.0 language, which allows the creation of NCL hypermedia composite templates. Templates define generic structures of nodes and links to be added to a document composition, providing spatio-temporal synchronization semantics to it. The use of hypermedia composite templates aims at facilitating the authoring work, allowing the reuse of hypermedia document common specifications. Using composite templates, hypermedia documents become simpler and easier to be created. The 3.0 version of XTemplate adds new facilities to the XTemplate language, such as the possibility of specifying presentation information, the attribution of values to variables and connector parameters during template processing time and the template ability to extend other templates. As an application of XTemplate, this work extends the NCL 3.0 declarative language with XTemplate, adding semantics to NCL contexts and providing document structure reuse. In addition, this paper also presents two authoring tools: the template processor and the wizard to create NCL documents using templates. The wizard tool allows the author to choose a template included in a template base and create an NCL document using that template. The template processor transforms an NCL document using templates into a standard NCL 3.0 document according to digital TV and IPTV standards.     

WWW环境下超媒体协同创作系统的设计

1 引言大型文献的创作是一种涉及到总编、美术、策划以及多个作者之间的协作活动,超媒体技术的出现为大型文献创作者提供了一种新的创作方式,能够很好地支持这种协作活动。常规文献是连续的线性结构,文献在组织结构上没有划分手段,因此协同写作时难以进行分工。超媒体文献的离散化节点和超链组织有利于多人协作时任务的划分,多成员可在分布环境下分担完成文献中的不同部分,通过超链可将各部分链接起来,保持整个文献的完整性。对于读者,超文本技术允许有选择地阅读其中感兴趣的部分,而忽略其他部     

Canonical processes for creating personalized semantically rich multimedia presentations

Authoring of multimedia content can be considered as composing media assets such as images, videos, text, and audio in time, space, and interaction into a coherent multimedia presentation. Personalization of such content means that it reflects the users’ or user groups’ profile information and context information. Enriching the multimedia content with semantically rich metadata allows for a better search and retrieval of the content. To actually create personalized semantically-rich multimedia content, a manual authoring of the many different documents for all the different users’ and user groups’ needs is not feasible. Rather a (semi-)automatic authoring of the content seems reasonable. We have analyzed in detail today’s approaches and systems for authoring, personalizing, and semantically enriching multimedia presentations. Based on this analysis, we derived a general creation chain for the (semi-)automatic generation of such content. In this paper, we introduce this creation chain. We present our software engineering support for the chain, the component framework SemanticMM4U. The canonical processes supported by the creation chain and SemanticMM4U framework are described in detail. We also provide an explicit mapping of SemanticMM4U framework components to the processes and argue for the benefits of defining canonical processes for creating personalized semantically rich multimedia presentations.     

A Multimedia Authoring-in-the-Large Environment to Support Complex Product Documentation

In this paper, we present a new paradigm for multimedia document authoring to support large-scaled industrial technical documentation. An industrial-strength multimedia authoring environment requires a high degree of automation support for producing a large amount of high-quality technical documentation efficiently and effectively, and provides a consistent user interface to facilitate viewing and browsing of large-scaled technical contents. Product documentation includes technical information in all media for all aspects of a product during the life cycle of the product. Product documents are highly cross-referenced and often shared by a family of related product models. Previous authoring paradigms have their limitations in supporting such complex technical documentation required for today's sophisticated products. Our approach is based on an authoring-in-the-large paradigm by adopting formal configuration specifications for automatically assembling machine-specific product manuals from component documents, and formal hyperlink specifications for systematically creating hyperlinks in highly cross-referenced technical documents. Integrated media-specific viewers are provided to support viewing, browsing and navigation of large-scaled hyperlinked multimedia contents in a consistent manner for various product-related applications such as operation, maintenance and training on various platforms such as UNIX, PC/Windows, laptops and hand-held devices locally and over network.     

分布式多媒体数据库系统的分层体系结构

本文研究分布式多媒体数据库系统的分层体系结构，分析了多媒体数据的表现特征，强调分离出独立的多媒体数据表现模式层的必要性，给出了多媒体数据对象的概念描述，提出了在多媒体计算机概念体系结构基础之上的我媒体数据库系统的分层体系结构框架，并进行了分析，最后给出了灵活的目录制导的分布式多媒体数据库系统结构。