多媒体结构的设计与选择

构造一个上下文敏感,具有可交互性的多媒体表示远比单纯构造视听信息或者单纯构造文本信息复杂得多.多媒体对象之间的交互需要有一个用来同步和异步交互的,包括立即响应的时空关系组织起来.根据构造环境的需要来考虑多媒体的结构构造.先通过介绍影响多媒体结构构造的7个要素来认识多媒体,然后在4种典型的构造模式中进行多媒体环境的选择.这4种构造模式分别是:结构化、时间关系、图关系、脚本形式.通过各种各样的观察和分析发现,结构化的多媒体构造为多媒体的表示提供了最为有效的表示形式.     

A Scalable Toolkit for Designing Multimedia Authoring Environments

This paper introduces Kaomi, a scalable toolkit for designing authoring environments of multimedia documents. The underlying concept is to provide the designer of multimedia applications with a fast method to get an authoring system based on a set of synchronized views (the presentation view for displaying the document, the scenario view for showing the temporal organization of the document, ...) so that each view is the support of editing actions. Kaomi is flexible enough to support a variety of multimedia documents declarative formats. It is indeed a scalable toolkit since it provides facilities for extending and/or for modifying the resulting authoring environment. In addition, cross-platform portability is provided which allows operation in the heterogenous Internet environment. The use of Kaomi is mainly described through the design of two authoring environments: one for authoring a sub-set of the Smil standard of the W3C and the other one for Madeus, a constraint based multimedia language.     

Spatio-temporal composition and indexing for large multimedia applications

Multimedia applications usually involve a large number of multimedia objects (texts, images, sounds, etc.). An important issue in this context is the specification of spatial and temporal relationships among these objects. In this paper we define such a model, based on a set of spatial and temporal relationships between objects participating in multimedia applications. Our work exploits existing approaches for spatial and temporal relationships. We extend these relationships in order to cover the specific requirements of multimedia applications and we integrate the results in a uniform framework for spatio-temporal composition representation. Another issue is the efficient handling of queries related to the spatio-temporal relationships among the objects during the authoring process. Such queries may be very costly and appropriate indexing schemes are needed so as to handle them efficiently. We propose efficient such schemes, based on multidimensional (spatial) data structures, for large multimedia applications that involve thousands of objects. Evaluation models of the proposed schemes are also presented, as well as hints for the selection of the most appropriate one, according to the multimedia author's requirements.     

一个面向对象的交互式创作工具OOIAT的设计与实现

在开放交互式创伤工具过程中,常常会遇到这样的难题：如何表示和建立用户模型及操作的对象,并向用户提供可直接操作的交互方式;如何有效地表示和管理对象之间的关系。,为此,我们设计并实现了一个创伤工具OOIAT,它提供了一个可扩充的,用于表示用户模型并集成了事件模型的对象集,使用户只需定义对象,不必了解对象如何传递
动作,如何实现其功能,就能够处理在这些对象上的交互式直接创伤。     

Constraint Techniques for Authoring Multimedia Documents

Authoring a multimedia document requires to specify both its spatial layout and its temporal organization, i.e. when and where objects such as pictures, texts and videos appear/disappear on /from the screen and when objects such as audios and videos start/end to play. In this paper, we present some benefits authors can gain when using an authoring tool in which constraints are used to specify these two kinds of information. We describe our experience in building Madeus, a constraint-based environment to design multimedia documents and we point out technical problems that still need to be solved to more completely satisfy author requirements.     

An ODA-like Multimedia Document System

A multimedia document is composed of different media objects. ISO's Open Document Architecture (ODA) proposes a standard multimedia document model. However, the current ODA profile only includes static media, e.g. text, geometric graphics and images. Because the future multimedia documents not only include static media but also continuous media, e.g. video and audio, continuous media document parts should be added to have a complete multimedia document model. In this paper, we propose a multimedia document model, which is derived from ODA's concept. The proposed model is based on the object-oriented approach. Objects in the proposed document model are divided into two types: data objects and pseudo objects. Data objects are data structures of a document; pseudo objects are used to manage data objects. Based on the proposed model, a multimedia document authoring and presenting system (MMDS) is also developed on SUN SPARC workstations using the Solaris 2.X operating system     

Interactive Multimedia Documents: A Modeling,Authoring and Rendering Approach

In this paper we present our research and development experience in the context of Interactive Multimedia Documents (IMDs). We define a rich model for such documents covering the issues of interaction and spatiotemporal compositions as means of representing the functionality of an IMD. We exploit the event concept to represent interaction, while complex interactions are covered by a rich algebraic and spatiotemporal event composition scheme. Based on the model we implemented an authoring methodology. Thereafter we present a generic framework for rendering (presenting) IMDs putting emphasis to the handling of interaction and to the temporal synchronization of media objects. The rendering system is implemented as a client-server architecture using Java and accompanying technologies. The implementation is suitable for WWW enabled interactive multimedia documents.     

基于SGI的多媒体创作工具的设计与实现

本文针对SGI图形工作站的特点,论述了基于SGI平台的多媒体创作工具AUTHOR的系统构造及其关键技术的实现。在媒体对象的同步中,采用时间流Petri网（TSPN）模型表示媒体数据流的同步、互斥等关系,用该模型结合“自上而下、逐步求精”的软件设计方法,描述了复杂多媒体表示系统中的媒体表示方案。     

多媒体编著语言的设计与实现

根据基于时序逻辑和XYZ系统思想的多媒体数据描述模型,设计并实现了一种新的多媒体编著语言MAL(multimedia authoring language),该语言具有抽象描述、同步描述、逐步求精设计的描述等能力,将多媒体节目中媒体对象的建模和多媒体节目的设计过程在一个统一的框架内进行描述.以该语言实现为核心，研制了一个交互式可视多媒体编著环境.     

Modelling Reactive Multimedia: Design and Authoring

Multimedia document authoring is a multifaceted activity, and authoring tools tend to concentrate on a restricted set of the activities involved in the creation of a multimedia artifact. In particular, a distinction may be drawn between the design and the implementation of a multimedia artifact.This paper presents a comparison of three different authoring paradigms, based on the common case study of a simple interactive animation. We present details of its implementation using the three different authoring tools, MCF, Fran and SMIL 2.0, and we discuss the conclusions that may be drawn from our comparison of the three approaches.Simon Thompson is grateful to the British Council for its funding of travel in support of the work reported here.Supported by an individual research grant from NSERC. This author’s research was performed, in part, at LIRMM, Montpellier, France.Supported by an individual research grant from NSERC.     

A Multimedia Authoring-in-the-Large Environment to Support Complex Product Documentation

In this paper, we present a new paradigm for multimedia document authoring to support large-scaled industrial technical documentation. An industrial-strength multimedia authoring environment requires a high degree of automation support for producing a large amount of high-quality technical documentation efficiently and effectively, and provides a consistent user interface to facilitate viewing and browsing of large-scaled technical contents. Product documentation includes technical information in all media for all aspects of a product during the life cycle of the product. Product documents are highly cross-referenced and often shared by a family of related product models. Previous authoring paradigms have their limitations in supporting such complex technical documentation required for today's sophisticated products. Our approach is based on an authoring-in-the-large paradigm by adopting formal configuration specifications for automatically assembling machine-specific product manuals from component documents, and formal hyperlink specifications for systematically creating hyperlinks in highly cross-referenced technical documents. Integrated media-specific viewers are provided to support viewing, browsing and navigation of large-scaled hyperlinked multimedia contents in a consistent manner for various product-related applications such as operation, maintenance and training on various platforms such as UNIX, PC/Windows, laptops and hand-held devices locally and over network.     

基于OCPN的SMIL文档创作平台设计与实现

基于SMIL的多媒体文档创作平台是目前的应用研究重点。SMIL Authoring Tool(SAT)创作平台在参考了SMIL2．O定义基础上，以OCPN为多媒体同步时序定义的基本模型，分析了国内外现有的系统优缺点之后，利用面向对象的方法实现。SAT相对于已有的系统而言，它使用树形组织结构和OCPN对节点之间的时序和节点内部的详细同步信息进行设置，二者互相补充，可使用户进行简单的同步时序设置。     

Creating a clickable TV program by sketching and tracking freeform triggers

Viewers watching Interactive TV can click on video objects on the screen, connecting them to an advertisement or more detailed content. But this requires an interactive authoring process to attach triggers to clickable objects, which is time-consuming because these objects can appear intermittently, move, and change shape. We facilitate authoring by combining a sketching interface with shot-based object tracking and trigger verification. Experiments involving professional video authors and non-specialist viewers suggest that this approach is an improvement on previous methods.     

A lightweight framework for authoring XML multimedia content on the web

This paper addresses the issue of authoring XML multimedia content on the web. It focuses on methods that apply to different kinds of contents, including structured documents, factual data, and multimedia objects. It argues in favor of a template-based approach that enhances the ability for multiple applications to use the produced content. This approach is illustrated by AXEL, an innovative multipurpose client-side authoring framework (previously described in Sire et al. (2010)), intended for web users with limited skills. The versatility of the tool is illustrated through a series of use cases that demonstrate the flexibility of the approach for creating various kinds of web content.     

多媒体对象的组织与结构化检索

多媒体的结构化检索具有广泛的应用前景，但多媒体的检索技术尚不成熟。多媒体数据模型的复杂性，连续媒体基于内容检索的低效，以及缺乏适用的查询语言，都使得多媒体检索困难重重。英国肯特大学新近研制的多媒体检索系统在多媒体检索的相关领域取得了一定的突破。这个系统把用户视图中的多媒体对象组织成具有层次结构的虚拟数据库，使用属性来标识数据库中多媒体对象索引的特征；查询代理机允许用户直观地构造查询过程－包括一个结     

AI meets authoring: User models for untelligent multimedia

Authoring is a complex, knowledge-intensive activity which until recently has been performed exclusively by humans. New computer-based techniques have added horsepower rather than intelligence to traditional approaches, and have not addressed their principal limitations, chief of which is the inability to tailor presentations to individual users at run-time.We believe a model of the user is needed to support this kind of run-time determination of formand content. We describe our approach to the acquisition, representation and exploitation of user models: themost plausible user model is the result of an abductiverecognition process and it incorporates assumptions about the user which are then used to constrain thedesign by abduction of the best presentation. Both recognition and design processes are performed at run-time. We describe a prototypical implementation designed to demonstrate these ideas in the domain of video authoring.Our approach to authoring is intended to apply across multiple media; we have demonstrated these ideas with video because authoring in the video medium with traditional approaches inherits and exacerbates the problems from traditional media, and because the popularity of video as an authoring medium continues to grow.     

COM组件技术在多媒体软件开发中的应用

提出了一种采用COM组件技术和著作系统相结合的方式开发高质量多媒体课件的方法，在著作系统支持的开放体系结构的基础上，新的基于COM组件技术的功能可以被加入到多媒体课件中，并举例说明，利用COM组件技术和基于MOA（Macromedia Open Architecture)的Xtras进行进程间通信，多媒体课件可以和其他应用程序进行交互。     

A Multimedia Presentation Toolkit for the World Wide Web

This paper describes the design and implementation of MPRES, a Multimedia Presentation Toolkit for the WWW. The WWW has seen phenomenal growth over the last couple of years. It has become a vast repository of multimedia information that is accessible to virtually anyone having a browser. MPRES is a multimedia presentation system that allows a user to compose and render a presentation consisting of objects referenced by their URLs (Uniform Resource Locators). It uses the concept of dynamic documents to render on a WWW browser, a sequence of multimedia scenarios, having objects of types such as audio, image, plaintext, HTML (Hypertext Markup Language) document and animation. MPRES Author, the authoring subsystem, allows the user to interactively test and compose such a presentation, using the Netscape Navigator to collect multimedia resources from the WWW. A presentation database stores the presentations and provides a convenient frontend for accessing them. © 1997 John Wiley & Sons,Ltd.     

Modeling and Management of Fuzzy Information in Multimedia Database Applications

In this paper, we firstly present a conceptual data model for multimedia database applications based on ExIFO₂ model. The ExIFO₂ data model is chosen as the conceptual model since it handles complex objects along with their uncertain and imprecise properties. We enhanced this conceptual model in order to meet the multimedia data requirements. In addition to uncertain and imprecise information, we present a way of handling relationships among objects of multimedia database applications. Events that might be extracted from video or audio are also considered in this study. Secondly, the conceptual model is mapped to a logical model, which the fuzzy object-oriented data (FOOD) model is chosen, for storing and manipulating the multimedia objects. This mapping is done in a way that it preserves most of the information represented at the conceptual level. Finally, in this study videos of football (soccer) games is selected as the multimedia database application to show how we handle crisp and fuzzy querying and retrieval of fuzzy and crisp data from the database. A program has been developed to draw ExIFO₂ schemas and to map the schema to FOOD code automatically.