Development procedure of a hypermedia application in support of industrial tasks

A technical environment which involves great amounts of specifications and procedure instructions is conducive to hypermedia technology. In a hypermedia environment, pertinent information is relationally retrieved and presented via a multitude of media avenues such as text, fullmotion video, photographs, audio, and graphics. This technology greatly reduces both the documentation search time and the confusion of interpretation associated with an information overload. Ultimately, a substantial increase in productivity is the result.

In this paper we report our experience in the development of a hypermedia-based information center. This development procedure is a by-product of a pilot project currently being conducted at the University of Central Florida (UCF) in Orlando, FL. The subject of our research is the working environment of the Orbiter Processing Facility (OPF) at Kennedy Space Center (KSC). A typical process from routine work instructions was selected and served as a basis of our development and evaluation. The outcome of the study is a computer-based hypermedia information center which employs full-motion video (via a laserdisc player), hypertext, graphics, and an authoring language.     

A neutral object data model for integrated building design and construction environment

Construction and civil engineering projects include large numbers of design elements, materials, activities, in addition to a diversity of data types and complex relationships. The need to adopt appropriate representational schemes and database technologies that can handle complex data types and relationships continue to hinder the search for solutions to an integrated design-construction environment. This paper describes a scheme that classifies and codes design information to support an integrated building design data model. The model is conceptual and based on the object-oriented paradigm. It uses concepts such as objects, attributes and different relations between objects. The main feature of the model is a set of hierarchies of design objects which have classes for describing the various aspects of design elements of a building. These classes represent elements, materials, geometry and construction activities represented by work sections. The model provides classes of data items from which the designer can select to model the various pieces of design elements and their associated work sections. Attributes provide information included in design and construction documents like drawings, specifications and bills of quantities. The model deals with a diversity of data abstracts including multimedia features like sound and video that can be stored in different design documents.     

Brahma: Browsing and Retrieval Architecture for Hierarchical Multimedia Annotation

Traditional browsing of large multimedia documents (e.g., video, audio) is primarily sequential. In the absence of an index structure browsing and searching for relevant information in a long video, audio or other multimedia document becomes difficult. Manual annotation can be used to mark various segments of such documents. Different segments can be combined to create new annotated segments, thus creating hierarchical annotation structures. Given the lack of structure in media data, it is natural for different users to have different views on the same media data. Therefore, different users can create different annotation structures. Users may also share some or all of each other's annotation structures. The annotation structure can be browsed or used to playback as a composed video consisting of different segments. Finally, the annotation structures can be manipulated dynamically by different users to alter views on a document. BRAHMA is a multimedia environment for browsing and retrieval of multimedia documents based on such hierarchical annotation structures.     

A Survey of MPEG-1 Audio,Video and Semantic Analysis Techniques

Digital audio & video data have become an integral part of multimedia information systems. To reduce storage and bandwidth requirements, they are commonly stored in a compressed format, such as MPEG-1. Increasing amounts of MPEG encoded audio and video documents are available online and in proprietary collections. In order to effectively utilise them, we need tools and techniques to automatically analyse, segment, and classify MPEG video content. Several techniques have been developed both in the audio and visual domain to analyse videos. This paper presents a survey of audio and visual analysis techniques on MPEG-1 encoded media that are useful in supporting a variety of video applications. Although audio and visual feature analyses have been carried out extensively, they become useful to applications only when they convey a semantic meaning of the video content. Therefore, we also present a survey of works that provide semantic analysis on MPEG-1 encoded videos.     

多媒体视、音频信号处理系统的集成与优化

在多媒体视、音频信号处理系统中,主要涉及数据通信、音频处理,复合视频信号（ＰＡＬ、ＮＴＳＣ）的变换、合成视频信号（Ｒ、Ｇ、Ｂ）的传输４大模块。讨论了如何结合新技术和新器件来实现各模块的高度集成和优化设计,从而使系统在性能指标、功能、结构体系等方面体现出良好的品质。     

Audio–Visual Active Speaker Tracking in Cluttered Indoors Environments $^{ast}$

We propose a system for detecting the active speaker in cluttered and reverberant environments where more than one person speaks and moves. Rather than using only audio information, the system utilizes audiovisual information from multiple acoustic and video sensors that feed separate audio and video tracking modules. The audio module operates using a particle filter (PF) and an information-theoretic framework to provide accurate acoustic source location under reverberant conditions. The video subsystem combines in 3-D a number of 2-D trackers based on a variation of Stauffer's adaptive background algorithm with spatiotemporal adaptation of the learning parameters and a Kalman tracker in a feedback configuration. Extensive experiments show that gains are to be expected when fusion of the separate modalities is performed to detect the active speaker.      

基于FC的航电数字视频传输技术研究

光纤通道音视频协议（FC-AV）定义了视频信息在光纤通道FC网络传输方法,为视频设备之间互连提供一种接口标准,代表航电系统视频信息传输技术的发展趋势。深入研究光纤通道音视频协议的基本原理,基于FPGA实现视频信息采集、容器系统的组织、FC数据帧的组织封装以及显示容器系统显示控制等关键技术,研制一套硬件接口模块,构建一个视频传输网络,验证了基于光纤通道传输图像信息方法,解决图像信息远距离的难题,为航空电子应用光纤通道传输图像信息奠定了基础。     

Perspective: A Standards-Based System for Manufacturing Information Integration

This paper presents an infrastructure and a prototype system for a manufacturing information system, which is distributed its nature and is able to store, index, manage, retrieve and present business data, inventory data, and manufacturing processes data. The system works with all kinds of information, such as continuous (i.e., stream oriented) data, production (e.g., decision support) data, legacy data, and multimedia data (say, drawings, pictures, audio signals, voice annotations, and video streams). A key criterion is support for content-based information retrieval across all application areas. The main objective is to provide support for automated information transactions. The prototype of our architecture uses JAVA, STEP (ISO 10303) standard, the Internet, and CORBA. A fully functional system, called Perspective, for retrieval of part and manufacturing process has been designed and implemented in a distributed environment. Among other capabilities, the system can retrieve a set of parts or manufacturing processes based on similarity to some desired criteria.     

面向编钟乐舞的音视频同步技术的研究

音视频同步作为连接音乐,动作的纽带在面向编钟乐舞的音乐驱动动作编辑流程中起到关键性的作用,通过从音频解析入手,提出了音频乐段与动作序列的对应关系,讨论了音频流与视频流如何在实时的环境中同步展示,并给出了音频,视频同步模型的具体实现方法。     

The digital curation of ethnic music audio archives: from preservation to restoration

In the sound archive field, a long-term maintenance of the collective human memory in its original form is not sustainable. All physical carriers are subject to degradation and the information stored on such carriers is bound to vanish. Only a re-mediation of the original documents can prevent precious knowledge from being permanently lost. In particular, ethnic music audio documents are often recorded on non-professional carriers by means of amateur recording system, or, more in general, in fieldwork circumstances. Thus, the preservation of the carrier and the restoration of the audio signal are crucial to avoid the permanent loss of the musical heritage, which is already heavily corrupted. This article describes the protocols defined, the processes undertaken, the results ascertained from several audio documents preservation/restoration projects carried out in the ethnic music field, and the techniques used. In particular: (i) a number of recommendations are given for the re-recording process, and (ii) an audio restoration environment (constituted by three audio restoration tools), developed using the VST plug-in architecture and optimized for different audio carriers (cylinders, shellac discs, tapes) is detailed. The experimental results and the perceptual assessment presented show the effectiveness of the restoration environment developed by the author.     

实时动态信息发布系统实现及发展

实时动态信息发布系统正是在这种背景环境下诞生的一种新型的媒体发布应用系统。实时动态信息发布系统是一种通过数字化音、视频多媒体处理,通过网络实现远程多点分布式播放和集中管理控制的系统,播放的信息是实时动态系统;一个操作员可以集中建立、编辑和分配内容给网络环境中的数量庞大的显示终端,即实现一台服务器集中管理,向多个不同场所地点的显示终端发布实时动态的多媒体信息。     

Voice Data Entry (VDE) training and Implementation Strategies

Current effort at Kennedy Space Center (KSC) involves implementation of voice data entry in the thermal Tile Processing System (TPS). Large amounts of data collection and recording along with the advancement in voice recognition and speech synthesis justified the introduction of a voice data entry system in support of TPS.

This paper presents a training and an implementation strategies for the VDE System in TPS at KSC. Training Strategies are tailored to different levels of the target population with varying objectives for the training sessions. Training scenarios and training manuals are designed to support the objectives of each session. A unique feature of the VDE is the fact that the “system” also needs to be trained for specific users.

Implementation strategy calls for parallel implementation for the current manual system over a period of four consecutive missions. This would be followed by gradual phasing out of the current manual system and phasing in of the VDE system over a span of three missions.

The methodologies used and the developed strategies can be used for the introduction of new technologies in general, and that related to voice and speech recognition in particular.     

Agent-based commercial dissemination of electronic information

Information dissemination is slowly moving from printed media to electronic media. However this step cannot be completed if the electronic commercialization of information does not provide the same guarantees against copyright infringement as the printed media. In this paper we present the major requirement for the commercialization of electronic information and describe Hypermedia Electronic Publishing (HEP), an agent-based framework we developed for the commercialization of arbitrary electronic documents.     

Knowledge based quality system in support of space shuttle operations

In an attempt to use statistical variable data for process improvement at Kennedy Space Center (KSC), statistical quality control is being introduced in the shop floor for use by technicians and engineers. An Expert System is proposed to support this effort. The system has a component for process improvement, which uses a process capability index to suggest continuos process improvement to reduce cost and duration of the process.     

Facilitating simultaneous engineering in the automotive industry via high speed networks, control passing and face-to-face video: Results from the car project

The European automotive industry requires frequent interaction and transfer of data between geographically dispersed designers and engineers at all stages of the product introduction process. The RACE CAR project identified and demonstrated Integrated Broadband Communications (IBC)-supported applications to support this process and improve competitiveness. User requirements for workstation-based, multi-media facilities including conferencing were identified. Two experiments were designed to investigate the role of face-to-face video and the means by which participants organise and control their interactions. These are critical issues in the multi-cultural, international environment of the European automotive industry. In the first experiment groups of three users solved a cooperative, screen-based, object manipulation task supported by different levels of communication. ‘Linked computers plus an audio link’ resulted in significantly faster completion times than either ‘audio alone’ or ‘linked computer plus audio and face-to-face video’. ‘Linked computers plus audio’ was also perceived as the most effective communications media. The passage of cursor via verbal agreement was successfully managed. Video was generally considered beneficial for initial introductions, assessing understanding and facilitating a stronger feeling of group identity.

In the second experiment, subjects were grouped under ‘chaired’ or ‘free-for-all’ conditions and linked via (1) audio and linked computers or (2) audio, linked computers and face-to-face video. The task was similar to Experiment 1 and attempts to introduce contention were made through adding hidden, sub-goals. The task took significantly less time to complete in the ‘video chaired’ condition than the ‘non-video chaired’ or ‘video free-for-all’ conditions. This suggests that video has an important role in enabling a chairperson to control the meeting. Contention was not successfully achieved.

The results of the experiments suggest face-to-face video may be useful in chaired meetings and to develop ‘team’ feeling. A free-for-all method of control passing was seen as most appropriate although problems in achieving contention in Experiment 2 meant the impact of disagreement was not fully investigated. The results are discussed in relation to the European automotive industry and areas for further study identified. Relevance to industry

The European automotive industry, which maintains distinct engineering functions in disparate countries, is striving to reduce the length of its design life cycle by improving communications between designers and engineers. The studies described in this paper provide information of use to the developers and procurers of systems intended to support this process. In particular issues relating to the relevance of face-to-face video and use of control mechanisms for co-operative computer-mediated work.     

Table-processing paradigms: a research survey

Tables are a ubiquitous form of communication. While everyone seems to know what a table is, a precise, analytical definition of “tabularity” remains elusive because some bureaucratic forms, multicolumn text layouts, and schematic drawings share many characteristics of tables. There are significant differences between typeset tables, electronic files designed for display of tables, and tables in symbolic form intended for information retrieval. Most past research has addressed the extraction of low-level geometric information from raster images of tables scanned from printed documents, although there is growing interest in the processing of tables in electronic form as well. Recent research on table composition and table analysis has improved our understanding of the distinction between the logical and physical structures of tables, and has led to improved formalisms for modeling tables. This review, which is structured in terms of generalized paradigms for table processing, indicates that progress on half-a-dozen specific research issues would open the door to using existing paper and electronic tables for database update, tabular browsing, structured information retrieval through graphical and audio interfaces, multimedia table editing, and platform-independent display.     

International real-time streaming of 4K digital cinema

This paper describes the world’s first real-time, international transmission of 4K digital cinema and 4K Super High Definition (SHD) digital video at iGrid 2005, hosted at the California Institute of Telecommunications and Information Technology (Calit2) at the University of California, San Diego. Nearly six hours of live and pre-recorded 4K motion picture and audio content was streamed to iGrid in San Diego from the Research Institute for Digital Media and Content (DMC) at Keio University in Tokyo.

To implement this demonstration, several new technologies were introduced, including a prototype high-performance 4K compressed multicasting system called “JPEG 2000 Flexcast”, and “Soundscape”, a practical scheme for synchronizing audio and video transmitted from different locations over IP networks.

These iGrid 2005 demonstrations proved that it is now feasible to implement networked professional audio/video applications–production, post-production and distribution–even at 4K quality over IP networks up to 15,000 km long. The demonstrations also showed the new 4K motion picture technology being introduced for digital cinema can be usefully applied to other network applications such as remote telepresence, distance learning and scientific visualization.     

An applied research study for the provision of a QoS-oriented environment for voice and video services over satellite networks

The aim of this paper is to present a network solution to provide Quality of Service (QoS) guaranteed voice and video services over a satellite test-bed based on the TCP/IP protocol suite, oriented to distance learning. The scope of the solutions proposed is a small private satellite network where specific services (e.g. tele-education) are offered to the users.The paper describes the main operating steps followed to perform the tests. The target service requirements are identified and the configuration of devices and protocols are described in detail. The Integrated Services approach is utilized along with three different scheduling mechanisms at IP layer. A proper routing protocol to support multicast is used.The work is a part of a project called ‘Integration of Multimedia Services over Heterogeneous Satellite Networks’, which has been developed by the Italian National Consortium of Telecommunications (CNIT) and funded by the Italian Space Agency (ASI). The test-bed is composed of two remote sites, connected through a satellite link at 2 Mbits/s and by one site, where no satellite device is available, connected by using ISDN.The results reported allow to test the application of bandwidth reservation strategies originally studied for a terrestrial environment and to measure the consequent performance improvement. The use of both subjective metrics as mean opinion score (MOS) and objective metrics, as audio/video packet loss and average bit rate, to perform the investigation, allow mapping the measure of P-QoS (Perceived-Quality of Service) with quantities uninfluenced by personal opinions. The configurations used represent the result of an applied research project and provide an operative solution, inclusive of technical details, to guarantee high quality of service for audio/video applications.