Hypermedia based application for space shuttle processing

In order to successfully complete routine procedures for the Space Shuttle, personnel in the Orbiter Processing Facility (OPF) at the Kennedy Space Center (KSC) are continuously checking numerous specifications and process procedures. Employees are not only faced with tedious searches for documents that frequently reference other drawings and documents, but they must correctly interpret the vast amount of information associated with each task in a timely manner.

Advances in Hypermedia and Database Management provide a solution for this problem. In a hypermedia environment, pertinent information is relationally retrieved and presented via a multitude of media avenues such as text, full-motion video, photographs, audio, and graphics display. This greatly reduces both the documentation search time and the confusion of interpretation resulting in a substantial increase in productivity.

In this paper we discuss the experience of developing a pilot project currently being conducted at the University of Central Florida. Hypermedia technology is being applied in support of Thermal Protection System (TPS) operations at KSC. The system involves the integration of several shuttle specification databases, video display of processes being performed, graphical display of drawings and specifications, and an optional audio output to provide the user with a free-hand environment if warranted.     

Using Hypermedia to Improve Safety in Underground Metropolitan Transportation

One of the main concerns in the organization and management of public transportation is passenger safety before an emergency. This is even more critical in the case of subway transportation, where risks are higher in the case of fire. Handling a critical emergency is a stressing task, in which large amounts of information must be used in order to make the right decision in a very short time.In this paper, we describe a pioneering application of hypermedia technology consisting of the integration of all the information needed to handle emergencies in a large hypermedia document. It reduces the response time remarkably by integrating text, graphics, sound, video and 3D models in a user-friendly interface. The authors and the Safety Office of Metro Valencia, the public transportation company of Valencia, developed it jointly between 1998 and 2000. We outline some of the technical decisions made during the project, as well as some of the lessons learned concerning the development of large hypermedia projects.     

The hype and the media: Issues concerned with designing hypermedia

Many claims and much 'hype' surround the term 'hypermedia'. Foremost amongst these claims are that hypermedia will revolutionize learning and users' abilities to interact with, search for, and tailor information to suit their own needs. These claims are similar to those made about 'hypertext' in the past. Our point of view is that hypermedia is 'more than just the sum (i.e. the overall effect) of the parts' (e.g. sound, video, graphics, text etc.). In this paper we offer definitions for the terms 'multimedia' and 'hypermedia' and examine some of the above claims using examples from a collaborative research and development project at the Open University and Rank Xerox EuroPARC. We consider what basic psychological principles can tell us about designing hypermedia from a usability perspective, apply these ideas to specific design issues, and raise some development issues which have also influenced our design of hypermedia. We conclude that further research and creative exploration are needed to understand how best to harness the potential of combining multiple media into well designed hypermedia systems.     

Linking Active Anchors: A Stage in the Evolution of Hypermedia

With the advent of multimedia technology, hypertext has evolved into hypermedia, in which the elements that are linked together can include animations, video clips, music recordings, and database queries. The critical hypertext function of link traversal must undergo a parallel evolution to support the dynamic aspects of these new types of information.

This paper introduces the concept of active anchors within dynamic information and explores the design issues involved in linking to active anchors. Scenarios from our hypermedia system, Intermedia, illustrate the use of active anchors in a university setting. General conclusions recommend characteristics that may facilitate the implementation of this concept in other hypermedia systems.     

HADT: Hypermedia application development tool for tourist applications

This paper describes an authoring tool prototype design for the development of hypermedia applications. The system is based on a generic object oriented data model suitable for hypermedia, that has been designed and implemented in our department. The model is extensible for integrated multimedia manipulation and provides an enhanced linking system. The design aims at a general purpose hypermedia application development tool which may well be used for the development of tourist applications. It is of special interest in the Greek tourist market since tourism contributes considerably to the national income of Greece. Current technology provides the hardware for manipulation of multimedia information and increases the quantity and quality of information flow between the user and the machine. Thus in a travel agency environment it would be desirable to have an interactive multimedia demonstration helping the user find places of interest in any context (physical beauty, archaeological interest, tourist infrastructure, possible itineraries etc.). Such a tool would be very effective compared with the static presentation of brochures. HADT has the potential to fulfil these needs when it is developed, and in this paper we explore such possibilities. Furthermore, research directions for future work are discussed.     

Real reality

In its most basic form, computer graphics technology renders an image of the world from a model. Having refined techniques from vector graphics, computer graphics now includes improved methods to render realistic and informative visual images of models representing microcosms of interest. Computational technology includes mechanisms to compress, communicate and combine text, audio, graphics and video to provide a unified multimedia document. Users can now decide if they want to read a story, watch a video or combine information from multiple sources to create a personalized digital experience. So what future faces computer graphics and multimedia? Can we take the technology to still another level of reality? Let's assume we can expand the scope of computer graphics to produce and render a world model for information or entertainment that surpasses the visual, also representing sound, touch, smell and taste. Although seemingly far out now, I believe computer graphics and multimedia will combine and expand to make such a technology-real reality-possible. Virtual reality (VR) foreshadows this development. I believe real reality, or what may more accurately be called remote reality, lies just around the corner. Real reality will revolutionize our society in many ways. Unlike VR, real reality systems will let users experience and interact digitally with real environments using all the human senses. However, real reality experiences will remain free of time and space constraints. You will be able to experience a remote environment digitally at your convenience wherever you are     

基于VC绘画板的开发与应用

信息时代的来临,让我们生活中的许多领域都发生了翻天覆地的变化,许多的工作都由计算机接替过来,甚至连传统的绘画也可以通过绘图板来实现。绘图板的普及为人们发挥绘画、书法、多媒体、视频等艺术才干提供了全新的工具,借助于绘图板以及各个专业制作软件的帮助,图形图像处理技术必将在艺术与设计领域发挥更好的作用。文章着重阐述了简易绘画板的整体开发过程。介绍了系统的开发环境以及开发工具,对于设计思想和设计流程也做出了全面的叙述,并且具体剖析了系统部分功能的实现过程以及详细设计过程,力求更加清晰地表明设计思想以及对整个程序设计的规划及具体实现,与此同时简单地展示了本系统的应用。     

Trams: Transportation-related air-management system

Transportation and air-quality issues are complex, coupled with the dynamic evolution of regulations, trends, and implications. The need for planners and decision makers to access current and expert information on air-quality trends, transportation planning, and applicable legislation to assist them in transportation-related air-quality management encouraged the development of the Transportation-Related Air-Management System (TRAMS). This hypertext, hypermedia system enables planners and decision makers to dynamically retrieve current information at their desktops. Transportation and air-quality information on a wide variety of related topics is organized into a branching hierarchy and presented in a consistently structured hypertext environment, allowing users to direct their own path through the resources integrated in the system design including graphics, glossary terms, crossreferences, original text materials, and expert contact information.     

Towards A New Authoring Methodology for Large-Scale Hypermedia Applications

As the amount of information technology increases, managing information resources, so that the correct people can find the information easily, becomes a critical issue. Hypermedia systems are considered one solution to this problem as they provide a means for representing higher level relationships between the underlying information. However, the amount of information available electronically is increasing at an accelerated rate. Using standard hypermedia authoring techniques, the effort required managing and maintaining large-scale hypermedia systems is enormous. Hypermedia authoring in the large requires new methodologies if it is going to be feasible.This paper presents a new model for building and structuring large-scale hypermedia applications. It describes a case study that explored the delivery of hypermedia information in an industrial environment on a small scale. Models and techniques developed for that case study were then refined and augmented so they could support the construction of large-scale hypermedia systems. In order to support such endeavors a new linking model is presented that allows the author to explicitly represent abstract concepts contained within the underlying information and interconnect them in some meaningful manner. A prototype system applying this linking technique is presented.     

三维视频中实现多个视频同时播放

研究了在三维视频中实现多个视频同时播放。为拓展多媒体技术的应用空间,使其与工程应用更接近,通过多媒体技术和OpenGL技术相结合,设计了一个立体视频播放器。它能在立体图形的不同面上播放不同的视频,而且可以在多个2D平面上同时播放多个不同的视频。2D图形和3D图形可以进行灵活自如的变形、移动、旋转等操作。实验结果表明,该播放器播放画面平滑自然,播放视频的数目可自由选择,多个视频间互不干扰,达到一种比较良好和理想的播放效果。     

A Hypermedia Tutoring System for Design Trainers

Research and development has been undertaken on the production of hypertext-based authoring and end-user training systems, linked to a videodisc player. A hypermedia system enabled the use of animation, purpose-designed graphics, sound and fast response to enhance the learning environment. The package structure could be presented, to allow the user to move around the package, and to see at a glance the consequence of his actions. In addition, material visited by the user and decisions taken, could be stored to enable computer managed manipulation of the data structure for individual requirements.

This paper discusses one particular system for design trainers to explore various structures of training material. This videodisc-based package gives guidance on the use of multi-media authoring packages to produce material that is sensitive to the interests of each trainee at an appropriate level of understanding. The control structure required some innovative programming techniques of benefit to other researchers investigating the potential of hypermedia.     

SKY：一个面向方案设计的超媒体智能开发环境

为了有效地支持方案设计，一个智能开发工具应具有哪些特征呢？作者认为将设计过程支持与设计信息管理集成在同一环境下可创造一个人机一体化的方案设计环境，本文介绍了一个作者开放的用于支持方案设计的智能设计开发环境ＳＫＹ《ＳＫＹ同时具有智能开发工具和超媒体系统的特点。文中给出了ＳＫＹ的总体结构，并且对ＳＫＹ的关键技术；面向对象知识表示，支持设计过程、问题求解策略和超媒体设计信息管理作出详细的讨论。最后介绍了     

Structuring Knowledge Bases for Designers of Learning Materials

Designers of interactive video training packages need access to multiple sources of information to be able to create exciting materials for learning or training. Hypertext allows dynamic linking of different strands of knowledge in ways which encourage effective elicitation of knowledge from experts, and understandable representation for subsequent users.

This paper describes the knowledge representation aspect of a system which will allow a designer to collect information from clients, from experts, as well as from printed and visual sources — to co-ordinate the information in a single environment, and using the same set of tools, to link the information to learning materials using videodisc and graphics packages.

The total system for a designer consists of an authoring environment, using NoteCards on a Xerox 1186, with a multi-tasking workstation (Amiga) which will bring together output from the knowledge base on the Xerox with information from videodisc. Information about the physical requirements of the authoring environment — constraints, domain limits, financial aspects — can be recorded alongside subject domain knowledge using different ‘modes’ of the Note Cards environment. Modes are a feature of a supplementary package. IDE (Instructional Design Environment), which operates as a ‘shell’ along with Note Cards. Our involvement with the designer's system is in looking at ways in which domain knowledge can be recorded and represented for use interactively with graphics and video materials.     

HVS：一种基于实景图象的虚拟现实系统

大多数的虚拟现实比试在于计算机图形技术,先由多边形构造虚拟场景的三维几何模型,再由计算机根据用户的观察点和观察方向实时绘制出用户所看到的虚拟场景,ＨＶＳ 另一种思路,由计算机自动拉接、变形与组织许多幅度散的实景图象或连续视频,生成虚拟场景,这种虚拟场人有照片质量的视觉效果,被我们称为虚拟实景空间,虚拟实时空间能为用户提供、后退、仰视、俯视、３６０度环境、近看、远看等漫游能力,运行它不需要高性能的图     

Storing user experiences in mixed reality using hypermedia

This paper describes HyperMem, a system to store and replay user experiences in mixed environments. The experience is stored as a set of hypermedia nodes and links, with the information that was displayed along with the video of the real world that was navigated. It uses a generic hypermedia model, implemented as software components, to handle mixed reality environments. This model includes components for storing and replaying experiences and integrating them in the overall set of hypermedia graphs that can be accessed by a given user. The paper presents the goals of the system, the underlying hypermedia model, the application scenarios, and the architecture and tools for replaying and repurposing stored information.     

SAPPHIRE: A toolkit for building efficient stream programs for medical video analysis

This paper describes the design and implementation of SAPPHIRE – a novel middleware and software development kit for stream programing on a heterogeneous system of multi-core multi-CPUs with optional hardware accelerators such as graphics processing unit (GPU). A stream program consists of a set of tasks where the same tasks are repeated over multiple iterations of data (e.g., video frames). Examples of such programs are video analysis applications for computer-aided diagnosis and computer-assisted surgeries. Our design goal is to reduce the implementation efforts and ease collaborative software development of stream programs while supporting efficient execution of the programs on the target hardware. To validate the toolkit, we implemented EM-Automated-RT software with the toolkit and reported our experience. EM-Automated-RT performs real-time video analysis for quality of a colonoscopy procedure and provides visual feedback to assist the endoscopist to achieve optimal inspection of the colon during the procedure. The software has been deployed in a hospital setting to conduct a clinical trial.     

基于Atom的移动装置远程监控系统设计

介绍了一种基于Atom处理器并结合3G无线通信技术和GPS定位技术的车辆远程监控系统。该系统主要包括车载终端、远程监控端。车载端将GPS数据和嵌入式移动数据库数据以及视频等车载信息通过二维码的编码方式进行封装,以当前应用成熟的3G无线通信技术作为载体来进行数据的远程传送,从而达到对车辆的运行状况进行远程监控和嵌入式移动数据库同步的目的。该系统可以为移动设备的更广泛的智能化应用提供一个通用的技术平台。     

固定多摄像头的视觉拼接技术

视频拼接技术是计算机图形学和计算机视觉的重要分支,它的发展基于静态图像的拼接技术,但由于视频信息的复杂性,视频拼接也有区别于图像拼接,针对实际运用中的实时拼接的需要,本文提出了一种基于控制帧的固定摄像头视频拼接方法。首先采集控制帧图像,对摄像头进行参数标定获得相机内参和光心坐标,再使用一种改进的畸变矫正方法去除摄像头畸变带来的成像失真。然后对控制帧图像进行SIFT特征提取并进行粗匹配,再用RANSAC的方法剔除误匹配点并拟合出图像变换单应阵。最后使用查表法将各摄像头的图像同步投影到大场景图片上,对重合区域进行光亮补偿和多带融合。最终实现速度可达25帧/秒的实时视频拼接。     

The development of a sound viewer for an open hypermedia system

Abstract

While rich support for a wide variety of media such as text, video and image is common among contemporary hypermedia systems, so too is the inadequate support for audio. The primary reason that audio has not attracted as much attention as other media can be attributed to its obvious lack of visual identity. The main focus of this work was to identify a generic and meaningful visual representation of audio within a hypermedia context, and significantly promote hypermedia support for audio through the provision of a sound viewer.

This paper describes the inherent difficulties in providing a consistent interface to audio, and discusses in some depth the issues raised during the development process. The sound viewer is then introduced and the associated concepts described. The creation and traversal of links to and from audio are facilitated by the sound viewer across formats including WAV (proprietary digital sound file format from Microsoft), CD (Compact Disc) Audio and MIDI (Musical Instrument Digital Interface). The resultant viewer provides a unified and extensible framework for interacting with audio from within an open hypermedia environment. The open hypermedia system Microcosm was used as the development platform for this work. Microcosm can be augmented to supply a hypermedia link service to additional media with minimal overhead.     

Automatic Real-Time Video Matting Using Time-of-Flight Camera and Multichannel Poisson Equations

This paper presents an automatic real-time video matting system. The proposed system consists of two novel components. In order to automatically generate trimaps for live videos, we advocate a Time-of-Flight (TOF) camera-based approach to video bilayer segmentation. Our algorithm combines color and depth cues in a probabilistic fusion framework. The scene depth information returned by the TOF camera is less sensitive to environment changes, which makes our method robust to illumination variation, dynamic background and camera motion. For the second step, we perform alpha matting based on the segmentation result. Our matting algorithm uses a set of novel Poisson equations that are derived for handling multichannel color vectors, as well as the depth information captured. Real-time processing speed is achieved through optimizing the algorithm for parallel processing on graphics hardware. We demonstrate the effectiveness of our matting system on an extensive set of experimental results.