虚拟现实软件系统开发方法研究

虚拟现实技术是一门综合性技术,涉及计算机图形学、多媒体技术、人机交互和人工智能等多个领域,在教育、医疗、娱乐、军事等众多领域有非常广泛的应用。所有这些技术和应用最终都要靠计算机软件来实现,这就使得虚拟现实系统的软件变得十分庞大和复杂,涉及许多多媒体数据。传统软件开发方法和程序设计技术侧重于处理文本数据,显然不能满足开发虚拟现实软件的需要。试图以所在团队研发成功的PAR方法和PAR平台为基础,根据虚拟现实软件系统的特征,探寻虚拟现实软件系统开发的新方法,进一步扩充和完善PAR平台中已有多媒体处理技术、形式化建模技术和C#等高级语言程序自动生成系统。     

解析Flash中的元件和实例

在动漫的王国里,二维动画、三维动画等技术在社会的各个方面已迅速发展和普及。尤其是二维平面动画FLASH软件。以其自身独有的特点在社会上各个领域的应用更为普及,逐渐成为推动动漫快速发展的核心技术之一,被广泛用于多媒体技术中、课件、网站动画、游戏、交互式软件开发等社会的多个方面。而元件与实例对象是组成动画生成的重要元素、是掌握FLASH这款软件的重点部分。     

多媒体教学实时录播系统的设计及其实现方法

随着计算机软硬件技术、计算机网络技术及音视频压缩技术的快速发展,教学方式也面临着一场巨大的变革,各种各样的多媒体教学应用系统应运而生,提高了实际教学工作的效率。为了共享宝贵的教学资源、增强课程学习的灵活性,从实际的教学需求出发,综合运用当前的计算机技术、网络技术以及多媒体技术,提出了一个多媒体教学实时录播系统的设计方案,并针对此设计方案探讨了各种可行的实现方法。     

基于authorware的交互并可扩展的多媒体课件设计

auhtorware是用来开发多媒体应用程序的设计软件.本文以一个院级获奖作品为例介绍了使用authorware开发一个多媒体课件的关键技术,如交互技术,外部程序调用技术,界面设计技术等.     

试对．NET组件技术进行研究

．NET组件技术随着网络与多媒体技术的应用与发展得到广泛的应用,尤其是近几年来在插件技术领域的开发与应用中,得到了众多软件系统开发人员的青睐,提高软件开发效率,使其更具实用价值。     

职业教育教学中多媒体技术应用探究

随着科技的发展,现在的教学技术越来越体现时代特征,即应用一切可利用的现代科学技术为教育工作服务。而在所有的现代教育技术中,以计算机为核心的多媒体教学对于教育教学尤其是职业教育的发展具有影响重大。笔者结合具体事例,浅析了多媒体教学在职业教育中的应用及其意义。     

Multimedia-oriented action recognition in Smart City-based IoT using multilayer perceptron

The Internet of Things (IoT) devices and technologies for smart city applications produces a vast amount of multimedia data (e.g., audio, video, image, text and sensorial data), such big data are difficult to handle with traditional techniques and algorithms. The emerging machine learning techniques have the potential to facilitate the development of a new class of applications that can deal with such multimedia big data. Recently, Activity Recognition systems suggest using of multimedia data to detect daily actions, since it provides more accurate patterns; prevent the arising complain on privacy issues (in case of using audio-base data) and able to work on a big data. In this paper, we propose a Deep Learning (DL) methodology for classifying audio data that is based on multilayer perceptron neural networks. The contributions of our work are to propose an efficient design of the network topology including hidden layers, neurons, and the fitness function. In addition, the proposed methodology contributed in producing high performance classifier in terms of accuracy and f-measure. The experiments have been conducted on four large audio-datasets that have been collected to represent different modalities in a smart city. The results indicated that the proposed methodology achieved high performance as compared to the state-of-the-art machine learning techniques.

     

CORE: a content-based retrieval engine for multimedia information systems

Rapid advances in multimedia technology necessitate the development of a generic multimedia information system with a powerful retrieval engine for prototyping multimedia applications. We develop a content-based retrieval engine (CORE) that makes use of novel indexing techniques for multimedia object retrieval. We formalize the concepts related to multimedia information systems such as multimedia objects and content-based retrieval. We bring out the requirements and challenges of a multimedia information system. The architecture of CORE is described in detail along with the associated retrieval mechanisms and indexing techniques. Various modules developed for efficient retrieval are presented with some APIs. The efficacy of CORE is demonstrated in the development of two multimedia systems, a computer-aided facial image inference and retrieval (CAFIIR) system and a system for trademark archival and retrieval (STAR), which have been developed at the Institute of Systems Science (ISS). We expect that CORE will be useful for effective prototyping of other such multimedia applications.Mainly supported by National Science & Technology Board of SingaporePartly working in Real World Computing Partnership, Novel Function Institute of Systems Science Laboratory since April 1994.     

Adobe Audition3.0音频素材制作应用技巧探究

随着时代的发展,在信息化的大背景下,多媒体技术在文化教育方面得到了广泛的应用。而音视频制作是多媒体技术的主要构成部分。该文基于Adobe Audition 3.0软件,具体阐述了降噪等音效处理技巧,对如何利用Audition来制作音频素材进行探讨研究。     

Multimedia technology for pervasive computing environment

With the emerging multimedia techniques which can be used for various pervasive and ubiquitous applications such as healthcare, environmental monitoring, security and surveillance, there are a number of important challenges that arise when multimedia transmits in this kind of pervasive computing environments. This special issue is called for high-quality, up-to-date related multimedia technology for pervasive computing environment. In this special issue, we have accepted only nine high-quality papers. We expect that this special issue will be a trigger for further related research and technology improvements in multimedia technology for pervasive computing environment.     

Experiences Using Domain Specific Techniques within Multimedia Software Engineering

Domain specific techniques take advantage of the commonalities among applications developed within a certain domain. They are known to improve quality and productivity by incorporating domain knowledge and previous project experiences and promote reuse. This paper describes six domain specific software engineering techniques for developing multimedia applications within the digital library domain. We provide examples of each technique from several projects in which they were used, how the techniques are used within general software engineering practice (in particular, MBASE), how the techniques address some of the particular challenges multimedia software engineering, and the positive impacts we have measured resulting from their use within a graduate level software engineering course.     

计算机辅助英语教学中多媒体的作用

如今,计算机辅助英语教学由基于光盘﹑独立系统和基于局域网的传统课程向基于网络的新型课程转变,它能更好地将网络的交流性﹑合作性和互动性与语言学习相结合。同时,多媒体在计算机辅助英语教学中的应用能更好地帮助学生理解语言。前人研究中对语言学习中多媒体的使用持肯定态度。讨论多媒体技术的新作用及教学环境中的一些表现。为了能有效推行多媒体语言教学,把新技术和传统教学相结合,需要开拓更灵活的语言环境。     

AuthorWare与PowerPoint应用浅析

由于多媒体技术其强大的功能,多媒体技术越来越受到受到人们的欢迎。多媒体计算机辅助教学也越来越受到师生们的重视。AuthorWare和PowerPoint多媒体技术中两个非常重要的软件,也是CAI最常用的软件,该文通过对两者进行比较,以便人们在以后的使用过程中更好的选择软件,从而达到最优化的使用效果。     

Developing and Maintaining an Object-Oriented Distributed Multimedia Information System

As object-oriented analysis and design techniques mature, the promises of object-orientation become more realizable. The advent of multimedia hardware and software technology give rise to a need for generalized multimedia data access methods. This paper describes the object-oriented development and subsequent maintenance of ENFORMS, an object-oriented distributed multimedia information system. We discuss the advantages and disadvantages of using object-oriented analysis and design techniques to develop a general client–server architecture for browsing, retrieving, and analyzing distributed multimedia data. We also describe lessons learned from this project, including the impact of a rigorous application of object-oriented analysis and design techniques.     

面向Agent的软件设计模式

设计模式针对一类在特定上下文中反复出现的问题给出了通用解决方案,模式的提取和重用有助于提高软件开发的效率和质量,其思想和方法已在面向对象软件工程中得到广泛应用和验证。我们认为同一问题采用不同的实现技术往往具有不同的设计形态,不同软件开发范型也有其各自不同的设计模式。作为一种新颖的软件开发范型,近年来面向Agent软件工程的研究取得了长足进展,如何提高软件Agent技术实用性,发挥其技术潜力,扩大其应用范围成为当前人们关注的焦点。本文将模式思想引入到面向Agent软件工程,针对软件Agent技术的特点,从组织结构、交互协作和个体Agent体系结构三个视点提出了一组面向Agent的软件设计模式,以支持多Agent系统的设计;并进一步给出了面向Agent设计模式的描述框架,进行了典型设计模式和应用案例的分析。     

浅谈流媒体技术及其在Internet上的应用

流媒体技术的基础是多媒体通信技术,一般是指通过IP网络传送媒体(如视频、音频)的技术总称,它是当前十分流行的多媒体技术之一。本文从流媒体技术的相关技术出发,对流媒体的组成、发展及其在Internet上的应用进行了研究探讨。     

多媒体智能：当多媒体遇到人工智能

过去10年中涌现出大量新兴的多媒体应用和服务,带来了很多可以用于多媒体前沿研究的多媒体数据。多媒体研究在图像/视频内容分析、多媒体搜索和推荐、流媒体服务和多媒体内容分发等方向均取得了重要进展。与此同时,由于在深度学习领域所取得的重大突破,人工智能(artificial intelligence,AI)在20世纪50年代被正式视为一门学科之后,迎来了一次“新”的发展浪潮。因此,一个问题就自然而然地出现了：当多媒体遇到人工智能时会带来什么？为了回答这个问题,本文通过研究多媒体和人工智能之间的相互影响引入了多媒体智能的概念。从两个方面探讨多媒体与人工智能之间的相互影响：一是多媒体促使人工智能向着更具可解释性的方向发展;二是人工智能反过来为多媒体研究注入了新的思维方式。这两个方面形成了一个良性循环,多媒体和人工智能在其中不断促进彼此发展。本文对相关研究及进展进行了讨论,并围绕值得进一步探索的研究方向分享见解。希望可以对多媒体智能的未来发展带来新的研究思路。     

多媒体社会事件分析综述

由于网络技术的飞速发展,自媒体、微博、论坛等基于互联网的多种交流渠道日渐完善,人们能够方便地在线生成和共享丰富的社会多媒体内容。社会事件数据具有跨平台、多模态、大规模、噪声大等特点,基于多媒体社会事件的分析研究非常具有挑战性。因此,如何对社会媒体数据进行处理,研究社会事件分析方法、设计有效的社会事件分析模型成为社会事件分析研究的关键问题。文中对近年来多媒体社会事件分析的相关研究展开了综述,重点回顾了多媒体社会事件表示方法及其在虚假新闻检测、多媒体热点事件检测跟踪及演化分析、社交媒体危机事件响应等领域的应用,并对不同应用涉及的数据集进行了详细介绍。最后对多媒体社会事件分析方面未来可能的研究课题进行了展望。     

Value Prediction and Speculative Execution on GPU

GPUs and CPUs have fundamentally different architectures. It is conventional wisdom that GPUs can accelerate only those applications that exhibit very high parallelism, especially vector parallelism such as image processing. In this paper, we explore the possibility of using GPUs for value prediction and speculative execution: we implement software value prediction techniques to accelerate programs with limited parallelism, and software speculation techniques to accelerate programs that contain runtime parallelism, which are hard to parallelize statically. Our experiment results show that due to the relatively high overhead, mapping software value prediction techniques on existing GPUs may not bring any immediate performance gain. On the other hand, although software speculation techniques introduce some overhead as well, mapping these techniques to existing GPUs can already bring some performance gain over CPU. Based on these observations, we explore the hardware implementation of speculative execution operations on GPU architectures to reduce the software performance overheads. The results indicate that the hardware extensions result in almost tenfold reduction of the control divergent sequential operations with only moderate hardware (5–8%) and power consumption (1–5%) overheads.     

Teacher knowledge for using technology to foster early literacy: A literature review

A literature review was conducted to describe the knowledge and skills teachers need for using technology to foster early literacy development in kindergarten classrooms. The study was guided by three research questions, concerning 1) effects of specific technologies, 2) effective design characteristics and 3) effective use of such applications. The sample consisted of 46 articles that reported on the affordances of technology in relation to kindergartners' early literacy development. The review included studies on electronic books, computer-based training programs, technology-rich literacy curricula, assistive technology, and other educational media and sources for technology-rich literacy education. The following software applications were found effective in fostering kindergartners' early literacy development: Electronic storybooks, computer-based phonics and vocabulary training programs, software applications that enable children to ‘read and write’, software applications that are designed for tutorial activities, and educational television programs with a narrative format. Few of the studies reviewed provided specific information about effective design characteristics of such applications or concrete guidelines for using technology in developmentally appropriate fashion in kindergarten. Theoretical and practical implications are discussed.