Real-time single camera natural user interface engine development

Natural user interfaces (NUIs) provide human computer interaction (HCI) with natural and intuitive operation interfaces, such as using human gestures and voice. We have developed a real-time NUI engine architecture using a web camera as a means of implementing NUI applications. The system captures video via the web camera, implements real-time image processing using graphic processing unit (GPU) programming. This paper describes the architecture of the engine and the real-virtual environment interaction methods, such as foreground segmentation and hand gesture recognition. These methods are implemented using GPU programming in order to realize real-time image processing for HCI. To verify the efficacy of our proposed NUI engine, we utilized it in the development and implementation of several mixed reality games and touch-less operation applications, using the developed NUI engine and the DirectX SDK. Our results confirm that the methods implemented by the engine operate in real time and the interactive operations are intuitive.     

The virtual wind tunnel

The design and implementation of a virtual environment linked to a graphics workstation for the visualization of complex fluid flows are described. The system user wears a stereo head-tracked display, which effectively displays 3-D information, and an instrumented glove to intuitively position flow-visualization tools. The visualization structures and their interfaces in the virtual environment and the implementation hardware and software are described. The performance of the virtual wind tunnel is reviewed using the flow past a tapered cylinder as an example. Performance issues and future directions for the system are discussed     

Intuitive user interfaces (IUI): a CASE starting point for design and programming.

The acceptance of a software product depends to a considerable extent on the user interface. The class of graphic-oriented user interfaces that are called Intuitive User Interfaces (IUI) is described. These interfaces allow the user to learn to operate software programs quickly. In the following the graphical layout put to use in an IUI is elaborated. All images the layout consists of are created with the aid of a paint program. Using these images, a procedure for creating, programming and linking an IUI to software applications is discussed and recommendations are made concerning software and hardware demands for easily creating IUIs. Practical experience of the authors with this procedure, mainly in the medical area, is described.     

Utilizing vector space models for user modeling within e-learning environments

User modeling has been found to enhance the effectiveness and/or usability of software systems through the representation of certain properties of a particular user. This paper presents the research and the results of the development of a user modeling system for the implementation of student models within e-learning environments, utilizing vector space models. The central challenge has been to exploit the possibilities of IUI research on user models without compromising the performance of the overall system. The research described in this paper has aimed to augment the user interface of an existing e-learning environment with relevant aspects from the domain of intelligent user interfaces, through developing a student modeling component.     

The Distributed Java Platform

Java's utility in developing distributed applications extends beyond the creation of more intuitive user interfaces and expansion of access. in its greater role in the world of distributed computing, Java represents a body of programming interfaces that enable Java applications to communicate with each other across a process boundary, simplifying the development, deployment, and maintenance of enterprise applications.     

一种支持模型驱动开发的Web用户界面建模方法

针对Web应用的特点,提出了一种基于XML和界面模板技术的界面建模方法。该方法以图形化的方式在模型层展示了Web用户界面的直观样式,能够对模型驱动的软件开发提供有力的支持。     

基于CHAM的软件连接件形式化模型

软件连接件是软件体系结构中的一个重要概念,是构件间相互作用的媒体。用形式化方法对其模型加以描述是软件体系结构研究中的一个重点。化学抽象机形式化语言(CHAM：Chemical Abstract Machine)是一种通用的、简单直观的计算模型描述语言。本文在分析了连接件语义模型的基础上,提出了一种基于CHAM的软件连接件描述模型,从软件连接件静态组成及动态行为两个方面对连接件进行形式化、规范化地描述和分析,以期进一步实现简化软件连接件的设计、增强其通用性的目的。     

面向资源的应用软件开发方法学

从分析编程手段和软件开发方法学的发展趋势入手,提出“资源”将是未来编程语义的主要载体。然后对主要的软件开发方法学进行阐述,提出面向资源的应用软件开发方法学（ＲＯＡＤ）可能是将面向对象（ＯＯ）思想提供给最终用户运用的有效方法。作者倡议：开辟一门新的软件开发方法学———ＲＯＡＤ方法学。最后介绍了珠海同望科技有限公司在ＲＯＡＤ方面所做的工作。     

中标麒麟系统下基于QT的PXI仪器软件开发

摘要：为了解决国产龙芯计算平台下PXI仪器软件的运行和使用问题,本文提出了在中标麒麟系统下基于QT开发PXI仪器软件。文中首先介绍了国产龙芯计算平台下的中标麒麟操作系统和Qt5.6开发工具,随后阐述了中标麒麟系统下基于QT的PXI仪器软件开发方法和步骤,讨论了Windows和Linux的编程环境配置、界面源码与用户源码隔离、驱动程序开发和移植,最后以航天测控公司几款PXI仪器模块为对象进行了程序开发与验证。总体上,当前运行在 X86 架构的PXI仪器软件均无法在龙芯平台运行和使用,必须重新开发驱动模块和应用程序接口来实现软件适配。     

Constraints in Graph Drawing Algorithms

Graphs are widely used for information visualization purposes, since they provide a natural and intuitive representation of complex abstract structures. The automatic generation of drawings of graphs has applications a variety of fields such as software engineering, database systems, and graphical user interfaces. In this paper, we survey algorithmic techniques for graph drawing that support the expression and satisfaction of user-defined constraints.     

Moo in your face: researching,designing, and programming a user-friendly interface

Promoters of multi-user, object-oriented domains (MOOs) in composition point to the capability for student collaboration and conversation throughout the writing process as a valuable feature; detractors, however, draw attention to the difficulty for students to negotiate the somewhat arcane, text-based MOO interface, which affords no easy, intuitive way for students to learn how to exist in that virtual world, and often results in confusing conversations. The learning curve of a MOO and its confusing interface blockade effective use. Current research on Web-browser interface design provides several principles for developing a user-friendly Telnet interface that creates a sense of presence for the user. An IBM/PC-compatible interface, Pueblo from Chaco Communications, Inc., allows developers to modify the interface to provide a sense of presence for the user. In addition, access to the sites for non-IBM users was developed. For Web browsers, a Java-based interface and a WOO interface allow students to access and function in the MOO more quickly than a purely text-based client did. Work in programming a variety of interfaces has led to a more intuitive environment for students and instructors who use MOOs.     

IFS: a tool to build application systems

The interpretive frame system (IFS), a tool for building application systems, is presented. IFS separates high-level design and user-interface programming from domain-specific programming. It offers a language suitable for implementing systems of interconnected tasks, simplifies the construction of sophisticated but easy-to-use user interfaces, and increases tool reuse in system construction. A system built with IFs is called a frame system, and it consists of four layers-the user interface, system structure, computational functions, and data architecture-which are described. The IFS language and programming environment are also described. A programming example is given. Reuse and prototyping are discussed     

Interfaces for parallel numerical linear algebra libraries in high level languages

In many high performance engineering and scientific applications there is a need to use parallel software libraries. Researchers behind these applications find it difficult to understand the interfaces to these libraries because they carry arguments that are related to the parallel environment and performance in addition to arguments related to the problem at hand. In this paper we introduce the use of high level user interfaces for ScaLAPACK. Concretely, a Python-based interface to ScaLAPACK is proposed. Numerical experiments comparing traditional programming practices with our proposed approach are presented. These experiments evaluate not only the performance of the Python interfaces but also how user friendlier they are, compared to the original calls, and show that PyScaLAPACK does not hinder the performance deliverance of ScaLAPACK. Finally, an example of a real scientific application code, whose functionality can be prototyped or extended with the use of PyScaLAPACK, is presented.     

EVA: an interactive Web-based collaborative learning environment

In this paper, a Web-based learning environment developed within the project called Virtual Learning Spaces (EVA, in Spanish) is described. The environment is composed of knowledge, collaboration, consulting and experimentation spaces as a collection of agents and conventional software components working over the knowledge domains. All user interfaces are Web pages, generated dynamically by servlets, applets and agents. The article describes theoretical underpinnings, EVA's architecture, implementation of particular software modules and agents, and the application results.     

Innovative User Interfaces in Automation Engineering by Application of Usability Engineering Methods Shown by the Example of a Three-Dimensional Plant Representation

This article is the first of 3 that focus on user-centered design and usability in the field of industrial process control. This article starts with an introduction to this special domain and sets out the need for user-centered design of innovative user interfaces. The MediaPlant research project is then introduced. This project aims to generate innovative user interface solutions for process control. The usability engineering methods presented are well known in relation to office application software and were applied in the course of the project to (a) evaluate the potential and application fields of innovative multimedia technology and 3-dimensional information presentation (described at the end of this article), (b) define innovative user interface building blocks for process control that can be applied across sectors (described in the second article, Komischke & Burmester [this issue]) and (c) develop human-centered user interfaces for controlling paper recycling plants (described in the third article, Epstein & Beu [this issue]).     

Software environment architectures and user interface facilities

The authors discuss the demands and constraints on a user interface management system for a software environment, and the relation between the architecture of the environment and the user interface management system. A model for designing user interface management systems for large extensible environments is presented. This model synthesizes several recent advances in user interfaces and specializes them to the domain of software environments. The model can be applied to a wide variety of environment contexts. A prototype implementation is described     

The design of the user interface for a large physics experiment

The paper describes the experience in developing and supporting the user interface of RFX, one of the large nuclear fusion experiments of the co-ordinated nuclear fusion experiment programme of the European Community. The aim of this work is to present the problems and some possible solutions when developing user interfaces in a scientific environment, especially in large physics experiments. An overview of the current state of interface technology in such an environment is first provided. The control and data acquisition system of the RFX experiment is then introduced and its user interface described in greater detail. Finally, our experience both in maintaining the system interface and in training its users is described.     

SoundWorks: an object-oriented distributed system for digital sound

SoundWorks, an object-oriented distributed system that lets users interactively manipulate sound through a graphical interface, is discussed. The system handles digitally sampled sounds as well as those generated by software and digital signal processing hardware. An overview of the different types of sounds and window interfaces provided by SoundWorks and of the operations that modify these sounds is presented. The high-level architecture and the design of the SoundWorks system the protocol defined between the user interface code and client application, and the sound kernel specification that manages sounds and lines, performs operations on sounds, and interfaces to the digital hardware are described. The NEWS application programming environment, which provided the necessary primitive graphic items for a graphical window-based interface and offered an object-oriented approach for development of the SoundWorks system, is also discussed     

基于智能规划的界面自动生成方法研究

将智能规划方法引入到软件工程中的界面设计与开发领域,提出了一种基于智能规划的界面自动生成方法。应用该方法进行界面设计,可以较好地实现界面设计与代码实现的分离,降低程序的耦合度,并且可以明确界面间的逻辑关系,使开发者可以不用通过手动编程来实现界面先后调用的逻辑顺序。实践证明,该方法可以大大降低界面开发者的工作强度,缩短软件开发周期,节约开发成本。     

Direct Virtual-hand Interface in Robot Assembly Programming

For a long time, robot assembly programming has been produced in two environments: on-line and off-line. On-line robot programming uses the actual robot for the experiments performing a given task; off-line robot programming develops a robot program in either an autonomous system with a high-level task planner and simulation or a 2D graphical user interface linked to other system components. This paper presents a whole hand interface for more easily performing robotic assembly tasks in the virtual tenvironment. The interface is composed of both static hand shapes (states) and continuous hand motions (modes). Hand shapes are recognized as discrete states that trigger the control signals and commands, and hand motions are mapped to the movements of a selected instance in real-time assembly. Hand postures are also used for specifying the alignment constraints and axis mapping of the hand-part coordinates. The basic virtual-hand functions are constructed through the states and modes developing the robotic assembly program. The assembling motion of the object is guided by the user immersed in the environment to a path such that no collisions will occur. The fine motion in controlling the contact and ending position/orientation is handled automatically by the system using prior knowledge of the parts and assembly reasoning. One assembly programming case using this interface is described in detail in the paper.