Motion–Display Gain: A New Control–Display Mapping Reflecting Natural Human Pointing Gesture to Enhance Interaction with Large Displays at a Distance

The use of large displays is becoming increasingly prevalent, but development of the usability of three-dimensional (3D) interaction with large displays is still in the early stage. One way to improve the usability of 3D interaction is to develop appropriate control–display (CD) gain function. Nevertheless, unlike in desktop environments, the effects of the relationship between control space and display space in 3D interaction have not been investigated. Moreover, 3D interaction with large displays is natural and intuitive similar to how we work in the physical world. Therefore, a CD gain function that considers human behavior might improve the usability of interaction with large displays. The first experiment was conducted to identify the characteristics of user’s natural hand motion and the user perception of target in distal pointing. Thirty people participated and the characteristics of users’ natural hand movements and the 3D coordinates of their pointing positions were derived. These characteristics were considered in development of motion–display (MD) gain which is a new position-to-position CD mapping. Then, MD gain was experimentally verified by comparing it with Laser pointing, which is currently the best existing CD mapping technique; 30 people participated. MD gain was superior to the existing pointing technique in terms of both performance and subjective satisfaction. MD gain can also be personalized for further improvement. This is an initial attempt to reflect natural human pointing gesture in distal pointing technique, and the developed technique (MD gain) was experimentally proved to be superior to the existing techniques. This achievement is worthy because even a marginal improvement in the performance of pointing task, which is a fundamental and frequent task, can have a large effect on users’ productivity. These results can be used as a resource to understand the characteristics of user’s natural hand movement, and MD gain can be directly applied to situations in which distal pointing is needed, such as interacting with smart TVs or with wall displays. Furthermore, the concept that maps natural human behavior in motor space and an object in visual space can be applied to any interactive system.     

用VRML和Java实现虚拟小区的交互漫游

为了实现虚拟小区的交互漫游,在系统实现过程中采用了几种方式的交互技术,文中对这些交互技术进行了讨论和实现。阐述了在虚拟小区中交互漫游的两种方式,即由用户交互控制视点和由计算机自动控制视点的方式,并对这两种交互漫游方式给出了VRML编码的具体实现;最后采用外部编程接口（EAI）实现了用户界面中的二维平面图和三维场景图的交互。     

基于Quest3D的钻床加工虚拟教学系统的研究

针对培训系统要求人机交互界面好以及沉浸感强等特点,在钻床教学系统开发中采用实时3D建构工具Quest3D,提出了一种针对钻床教学培训的虚拟现实系统的开发方案,将虚拟现实系统分为三维显示模块,运动控制模块,场景交互模块和场景声控模块等,通过Quest3D的图形编程使得整个系统开发周期缩短,运行效率提高。成功将三维场景虚拟交互技术运用于钻床教学培训系统中。     

Toward overcoming culture, skill and situation hurdles in Human-Computer Interaction

This paper proposes a new effective strategy for designing and implementing interactive systems overcoming culture, skill and situation hurdles in Human-Computer Interaction (HCI). The strategy to identify and reduce these hurdles is developed in the framework of a methodology based on a recently introduced model of HCI, and exploits the technological innovations of XML (Extensible Markup Language). HCI is modelled as a cyclic process in which the user and the interactive system communicate by materializing and interpreting a sequence of messages. The interaction process is formalized by specifying both the physical message appearance and the computational aspect of the interaction. This formalization allows the adoption of notation traditionally adopted by users in their workplaces as the starting point of the interactive system design. In this way, the human–system interaction language takes into account the users’ culture. Moreover, the methodology permits user representatives to build a hierarchy of systems progressively adapted to users’ situations, skills and habits, according to the work organization in the domain considered. The strategy is proved to be effective by describing how to implement it using BANCO (Browsing Adaptive Network for Changing user Operativity), a feasibility prototype based on XML, which allows the hierarchy implementation and system adaptations. Several examples from an environmental case under study are used throughout the paper to illustrate the methodology and the effectiveness of the technology adopted. Published online: 4 June 2002     

基于Java 3D的生物大分子模拟可视化系统

本文采用基于Java 3D的三维可视化编程环境,利用Java 3D、Java Applet、Java多线程等技术,开发了一个适于网络环境的生物大分子模拟的可视化系统,有效地解决了网络环境下生物大分子模拟计算中的三维图像的动静态显示、用户交互、进程控制等问题。     

The Usability Construct: A Dead End?

“Usability” is a construct conceived by the human–computer interaction (HCI) community to denote a desired quality of interactive systems and products. Despite its prominence and intensive use in HCI research, the usefulness of the usability construct to HCI theories and to our understanding of HCI has been meager. In this article I propose and discuss two reasons for this state of affairs. The first is that usability is an umbrella construct. Umbrella constructs are prevalent in scientific fields that are broad, diverse, and lack a unifying research paradigm. Accordingly, umbrella constructs, such as usability, tend to be vague and loose, characteristics that challenge our ability to accumulate and communicate knowledge and to capture real-world phenomena. The second reason involves the nature of the relations between the usability construct and its measures, a topic rarely discussed in HCI research. There appears to be a mismatch between how the HCI community has (implicitly) conceptualized these relations and how it has empirically examined them. The relations have been conceptualized according to a formative measurement model but have mostly been tested according to a reflective measurement model. The trouble is that representing the usability construct by the reflective model appears inappropriate, and representing it by the formative model involves considerable difficulties. Possible ways of addressing these issues are discussed, each with its advantages and drawbacks. I conclude that for scientific research on this subject to progress, the usability construct ought to be unbundled and replaced by well-defined constructs. The issues discussed in this article are relevant to other HCI umbrella concepts and constructs such as user experience.     

A tangible goal for 3D modeling

As we progress into applications that incorporate interactive life-like 3D computer graphics, the mouse falls short as a user interface device, and it becomes obvious that 3D computer graphics could achieve much more with a more intuitive user interface mechanism. Haptic interfaces, or force feedback devices, promise to increase the quality of human-computer interaction by accommodating our sense of touch. The article discusses the application of touch feedback systems to 3D modelling. To achieve a high interactivity level requires novel rendering techniques such as volume-based rendering algorithms     

A different way of seeing: Albert Borgmann’s philosophy of technology and human–computer interaction

Traditional human–computer interaction (HCI) allowed researchers and practitioners to share and rely on the ‘five E’s’ of usability, the principle that interactive systems should be designed to be effective, efficient, engaging, error tolerant, and easy to learn. A recent trend in HCI, however, is that academic researchers as well as practitioners are becoming increasingly interested in user experiences, i.e., understanding and designing for relationships between users and artifacts that are for instance affective, engaging, fun, playable, sociable, creative, involving, meaningful, exciting, ambiguous, and curious. In this paper, it is argued that built into this shift in perspective there is a concurrent shift in accountability that is drawing attention to a number of ethical, moral, social, cultural, and political issues that have been traditionally de-emphasized in a field of research guided by usability concerns. Not surprisingly, this shift in accountability has also received scarce attention in HCI. To be able to find any answers to the question of what makes a good user experience, the field of HCI needs to develop a philosophy of technology. One building block for such a philosophy of technology in HCI is presented. Albert Borgmann argues that we need to be cautious and rethink the relationship as well as the often-assumed correspondence between what we consider useful and what we think of as good in technology. This junction—that some technologies may be both useful and good, while some technologies that are useful for some purposes might also be harmful, less good, in a broader context—is at the heart of Borgmann’s understanding of technology. Borgmann’s notion of the device paradigm is a valuable contribution to HCI as it points out that we are increasingly experiencing the world with, through, and by information technologies and that most of these technologies tend to be designed to provide commodities that effortlessly grant our wishes without demanding anything in return, such as patience, skills, or effort. This paper argues that Borgmann’s work is relevant and makes a valuable contribution to HCI in at least two ways: first, as a different way of seeing that raises important social, cultural, ethical, and moral issues from which contemporary HCI cannot escape; and second, as providing guidance as to how specific values might be incorporated into the design of interactive systems that foster engagement with reality.     

A Heuristic Evaluation for Deaf Web User Experience (HE4DWUX)

Websites that are usable and accessible can have a positive impact on the overall user experience. Usability Inspection Methods (UIMs) can be applied to evaluate and measure the usability. The current research in the fields of Web Accessibility and Human –Computer Interaction (HCI) is in need of additional UIMs that can be applied to also measure the accessibility, in addition to the usability alone. In this article, a novel UIM in the form of a heuristic evaluation is presented. The heuristic evaluation aims to support HCI experts and Web developers in designing and evaluating websites that provide positive user experiences to users who are deaf. This article discusses the development of the Heuristic Evaluation for Deaf Web User Experience (HE4DWUX). Following an iteration cycle, version 2 of the HE4DWUX is presented in Appendix A. An existing three-phase process to develop heuristics for specific application domains was applied to construct the HE4DWUX. The outcome of this research is 12 heuristics, with each containing its own set of checklist items to operationalize its applicability in measuring the Web user experience for users who are deaf. The heuristics and their checklist items can identify important aspects of design that will impact the Web user experience for this particular user group.     

Using task analysis to improve usability of fatigue modelling software

The design of any interactive computer system requires consideration of both humans and machines. Software usability is one aspect of human–computer interaction that can benefit from knowledge of the user and their tasks. One set of methods for determining whether an application enables users to achieve their predetermined goals effectively and efficiently is task analysis. In the present study, a task analysis was applied to the graphical user interface of fatigue modelling software used in industry. The task analysis procedure allowed areas of usability improvement to be identified and then addressed with alternate interface prototypes. The present method of task analysis illustrates a practical and efficient way for software designers to improve software usability, user effectiveness and satisfaction, by involving users in the design process.     

Future multimedia user interfaces

No matter how powerful or elegant the technologies underlying multimedia computing, it is the user interface that ultimately determines how these systems will be used. We provide an overview of two emerging areas of user-interface research that will play major roles in future multimedia systems: virtual environments and ubiquitous computing. We discuss what they are and why they are important, and describe their relationship to current multimedia systems. While mouse and window-based user interfaces provide access to 2D graphics, video, and sound, virtual environments not only involve interactive 3D graphics, but further address all our senses through the use of spatial audio, haptics, and other modalities. While it is still a research goal to provide high-throughput video on demand, ubiquitous computing will require that multimedia network infrastructure also support extremely low-latency interaction among large numbers of mobile wireless users. To arrive at an understanding of the needs, capabilities, and potential of these new paradigms, we introduce their terminology and technology, and explain the basic system architectures being explored, leading up to a discussion of key current research issues and future directions.     

协同系统中三维图形渲染的分布式架构

在三维协同系统中,三维图形的渲染效率和传输速度影响到了系统的整体效率。本文采用分布式架构保证三维图形在协同系统中的渲染和传输效率。把渲染好的三维图形以拍照的形式生成图片在网络中传输,打破了传统三维图形渲染对浏览器的限制以及对移动终端消耗巨大资源的局限。服务器端通过建立多线程TCP通信,既保证了用户交互操作的可靠性,同时又避免了多个用户同时操作三维图形时出现的操作二义性。最终实现用户与三维图形的实时交互,从而提高用户体验。      

The quest for appropriate models of human-likeness: anthropomorphism in media equation research

Nass’ and Reeves’ media equation paradigm within human–computer interaction (HCI) challenges long-held assumptions about how users approach computers. Given a rudimentary set of cues present in the system’s design, users are said to unconsciously treat computers as genuine interactants—extending rules of politeness, biases and human interactive conventions to machines. Since the results have wide-ranging implications for HCI research methods, interface design and user experiences, researchers are hard-pressed to experimentally verify the paradigm. This paper focuses on the methodology of attributing the necessary social cues to the agent, a core aspect of the experimental design of studies dealing with the media equation. A typology of experimental anthropomorphisms is developed, allowing an assessment of how the differing axiomatic assumptions affect the relevance of the results for an evaluation of the paradigm. The paper concludes with a series of arguments in favour of one particular anthropomorphism type for researching the media equation.     

Adaptive Hypermedia Techniques for 3D Educational Virtual Environments

Based on a well-known adaptive hypermedia framework, the proposed system creates a 3D educational virtual environment that selects and personalizes interactive learning content for users. In EVEs, users not only see concepts visualized, but they can perform tasks in a suitable fictional world or a real-world reproduction. Moreover, compared to 2D multimedia, using interactive 3D graphics lets developers create representations of subjects or phenomena that are more informative and make it possible for users to analyze a single subject from different viewpoints. In EVEs, adaptivity can play an important role in increasing both learning-process effectiveness and interface usability.     

Mobility as involvement: on the role of involvement in the design of mobile support systems for industrial application

Traditional human–computer interaction (HCI) allowed researchers and practitioners to share and rely on the ‘five E’s’ of usability, the principle that interactive systems should be designed to be effective, efficient, engaging, error tolerant, and easy to learn. A recent trend in HCI, however, is that academic researchers as well as practitioners are becoming increasingly interested in user experiences, i.e., understanding and designing for relationships between users and artifacts that are for instance affective, engaging, fun, playable, sociable, creative, involving, meaningful, exciting, ambiguous, and curious. In this paper, it is argued that built into this shift in perspective there is a concurrent shift in accountability that is drawing attention to a number of ethical, moral, social, cultural, and political issues that have been traditionally de-emphasized in a field of research guided by usability concerns. Not surprisingly, this shift in accountability has also received scarce attention in HCI. To be able to find any answers to the question of what makes a good user experience, the field of HCI needs to develop a philosophy of technology. One building block for such a philosophy of technology in HCI is presented. Albert Borgmann argues that we need to be cautious and rethink the relationship as well as the often-assumed correspondence between what we consider useful and what we think of as good in technology. This junction—that some technologies may be both useful and good, while some technologies that are useful for some purposes might also be harmful, less good, in a broader context—is at the heart of Borgmann’s understanding of technology. Borgmann’s notion of the device paradigm is a valuable contribution to HCI as it points out that we are increasingly experiencing the world with, through, and by information technologies and that most of these technologies tend to be designed to provide commodities that effortlessly grant our wishes without demanding anything in return, such as patience, skills, or effort. This paper argues that Borgmann’s work is relevant and makes a valuable contribution to HCI in at least two ways: first, as a different way of seeing that raises important social, cultural, ethical, and moral issues from which contemporary HCI cannot escape; and second, as providing guidance as to how specific values might be incorporated into the design of interactive systems that foster engagement with reality.     

Navidget for 3D interaction: Camera positioning and further uses

This paper presents an extended version of Navidget. Navidget is a new interaction technique for camera positioning in 3D environments. This technique derives from the point-of-interest (POI) approaches where the endpoint of a trajectory is selected for smooth camera motions. Unlike the existing POI techniques, Navidget does not attempt to automatically estimate where and how the user wants to move. Instead, it provides good feedback and control for fast and easy interactive camera positioning. Navidget can also be useful for distant inspection when used with a preview window. This new 3D user interface is totally based on 2D inputs. As a result, it is appropriate for a wide variety of visualization systems, from small handheld devices to large interactive displays. A user study on TabletPC shows that the usability of Navidget is very good for both expert and novice users. This new technique is more appropriate than the conventional 3D viewer interfaces in numerous 3D camera positioning tasks. Apart from these tasks, the Navidget approach can be useful for further purposes such as collaborative work and animation.     

‘Representing the User’ in software development—a cultural analysis of usability work in the product development context

It is widely accepted that users should be involved in the development of interactive systems. However, involving users in interactive systems development is challenging, especially in product development. The organizational culture is a key factor affecting the successes and failures of organizational change and development efforts. This paper shows how user involvement is intertwined with the organizational cultures in a case study of five software development organizations. User involvement is indirect in the case organizations, and labeled as usability work. Using cross case analysis, four ‘cultures of usability work’ are identified. The cultures have distinct cultural characteristics, employ different approaches to usability work, and have different preferences and strategies for the prospective facilitation of usability work. Sensitivity to the cultural context is identified as an important consideration in the facilitation of usability work, and culturally compatible strategies for usability work in different cultural settings are identified. The paper concludes that there might not be one ‘best, universally valid, context free way’ of introducing and carrying out usability work in software product development organizations.     

基于Unity平台的漫游交互系统的设计

随着网络及计算机技术的发展,3D实景虚拟漫游已经作为一种全新的展示在房产销售中普遍运用。本系统运用了3Dmax、Photoshop、Unity3D软件,参考现实广场小区,创建虚拟场景。为达到预期效果,通过骨骼动画及JavaScript语言实现控制角色移动转向等动作,用户可以对场景自主漫游、浏览,让用户真正沉浸在虚拟交互环境当中,实现用户与虚拟环境直接交互。     

Security and human computer interfaces

Computer users are exposed to technology mainly through user interfaces. Most users' perceptions are based on their experience with these interfaces. HCI (human computer interaction) is concerned with these interfaces and how they can be improved. Considerable research has been conducted and major advances have been made in the area of HCI. Information security is becoming increasingly important and more complex as business is conducted electronically. However, state-of-the-art security-related product development has ignored general aspects of HCI. The objective of this paper is to promote and enable security awareness of end-users in their interaction with computer systems. It thus aims to consolidate and integrate the two fields of information security and HCI. HCI as a research discipline is a well developed field of study, and the authors are of the opinion that the use of security technologies can be significantly enhanced by employing proven HCI concepts in the design of these technologies. In order to achieve this, various criteria for a successful HCI in a security-specific environment will be examined. Part of the Windows XP Internet Connection Firewall will be used as a case study and analysed according to these criteria, and recommendations will be made.     

A Systematic Mapping Study of HCI Practice Research

ABSTRACT

Human–computer interaction (HCI) practice has emerged as a research domain in the HCI field and is growing. The need to transfer HCI practices to the industry began significantly with the works of Nielsen on usability engineering. To date, methods and techniques for designing, evaluating, and implementing interactive systems for human use have continued to emerge. It is, therefore, justified to conduct a systematic mapping study to determine the landscape of HCI practice research. A Systematic Mapping Study method was used to map 142 studies according to research type, topic, and contribution. These were then analyzed to determine an overview of HCI practice research. The objective was to analyze studies on HCI practice and present prominent issues that characterize the HCI practice research landscape. Second, to identify pressing challenges regarding HCI practices in software/systems development companies. The results show that HCI practice research has steadily increased since 2012. The majority of the studies explored focused on evaluation research that largely contributed to the evaluation methods or processes. Most of the studies were on design tools and techniques, design methods and contexts, design work and organizational culture, and collaboration and team communication. Interviews, case studies, and survey methods have been prominently used as research methods. HCI techniques are mostly used during the initial phase of development and during evaluation. HCI practice challenges in companies are mostly process-related and on performance of usability and user experience activities. The major challenge seems to be to find a way to collect and incorporate user feedback in a timely manner, especially in agile processes. There are areas identified in this study as needing more research.