Vehicle Routing and Production Planning Decision Support Systems: Designing Graphical User Interfaces

Given the inherent complexity of vehicle routing and production planning decision support systems, designing user interfaces for them is challenging and can make a big difference in the usability of these systems. Many heuristic and optimization-oriented systems that have been implemented for this type of problem have failed in part due to a poor graphical user interface. This work proposes an approach that can be applied to improve the design of user interfaces for this type of system and make its implementation easier. The approach is based on tools that were adapted from the FW/SM system for Structured Modeling and commercially available tools, such as Powerbuilder and CPLEX. Two systems that were implemented using this approach, in two different firms, are presented. These systems run on standard PCs under MS Windows, follow the Windows applications design guidelines, and interact with relational database management systems.     

A formal model for plastic human computer interfaces

The considerable and significant progress achieved in the design and development of new interaction devices between man and machine has enabled the emergence of various powerful and efficient input and/or output devices. Each of these new devices brings specific interaction modes.With the emergence of these devices, new interaction techniques and modes arise and new interaction capabilities are offered. New user interfaces need to be designed or former ones need to evolve. The design of so called plastic user interfaces contributes to handling such evolutions. The key requirement for the design of such a user interface is that the new obtained user interface shall be adapted to the application and have, at least, the same behavior as the previous (adapted) one. This paper proposes to address the problem of user interface evolution due to the introduction of new interaction devices and/or new interaction modes. More, precisely, we are interested by the study of the design process of a user interface resulting from the evolution of a former user interface due to the introduction of new devices and/or new interaction capabilities. We consider that interface behaviors are described by labelled transition systems and comparison between user interfaces is handled by an extended definition of the bi-simulation relationship to compare user interface behaviors when interaction modes are replaced by new ones.     

Applying user modeling to human-computer interaction design

Since the early 1980's, intelligent and adaptive systems have appeared and have been written about in a variety of guises. Although there are many differences between such systems as adaptive user interfaces, intelligent help systems and explanation systems, there are many similarities as well. The most notable of these is that they all require user models to be maintained and exploited as part of their designs. Furthermore, they share the same high level architecture. This paper discusses the use of models in human-computer interaction design and offers a common architecture for these adaptive systems. A methodology for the development of these systems is presented.This is based on our experimental work which is reported fully in Jennings, Benyon and Murray, 1991 and Jennings and Benyon, in press)     

Control centric approach in designing scrolling and zooming user interfaces

The dynamic systems approach to the design of continuous interaction interfaces allows the designer to use simulations, and analytical tools to analyse the behaviour and stability of the controlled system alone and when it is coupled with a manual control model of user behaviour. This approach also helps designers to calibrate and tune the parameters of the system before the actual implementation, and in response to user feedback. In this work we provide a dynamic systems interpretation of the coupling of internal states involved in speed-dependent automatic zooming, and test our implementation on a text browser on a Pocket PC instrumented with a tilt sensor. We illustrate simulated and experimental results of the use of the proposed coupled navigation and zooming interface using tilt and touch screen input.     

Rapid Prototyping of Adaptable User Interfaces

User interface adaptation has been proposed in recent years as a means to achieve personalized accessibility and usability of user interfaces. Related user interface architectures, as well as a variety of related development method and tools, have also been elaborated. Admittedly, however, despite the recognized validity of the approach, which has been proved in practice in a series of prototype systems, the wider adoption and uptake of user interface adaptation approaches are still limited. One of the identified obstacles is the complexity intrinsic in designing such interfaces and the need of radically revising the current user interface design practice to account for (a) the alternative designs required for adaptation, (b) the parameters involved in driving adaptations (i.e., selecting among alternatives at a given point during interaction), and (c) the logic of adaptation at runtime. This article proposes a twofold tool-based support strategy for user interface adaptation development, based on (a) an adaptation development toolkit and related widget library, which directly embeds lexical level adaptations into common interactive widgets, and (b) embedding such a library in a common integrated development environment, thus allowing designers to define and view alternative adaptations at design time and create adaptable user interfaces through traditional prototyping. The aforementioned approach has been implemented in the domain of adaptable applications for older users, producing tools that are currently in use in the development of a large suite of interactive applications in various domains. The approach presented in this article is claimed to be the first and so far unique supporting rapid prototyping of adaptable user interfaces, thus minimizing the divergence between typical development practices and user interface adaptation development.     

From user interface design to the support of intelligent and adaptive interfaces: an overhaul of user interface software infrastracture

Research on adaptive interfaces in the past has lacked support from user interface tools which allow interfaces to be easily created and modified. Also, current user interface tools provide no support for user models which can collect task-oriented information about users. Developing an adaptive interface requires a user model and an adaptation strategy. It also, however, requires a user interface which can be adapted. The latter task is often time-consuming, especially in relation to more sophisticated user interfaces.

The paper presents a user interface design environment, UIDE, which has a different software infrastracture. Designers use high-level specifications to create a model of an application and links from the application to various interface components. The model is the heart of all the design and run-time support in UIDE, including automatic dialog sequencing and help generation. UIDE provides automatic support for collecting task-oriented information about users, by the use of its high-level specifications in its application model as a basic construct for a user model. Some examples of adaptive interfaces and adaptive help are presented that use the information that is collectable in UIDE.     

Using Distributable User Interfaces in CSCL In-Situ Classrooms

Distributable user interfaces enable users to distribute user interface interaction objects (i.e. panels, buttons, input fields, checkboxes, etc.) across different displays using a set of distribution primitives to manipulate them in real time. This work presents how this kind of user interfaces facilitates the computer supported collaborative learning in modern classrooms. These classrooms provide teachers and students with display ecosystems consisting of stationary displays, such as smart projectors and smart TVs as well as mobile displays owned by teachers and students, such as smartphones, tablets, and laptops. The distribution of user interface interaction objects enables teachers to modify the user interface interaction objects that are available to students in real time to control and promote the collaboration and participation among them during learning activities. We propose the development of this type of applications using an extension of the CAMELEON reference framework that supports the definition of UI distribution models. The Essay exercise is presented as a case of study where teachers control the collaboration among students by distributing user interface interaction objects.     

A multi-formalism approach for model-based dynamic distribution of user interfaces of critical interactive systems

Evolution in the context of use requires evolutions in the user interfaces even when they are currently used by operators. User Centered Development promotes reactive answers to this kind of evolutions either by software evolutions through iterative development approaches or at runtime by providing additional information to the operators such as contextual help for instance. This paper proposes a model-based approach to support proactive management of context of use evolutions. By proactive management we mean mechanisms in place to plan and implement evolutions and adaptations of the entire user interface (including behaviour) in a generic way. The approach proposed handles both concentration and distribution of user interfaces requiring both fusion of information into a single UI or fission of information into several ones. This generic model-based approach is exemplified on a safety critical system from space domain. It presents how the new user interfaces can be generated at runtime to provide a new user interface gathering in a single place all the information required to perform the task. These user interfaces have to be generated at runtime as new procedures (i.e. sequences of operations to be executed in a semi-autonomous way) can be defined by operators at any time in order to react to adverse events and to keep the space system in operation. Such contextual, activity-related user interfaces complement the original user interfaces designed for operating the command and control system. The resulting user interface thus corresponds to a distribution of user interfaces in a focus+context way improving usability by increasing both efficiency and effectiveness.     

A Semantics-based Approach for the Design and Implementation of Interaction Objects

Although tools for developing graphical user interfaces are becoming increasingly popular, they do not usually highlight precisely which key elements developers should take into account. This still entails considerable expertise in developing user interfaces. In this paper we present an approach to overcome these problems. Our approach is based on a model for interaction objects and a corresponding design space. This is supported by a toolkit where the available interaction objects are initially classified by their semantics whereas in most current toolkits they are investigated by their appearance. This facilitates designers and developers in identifying the interactors needed in order to obtain an Interactive System supporting user tasks.     

SUMLOW: early design‐stage sketching of UML diagrams on an E‐whiteboard

Most visual diagramming tools provide point‐and‐click construction of computer‐drawn diagram elements using a conventional desktop computer and mouse. SUMLOW is a unified modelling language (UML) diagramming tool that uses an electronic whiteboard (E‐whiteboard) and sketching‐based user interface to support collaborative software design. SUMLOW allows designers to sketch UML constructs, mixing different UML diagram elements, diagram annotations, and hand‐drawn text. A key novelty of the tool is the preservation of hand‐drawn diagrams and support for manipulation of these sketches using pen‐based actions. Sketched diagrams can be automatically ‘formalized’ into computer‐recognized and ‐drawn UML diagrams and then exported to a third party CASE tool for further extension and use. We describe the motivation for SUMLOW, illustrate the use of the tool to sketch various UML diagram types, describe its key architecture abstractions and implementation approaches, and report on two evaluations of the toolset. We hope that our experiences will be useful for others developing sketching‐based design tools or those looking to leverage pen‐based interfaces in software applications. Copyright © 2007 John Wiley & Sons, Ltd.     

Neuro-cognitively inspired haptic user interfaces

Haptic systems and devices are a recent addition to multimodal systems. These devices have widespread applications such as surgical simulations, medical and procedural training, scientific visualizations, assistive and rehabilitative devices for individuals who have physical or neurological impediments and assistive devices for individuals who are blind. While the potential of haptics in natural human machine interaction is undisputable, the realization of such means is still a long way ahead. There are considerable research challenges to development of natural haptic interfaces. The study of human tactile abilities is a recent endeavor and many of the available systems still do not incorporate the domain knowledge of psychophysics, biomechanics and neurological elements of haptic perception. Development of smart and effective haptic interfaces and devices requires extensive studies that link perceptual phenomena with measurable parameters and incorporation of such domain knowledge in the engineering of haptic interfaces. This paper presents design, development and usability testing of a neuro-cognitively inspired haptic user interface for individuals who are blind. The proposed system design is inspired by neuro-cognitive basis of haptic perception and incorporates the computational aspects and requirements of multimodal information processing system. Usability testing of the system suggests that a biologically inspired haptic user interfaces may form a powerful paradigm for haptic user interface design.

Shaping user input: a strategy for natural language dialogue design

Traditional approaches to natural language dialogue interface design have adopted ordinary human-human conversation as the model for online human-computer interaction. The attempt to deal with all the subtleties of natural dialogues, such as topic focus, coherence, ellipsis, pronominal reference, etc. has resulted in prototype systems that are enormously complex and computationally expensive.

In a series of experiments^†, we explored ways of minimizing the processing burden of a dialogue system by channeling user input towards a more tractable, though still natural, form of Englishlanguage questions. Through linking a pair of terminals, we presented subjects with two different dialogue styles as a framework for online help in the domain of word-processing. The first dialogue style involved ordinary conversational format. The second style involved a simulation of an automated dialogue system, including apparent processing restrictions and ‘system process messages’ to inform the subject of the steps taken by the system during query analysis. In both cases human tutors played the role of the help system. After each dialogue session, subjects were interviewed to determine their assessments of the naturalness and usability of the dialogue interface.

We found that user input became more tractable to parsing and query analysis as the dialogue style became more formalized, yet the subjective assessment of naturalness and usability remained fairly constant. This suggests that techniques for channeling user input in a dialogue system may be effectively employed to reduce processing demands without compromising the benefits of a natural language interface. Theoretically, this data lends support to the hypothesis that unrestricted human-human conversation is not the most appropriate model for the design of human-computer dialogue interfaces.     

The um toolkit for cooperative user modelling

This paper gives an overview of the um toolkit: the philosophy underlying its design, examples of its use and discussion of the way it deals with some major issues in creating user modelling shells. The um toolkit has been developed to provide support for a variety of cooperative agents. An important element of its cooperativeness is due to its capacity to give users an understanding of their own user models. This paper describes two substantial but very different uses of the toolkit. The first involves a collection of coaching systems that help users learn more about their text editor. Experimental results suggest that the user model is associated with users learning more. The second is a movie advisor that uses a range of tools to construct and refine the user model and to filter a database of movies. Both these systems are built from combining tools in um. The paper describes several of the tools for constructing and refining user models. In addition it describes the user-model viewing tools and the way that these help users ensure their user models are correct. The paper also discusses the two central themes of the um work, the application of a tools approach to the design of a user modelling toolkit and the implications of making the user model accessible to its owner, the person modelled.     

On the interaction between plan recognition and intelligent interfaces

Plan recognition is an active research area in automatic reasoning, as well as a promising approach to engineering interfaces that can exploit models of user's plans and goals. Much research in the field has focused on the development of plan recognition algorithms to support particular user/system interactions, such as found in naturally occurring dialogues. However, two questions have typically remained unexamined: 1) exactly what kind of interface tasks can knowledge of a user's plans be used to support across communication modalities, and 2) how can such tasks in turn constrain development of plan recognition algorithms? In this paper we present a concrete exploration of these issues. In particular, we provide an assessment of plan recognition, with respect to the use of plan recognition in enhancing user interfaces. We clarify how use of a user model containing plans makes interfaces more intelligent and interactive (by providing an intelligent assistant that supports such tasks as advice generation, task completion, context-sensitive responses, error detection and recovery). We then show how interface tasks in turn provide constraints that must be satisfied in order for any plan recognizer to construct and represent a plan in ways that efficiently support these tasks. Finally, we survey how interfaces are fundamentally limited by current plan recognition approaches, and use these limitations to identify and motivate current research. Our research is developed in the context of CHECS, a plan-based design interface.     

Dynamically reconfigurable vision-based user interfaces

We describe a system that supports practical, vision-based user interfaces, addressing the issues of a usable interaction paradigm, support for application developers, and support for application deployment in real-world environments. Interfaces are defined as configurations of predefined interactive widgets that can be moved from one surface to another. Complex interfaces can be dynamically reconfigured, changing both form and location on the fly, because the functional definition of the interface is decoupled from the specification of its location in the environment. We illustrate the power of such an architecture in the context of projected interactive displays.Published online: 13 July 2004     

协作笔式用户界面开发工具研究

笔式用户界面是一种重要的Post-WIMP(window icon menu pointer)界面,它给用户提供了自然的交互方式.然而,当前的笔式用户界面工具箱大多是面向单用户任务的,不能很好地支持协作应用场景.通过对笔式交互特征和协作环境功能需求的分析,设计并实现了一个工具箱CoPen Toolkit,用于支持协作笔式用户界面的开发.它提供了灵活的架构和可扩展的组件,支持笔迹描述、事件处理和网络协作等功能.基于CoPen Toolkit,构造了多个原型系统,实践表明,它能够很好地支持协作笔式用户界面的开发.     

Supporting Cooperation through Customisation: The Tviews Approach

User interfaces for groupware systems rarely reflectthe different requirements for support of theirend-users. Here we present an approach to designingmulti-user interfaces for cooperative systems whichbuilds on previous work from the HCI community in thearea of end-user customisation. Using this approach wehave developed an approach and a system prototype basedon tailorable views, or Tviews, which allows end-usersengaged in group working to configure theircooperative system interfaces to support theirdifferent tasks, preferences and levels of expertise.Tviews are user interface components which can bedragged and dropped over representations ofapplication objects to customise presentation,interaction and event updating properties, and canthemselves be tailored using high-level, incrementalcustomisation techniques. We discuss the implicationsof this work for CSCW system development by referenceto studies of work carried out by the CSCW communitywhich point to a need for more flexible and tailorablesystem interfaces.     

Towards useful and usable interaction design tools: CanonSketch

Despite all the effort dedicated to bringing better User-Centered Design (UCD) tools to market, current studies show that the industry is still dominated by tools that do not support the activities and workstyles of designers. Also, there is a growing need for interaction design tools aimed at software engineers, a problem related to bringing usability into the software engineering processes.

We propose a new workstyle model that can be effectively used to envision, design and evaluate a new generation of innovative interaction and software design tools, aimed at integrating usability and software engineering.

We illustrate the effectiveness of our model by describing a new tool, called CanonSketch, that was built in order to support UCD in terms of the dimensions in our workstyle model. We also describe an evaluation study aimed at contrasting paper prototyping with our tool as well as the level of workstyle support.