Representation still matters: cognitive engineering and user interface design

With the increased utilization of cognitive models for designing user interfaces several disciplines started to contribute to acquiring and representing knowledge about users, artifacts, and tasks. Although a wealth of studies already exists on modeling mental processes, and although the goals of cognitive engineering have become quite clear over the last decade, essential epistemological and methodological issues in the context of developing user interfaces have remained untouched. However, recent challenging tasks, namely designing information spaces for distributed user communities, have led to a revival of well known problems concerning the representation of knowledge and related issues, such as abstraction, navigation through information spaces, and visualization of abstract knowledge. All of these issues are associated with mental processes and thus, might become part of cognitive models. In this paper we reveal epistemological and methodological assumptions in the field of cognitive modeling as well as their implications for user interface design. It turns out that in order to achieve the goal of developing human-oriented (in contrast to technology-driven) human-computer interfaces developers have to develop knowledge of the structure and the representational dynamics of the cognitive systems which are interacting with the computer. We show that in a first step it is necessary to study and investigate the different levels and forms of representation that are involved in the interaction processes between computers and human cognitive systems. We propose a hybrid user modeling approach as part of the task-based development procedure in TADEUS (Task Analysis/Design/End User Systems). The hybrid approach does not only enable the representation of functional roles end users have to perform, but also how end users perform these roles, i.e. the representation and reflection, if not prediction of their behavior. This way, holistic system development that equally takes into account the organizational requirements and the end user reality at work places is facilitated.     

Modeling the user's conceptual knowledge in BGP-MS,a user modeling shell system1

The paper describes the modeling of a user's conceptual knowledge in the general user modeling shell system BGP-MS. On the one hand, BGP-MS is a workbench for the develment of a user model in a particular application domain. It supports the definition of the architecture of the individual user model, and of the architecture and the contents of user stereotypes. A rich representation language for conceptual knowledge, a partition mechanism, and flexible graphics-based interfaces are at the disposal of the user model developer. On the other hand, BGP-MS is a runtime user modeling tool aimed at fulfilling central tasks of a user modeling component in an application system. In this mode, the system offers a functional interface for accessing and updating the model of the current user, as well as basic domain-independent inference mechanisms, support for inferences defined by the developer, and a customizable stereotype management utility. The usefulness of BGP-MS will be demonstrated by illustrating how it can support the user modeling of various recently developed application systems.     

The Role of Cognitive Modeling for User Interface Design Representations: An Epistemological Analysis of Knowledge Engineering in the Context of Human-Computer Interaction

In this paper we review some problems with traditional approaches for acquiring and representing knowledge in the context of developing user interfaces. Methodological implications for knowledge engineering and for human-computer interaction are studied. It turns out that in order to achieve the goal of developing human-oriented (in contrast to technology-oriented) human-computer interfaces developers have to develop sound knowledge of the structure and the representational dynamics of the cognitive system which is interacting with the computer.We show that in a first step it is necessary to study and investigate the different levels and forms of representation that are involved in the interaction processes between computers and human cognitive systems. Only if designers have achieved some understanding about these representational mechanisms, user interfaces enabling individual experiences and skill development can be designed. In this paper we review mechanisms and processes for knowledge representation on a conceptual, epistemological, and methodologieal level, and sketch some ways out of the identified dilemmas for cognitive modeling in the domain of human-computer interaction.     

Integrated graphical approach to knowledge representation and acquisition

An approach toward improving the accessbility of the knowledge and information structures of expert systems is described; it is based upon a foundation development environment called the Rule-Based Frame System (RBFS), which forms the kernel of a larger system, IDEAS. RBFS is a knowledge representation language, within which a distinction is drawn between information which represents the world or domain, and knowledge which states how to make conclusions based upon the domain. Information takes the form of frames, for system processing, but is presented to the user/developer as an associative network via a Visual Editor for the Generation of Associative Networks (VEGAN). Knowledge takes the form of production rules, which are connected at suitable points in the domain model, but again it is presented to the user via a graphical interface known as the Knowledge Encoding Tool (KET). KET is designed to assist in knowledge acquisition in expert systems. It uses a combination of decision support trees and associative networks as its representation. A combined use of VEGAN and KET will enable domain experts to interactively create and test their knowledge base with minimum involvement on behalf of a knowledge engineer. An inclusion of learning features in VEGAN/KET is desirable for this purpose. The main objective of these tools, therefore, is to encourage rapid prototyping by the domain expert. VEGAN and KET are implemented in the Poplog environment on SUN 3/50 workstations.     

Model-based automation of the design of user interfaces to digitalcontrol systems

Digital control systems, like those controlling the functions of buildings or industrial processes, pose a number of special problems for good user interface design. The general problems of providing usability, common to all systems, include difficulty in accessing and applying principles of good design. In addition, digital control systems can have multiple users, with multiple roles, and each installation has different configurations of systems, controls, and user interface devices. Providing interactions for the users of building control systems is often achieved by manually implementing each required display. This is an expensive solution, which often produces less than optimal results. We address these problems through the automation of user interface design. Our solution, called DIGBE (dynamic interface generation for building environments), separates the domain knowledge, interaction design, and presentation heuristics into multiple collaborating models. Each model contains knowledge about a particular aspect of interface design, and uses this knowledge to dynamically create each user interface that is needed to support the users of a control system. DIGBE demonstrates that it is possible to automatically and dynamically create consistent and individualized user interfaces from model-based design knowledge     

Modeling decisions under uncertainty in adaptive user interfaces

The present work proposes a methodological approach for modeling adaptation decisions and for solving the problem of integrating existing as well as acquired knowledge in the decision module of an adaptive interface. So far, most applications do not exploit in full the value of data originating from user models or knowledge acquisition engines that monitor the user and the context. The proposed decision theoretic model is represented through specifically structured influence diagrams. It provides to designers and developers a specific method to encode user and context information, as well as other crucial decision factors, to be subsequently used in the decision making process regarding user interface adaptation actions. Such a process is driven by the definition of relevant utilities referring to the design of a user interface. The proposed model guides designers and developers of an adaptive or intelligent interface to integrate, without conflicts and incoherence, design strategies, design goals, user goals, alternative constituents, user profile, context and application domain knowledge. An illustrative example of the analyzed modeling method is presented.

A reasoning method for a ship design expert system

Abstract: The ship design process is a highly data‐oriented, dynamic, iterative and multi‐stage algorithm. It utilizes multiple abstraction levels and concurrent engineering techniques. Specialized techniques for knowledge acquisition, knowledge representation and reasoning must be developed to solve these problems for a ship design expert system. Consequently, very few attempts have been made to model the ship design process using an expert system approach. The current work investigates a knowledge representation–reasoning technique for such a purpose. A knowledge‐based conceptual design was developed by utilizing a prototype approach and hierarchical decompositioning. An expert system program called ALDES (accommodation layout design expert system) was developed by using the CLIPS expert system shell and an object‐oriented user interface. The reasoning and knowledge representation methods of ALDES are explained in the paper. An application of the method is given for the general arrangement design of a containership.     

Evolutionary design of user interfaces for workflow information systems

In this paper we argue that user interface design should evolve from iterative to evolutionary in order to support the user interface development life cycle in a more flexible way. Evolutionary design consists of taking any input that informs to the lifecycle at any level of abstraction and its propagation through inferior and superior levels (vertical engineering) as well as the same level (horizontal engineering). This lifecycle is particularly appropriate when requirements are incomplete, partially unknown or to be discovered progressively. We exemplify this lifecycle by a methodology for developing user interfaces of workflow information systems. The methodology involves several models (i.e., task, process, workflow, domain, context of use) and steps. The methodology applies model-driven engineering to derive concrete user interfaces from a workflow model imported into a workflow management system in order to run the workflow. Instead of completing each model step by step, any model element is either derived from early requirements or collected in the appropriate model before being propagated in the subsequent steps. When more requirements are elicited, any new element is added at the appropriate level, consolidated with the already existing elements, and propagated to the subsequent levels. A workflow editor has been developed to support the methodology.     

An integrated system for knowledge sharing among heterogeneous knowledge derivation systems

Solving problems in a complex application domain often requires a seamles integration of some existing knowledge derivation systems which have been independently developed for solving subproblems using different inferencing schemes. This paper presents the design and implementation of an Integrated Knowledge Derivation System (IKDS) which allows the user to query against a global database containing data derivable by the rules and constraints of a number of cooperative heterogeneous systems. The global knowledge representation scheme, the global knowledge manipulation language and the global knowledge processing mechanism of IKDS are described in detail. For global knowledge representation, the dynamic aspects of knowledge such as derivational relationships and restrictive dependencies among data items are modeled by a Function Graph to uniformly represent the capabilities (or knowledge) of the rule-based systems, while the usual static aspects such as data items and their structural interrelationships are modeled by an object-oriented model. For knowledge manipulation, three types of high-level, exploratory queries are introduced to allow the user to query the global knowledge base. For deriving the best global answers for queries, the global knowledge processing mechanism allows the rules and constraints in different component systems to be indiscriminately exploited despite the incompatibilities in their inferencing mechanisms and interpretation schemes. Several key algorithms required for the knowledge processing mechanism are described in this paper. The main advantage of this integration approach is that rules and constraints can in effect be shared among heterogeneous rule-based systems so that they can freely exchange their data and operate as parts of a single system. IKDS achieves the integration at the rule level instead of at the system level. It has been implemented in C running in a network of heterogenous component systems which contain three independently developed expert systems with different rule formats and inferencing mechanisms.Database Systems Research and Development Center, Department of Computer Information Sciences, Department of Electrical Engineering, University of Florida     

Concept classifier for knowledge acquisition in frame-based systems

Frame-based systems that employ inheritance networks as a form of knowledge representation have a number of inherent knowledge acquisition problems, one of the most significant being the transfer to the representation system of knowledge itself. The problem of concept classification, and specifically that of determining the location of a new concept in an existing network inheritance hierarchy, is discussed here using an experimental knowledge-base editor, KRE. Tools which support the process of knowledge base construction must allow the user to concentrate on the domain problems, and not on low level, representation system decisions. KRE, written in C, is a knowledge acquisition tool which assists the knowledge engineer by using an interactive acquisition strategy during the process of concept classification. The processes of classification, and its advantages over other knowledge representation systems, are presented.     

基于与或逻辑的界面关系模型表示方法

作为用户与系统直接交互的途径,界面设计的好坏将影响用户对系统的第一印象,因此界面设计在软件工程系统设计中十分重要.传统有限状态机在表达复杂的界面状态关系时存在困难.我们引入与或图表示方法来表达初始界面到最终界面的业务流程问题求解过程,建立基于与或逻辑的界面关系模型,并给出模型的逻辑表示,讨论了利用逻辑推理和演绎实现模型语法和语义检查的方法.     

A Domain Knowledge Driven Approach for User Interface Software Development

A domain knowledge driven user interface development approach is described.As a conceptual design of the user interface,the domain knowledge defines the user interface in terms of objects,actions and their relationships that the user would use to interact with the application system.It also serves as input to a user interface management system (UIMS) and is the kernel of the target user interface.The principal ideas and the implementation techniques of the approach is discussed.The user interface model,user interface designer oriented high-level specification notatiopn,and the transformation algorithms on domain knowledge are presented.     

A multi-functional knowledge based system to learn, apply and consult procedures

One of the main challenges facing systems developers is to design systems with the flexibility and adaptability required to satisfy a professional user's needs. This paper presents a novel architecture and a knowledge representation scheme for a multi-functional adaptive system that support professional engineers that work with established procedures. The system achieves its multi-functionality by using a single knowledge representation scheme based on a set of modular networks. The developed representation is exploited by three operators that enable a user to learn, consult different procedures and solve problems. The representation also facilitates the automatic generation of problems and the identification of user errors. The integration of functionalities through a single representation produces a synergy that results in extra-functionality, flexibility and reduces the amount of development effort required. The system adapts to a user by using simple but efficient user modelling techniques that tailor the tutoring information. A rule-based mechanism is used to propose an agenda and a novel rule simplification algorithm is developed to help an expert to develop the rules for proposing the agenda. A prototype was developed and three civil engineering procedures were implemented to evaluate the architecture through scenarios and an empirical evaluation with real engineers.     

Principled Modeling and Automatic Classification for Enhancing the Reusability of Problem Solving Methods of Expert Systems

Software reuse is widely believed to be a key to improving software productivity and quality in conventional software. In expert systems, much of the knowledge has been compiled (i.e., compressed and restricted into effective procedures) and this makes reusability difficult. One of the issues in modeling expert systems for enhanced reusability is capturing explicity the underlying problem solving designs. Principled knowledge representation schemes have been used to model components of complex software systems. However, the potential for applying these principled modeling techniques for explicitly capturing the problem solving designs of expert systems has not been fully explored. To overcome this omission, we use an Artificial Intelligence knowledge representation scheme for developing an ontology of the software components to facilitate their classification and retrieval. The application of our ontological approach is of both theoretical and practical significance. This method facilitates the reuse of high-level design. We illustrate the application of principled domain modeling using two real world applications of knowledge-based systems.     

BioDKM: Bio-inspired domain knowledge modeling method for humanoid delivery robots’ planning

A bio-inspired human domain knowledge modeling method, BioDKM, is proposed and developed to make delivery robots think more humanly and act more effectively. This presented method focused on feasible fusion between artificial intelligent and bionics in the field of tasks planning or scheduling in delivery robots. BioDKM is designed and implemented with several components, in terms of human knowledge, workflow (WF), hierarchical task network (HTN), and planner. In detail, WF is utilized as the human domain knowledge modeling tool, because of its convenient applications, friendly user interface and explicit representation. Moreover, WF can effectively complement conventional HTN planning with great convenience to formalize human domain knowledge. Translation from WF to HTN is also considered and established to make task planning smooth. Finally, examples and simulations are carried out to validate the effectiveness of this proposed bio-inspired domain knowledge modeling method.     

Utilizing vector space models for user modeling within e-learning environments

User modeling has been found to enhance the effectiveness and/or usability of software systems through the representation of certain properties of a particular user. This paper presents the research and the results of the development of a user modeling system for the implementation of student models within e-learning environments, utilizing vector space models. The central challenge has been to exploit the possibilities of IUI research on user models without compromising the performance of the overall system. The research described in this paper has aimed to augment the user interface of an existing e-learning environment with relevant aspects from the domain of intelligent user interfaces, through developing a student modeling component.     

A GUI for Jess

The paper describes JessGUI, a graphical user interface developed on top of the Jess expert system shell. The central idea of the JessGUI project was to make building, revising, updating, and testing Jess-based expert systems easier, more flexible, and more user friendly. There are many other expert system building tools providing a rich and comfortable integrated development environment to expert system builders. However, they are all either commercial or proprietary products. Jess and JessGUI are open-source freeware, and yet they are well suited for building even complex expert system applications, both stand-alone and Web-based ones. An important feature of JessGUI is its capability of saving knowledge bases in XML format (in addition to the original Jess format), thus making them potentially easy to interoperate with other knowledge bases on the Internet. Jess and JessGUI are also used as practical knowledge engineering tools to support both introductory and advanced university courses on expert systems. The paper presents design details of JessGUI, explains its links with the underlying Jess knowledge representation and reasoning tools, and shows examples of using JessGUI in expert system development. It also discusses some of the current efforts in extending Jess/JessGUI in order to provide intelligent features originally not supported in Jess.     

基于web的智能教学系统研究

该文对智能教学系统进行了深入的研究,提出了由用户环境和教学环境组成的基于web的智能教学系统形式化模型,并且对系统运行过程进行了详细的分析。该模型将本体论引入到领域知识的表示中提高了教学资源的重用和共享程度;同时,充分考虑了web以及用户环境所提供的与用户相关信息在智能教学系统中的重要作用。系统基于多领域多应用,结合认知能力、知识水平、学习风格、心理特征等知识结构和认知心理因素来对用户进行建模以增强系统的自适应能力和提高教学效果。