A survey of usability capability maturity models: implications for practice and research

Improving the position and effectiveness of user-centred design (UCD) in software and product development is a challenge in many companies. One step towards improvements is to carry out a usability capability maturity (UCM) assessment to evaluate the strengths and weaknesses of a development organisation in UCD. While several diverse UCM models have been introduced, little research has been published in the public domain on these models. The paper aims to fill this gap by analysing the main features of the models. The results show that most models represent different approaches – although some of them have the same roots – meaning that understanding one model is not enough to understand the basics of another model. All models can be used for examining the status of UCD in individual development projects. In addition, models provide various means for assessment of the status of UCD in other organisational areas. The level of documentation of models varies a lot, and very few empirical research results exist. Based on the results, implications for practice and research are suggested.     

A survey of usability capability maturity models: implications for practice and research

Improving the position and effectiveness of user-centred design (UCD) in software and product development is a challenge in many companies. One step towards improvements is to carry out a usability capability maturity (UCM) assessment to evaluate the strengths and weaknesses of a development organisation in UCD. While several diverse UCM models have been introduced, little research has been published in the public domain on these models. The paper aims to fill this gap by analysing the main features of the models. The results show that most models represent different approaches - although some of them have the same roots - meaning that understanding one model is not enough to understand the basics of another model. All models can be used for examining the status of UCD in individual development projects. In addition, models provide various means for assessment of the status of UCD in other organisational areas. The level of documentation of models varies a lot, and very few empirical research results exist. Based on the results, implications for practice and research are suggested.     

Contextualising design: Aspects of using usability context analysis and hierarchical task analysis for software design

Usability Context Analysis is part of ISO 9241-11 and, as such, is recommended for use in user-centred design. However, studies involving a critical assessment of usability context analysis within the software domain are scarce; this paper details two small studies that involved the use of usability context analysis (UCA) and hierarchical task analysis (HTA). The first system involved designing a small subsite of a larger website, while the second system was a small database designed as part of an exercise by UK university students. Post-design evaluation suggested that the use of both UCA and HTA, rather than one or the other, was beneficial in gathering and analysing user requirements.     

Contextualising design: Aspects of using usability context analysis and hierarchical task analysis for software design

Usability Context Analysis is part of ISO 9241-11 and, as such, is recommended for use in user-centred design. However, studies involving a critical assessment of usability context analysis within the software domain are scarce; this paper details two small studies that involved the use of usability context analysis (UCA) and hierarchical task analysis (HTA). The first system involved designing a small subsite of a larger website, while the second system was a small database designed as part of an exercise by UK university students. Post-design evaluation suggested that the use of both UCA and HTA, rather than one or the other, was beneficial in gathering and analysing user requirements.     

Internationalization and localization: evaluating and testing a Website for Asian users

The objective of this study was to combine internationalization and localization of Websites and improvement of Website usability with user-centred design methods. This study designed for internationalization and localization of Websites for Asian users, and implemented usability engineering into every phase of Website usability testing, based on the internationalization and localization perspectives of the honeywell.com/your home Website. The first step was to develop the usage scenarios. Three Asian usability specialists carried out one heuristic evaluation session for the current honeywell.com/your home Website. The usability problems were analysed and possible solutions to these problems were discussed. In the next phase, cluster analysis was utilized to test current information architecture. The results provided options for future information architecture development for this Website. Finally, a performance measurement test was conducted to investigate the performance for Asian users. Based on the results, suggestions for improving the Website usability from the localization perspective were provided. The results demonstrate the user-centred design (UCD) approach and stress international and local issues in Website development to Website designers.     

Issues surrounding the user-centred development of a new interactive memory aid

Memory problems are often associated with the ageing process and are one of the commonest effects of brain injury. Electronic memory aids have been successfully used as a compensatory approach to provide reminders to individuals with prospective memory problems. This paper describes the usability issues surrounding the development of a new memory aid rendered on a personal digital assistant (PDA); in addition, it discusses the importance of a user-centred design process for the development of the memory aid and preliminary qualitative findings from interviews and focus groups of disabled or elderly users.     

Key principles for user-centred systems design

The concept of user-centred systems design (UCSD) has no agreed upon definition. Consequently, there is a great variety in the ways it is applied, which may lead to poor quality and poor usability in the resulting systems, as well as misconceptions about the effectiveness of UCSD. The purpose of this paper is to propose a definition of UCSD. We have identified 12 key principles for the adoption of a user-centred development process, principles that are based on existing theory, as well as research in and experiences from a large number of software development projects. The initial set of principles were applied and evaluated in a case study and modified accordingly. These principles can be used to communicate the nature of UCSD, evaluate a development process or develop systems development processes that support a user-centred approach. We also suggest activity lists and some tools for applying UCSD.     

Key principles for user-centred systems design

The concept of user-centred systems design (UCSD) has no agreed upon definition. Consequently, there is a great variety in the ways it is applied, which may lead to poor quality and poor usability in the resulting systems, as well as misconceptions about the effectiveness of UCSD. The purpose of this paper is to propose a definition of UCSD. We have identified 12 key principles for the adoption of a user-centred development process, principles that are based on existing theory, as well as research in and experiences from a large number of software development projects. The initial set of principles were applied and evaluated in a case study and modified accordingly. These principles can be used to communicate the nature of UCSD, evaluate a development process or develop systems development processes that support a user-centred approach. We also suggest activity lists and some tools for applying UCSD.     

Trading off usability and security in user interface design through mental models

The aim of this paper is to establish the foundations for developing a mental model that bridges the gap between usability and security in user-centred designs. To this purpose, a meta-model has been developed to align design features with the users’ requirements through tacit knowledge elicitation. The meta-model describes the combinatorial relationships of Security, Usability and Mental (SUM) and how these components can be used to design a usable and secure system. The SUM meta-model led to the conclusion that there is no antagonism between usability and security. However, the degree of usable security depends on the ability of the designer to capture and implement the user’s tacit knowledge. In fact, the SUM meta-model seeks the dilution of the trading-off effects between security and usability through compensating synergism of the tacit knowledge. A usability security cognitive map has been developed for the major constituents of usability and security to clarify the interactions and their influences on the meta-model stipulations. The three intersecting areas of the three components’ relationships are manipulated to expand the Optimal Equilibrium Solution (OES) (δ) expanse. To put the SUM meta-model into practice, knowledge management principles have been proposed for implementing user-centred security and user-centred design. This is accomplished by using collaborative brainpower from various knowledge constellations to design a system within the user’s current and future perception boundaries. Therefore, different knowledge groups, processes, techniques, tactics and practices have been proposed for knowledge transfer and transformation during the mental model development.     

AHP与FUZZY在软件开发项目风险管理中的综合应用

归纳了软件开发项目的几大常见风险,在此基础上,通过集成层次分析法AHP和模糊综合评判法FUZZY的原理和模型,设计出软件开发项目风险评价的指标体系,并运用Delphi方法,让多名专家对各项指标赋权而得出每个指标的权重,之后通过风险因素U到模糊评判评语集V的模糊映射,得到模糊评估矩阵。最后根据FUZZY理论,运用模糊矩阵的合成运算,对软件开发项目风险进行两级评估,从而构建了集成方法下软件开发项目风险评价的过程和模型。结论对软件开发项目管理者具有实际参考价值。     

The influence of a knowledge-based system on designers' cognitive activities: a study involving professional web designers

Over the last few decades, several usability knowledge-based systems have been developed to provide user interface designers with usability knowledge (e.g. heuristics, usability guidelines, standards). Such systems are intended to assist designers during the design process, and to improve the usability of the user interface being designed. However, the assumption that such systems actually improve the usability of the resulting user interface remains to be demonstrated: virtually no systems have been empirically tested by designers who create products. In order to confirm this assumption, we conducted an experimental study in which professional web designers had to create webpages, either using a knowledge-based system – MetroWeb – or without it. This study was intended to determine the influence of MetroWeb on the professional web designers' cognitive activity, and to find out whether MetroWeb actually assists them to develop a user-centred design. The results show that the web designers did not very often use MetroWeb while designing webpages; however, rather surprisingly, the designers who did use MetroWeb more often exhibited a user-centred activity than those working without MetroWeb. We conclude this paper by discussing these findings, and suggesting future possible ways of research intended to assist designers to adopt a user-centred approach to their activity.     

Identifying organizational barriers—A case study of usability work when developing software in the automation industry

This study investigates connections between usability efforts and organizational factors. This is an important field of research which so far appears to be insufficiently studied and discussed. It illustrates problems when working with software engineering tasks and usability requirements. It deals with a large company that manufactures industrial robots with an advanced user interface, which wanted to introduce usability KPIs, to improve product quality. The situation in the company makes this difficult, due to a combination of organizational and behavioural factors that led to a “wicked problem” that caused conflicts, breakdowns and barriers. Addressing these problems requires a holistic view that places context in the foreground and technological solutions in the background. Developing the right product requires communication and collaboration between multiple stakeholders. The inclusion of end users, who fully understand their own work context, is vital. Achieving this is dependent on organizational change, and management commitment. One step to beginning this change process may be through studying ways to introduce user-centred design processes.     

BIM extension for the sustainability appraisal of conceptual steel design

Contemporary advancements in Information Technology and the efforts from various research initiatives in the AEC industry are showing evidence of progress with the emergence of building information modelling (BIM). BIM presents the opportunity of electronically modelling and managing the vast amount of information embedded in a building project, from its conception to end-of-life. Researchers have been looking at extensions to expand its scope. Sustainability is one such modelling extension that is in need of development. This is becoming pertinent for the structural engineer as recent design criteria have put great emphasis on the sustainability credentials in addition to the traditional criteria of structural integrity, constructability and cost. With the complexity of designs, there are now needs to provide decision support tools to aid in the assessment of the sustainability credentials of design solutions. Such tools would be most beneficial at the conceptual design stage so that sustainability is built into the design solution starting from its inception. The sustainability of buildings is related to life cycle and is measured using indicator-terms such as life cycle costing, ecological footprint and carbon footprint. This paper proposes a modelling framework combining these three indicators in providing sustainability assessments of alternative design solutions based on the economic and environmental sustainability pillars. It employs the principles of feature-based modelling to extract construction-specific information from product models for the purposes of sustainability analysis. A prototype system is implemented using .NET and linked to the BIM enabled software, Revit Structures™. The system appraises alternative design solutions using multi-criteria performance analysis. This work demonstrates that current process and data modelling techniques can be employed to model sustainability related information to inform decisions right from the early stages of structural design. It concludes that the utilized information modelling representations – in the form of a process model, implementation algorithms and object-based instantiations – can capture sustainability related information to inform decisions at the early stages of the structural design process.     

A guide to agile development of interactive software with a “User Objectives”-driven methodology

This paper presents the InterMod methodology. By combining the widely accepted Agile Methods, Model-Driven Developments and User-Centred Design it allows us to develop high-quality interactive applications. As a main characteristic, it plans and organises the software project as a series of iterations that are guided by the User Objectives in an agile and user-centred manner. At each iteration, the software development work can be distributed to different teams according to some developmental and integration activities. Each activity is driven by models that are validated by a multidisciplinary team composed of developers and users. The requirements are incrementally collected and formalised by means of models based on user-centred design. Besides, the Semantically Enriched Human–Computer Interaction model is proposed to speed up project validation. This model enriches a human–computer interaction model with some visual characteristics and the application semantic. Thus, the enriched model provides enough information to generate prototypes so users and developers can easily validate this model. Diagram project is a real case study that is used to illustrate the application of the InterMod methodology through the whole paper.     

软件过程建模方法研究

通过软件开发实践,人们逐步地认识到软件产品的质量在很大程度上依赖于产品开发时所使用的过程.软件过程建模是通过特定的方法对软件过程进行抽象、表示和分析以增加对软件过程的理解,同时,可执行的(enactable)软件过程模型可以直接指导实际软件开发活动,进而规范软件开发行为并最终提高软件质量.为了系统地了解软件过程建模方法研究的现状和最新进展,采用系统评价(systematic review)方法对该领域最近10年的主要研究进行了概括和分析.从一系列的相关研究中,选出来自20 个会议和7 种期刊的72 篇文献,作为系统评价的依据.该系统评价回答了如下关于软件过程建模方法的3 个问题,以便从总体上概括和把握该领域的研究:1) 软件过程建模方法主要基于什么范式;2) 软件过程建模方法研究的主要目的集中在哪些方面;3) 软件过程建模方法的研究有哪些新的趋势.同时,在仔细回顾和分析软件过程建模领域研究现状的基础上,给出了一种多维度的集成化软件过程建模方法.该方法有助于解决过程建模领域所面临的主要问题.     

多通道人机界面设计及应用

人机界面设计和开发已经成为国际计算机界最为活跃的研究方向,多通道交互作为人机界面的一种技术,因为适应"以人为中心"的自然交互准则而得到了迅速发展.在图形用户界面基础上进行多通道设计,提出了"基于剧情的设计"方法,以ATM取款操作为例进行介绍,操作顺序有所改进,相比传统的ATM系统具有更好的易用性.     

Dogmas in the assessment of usability evaluation methods

Usability evaluation methods (UEMs) are widely recognised as an essential part of systems development. Assessments of the performance of UEMs, however, have been criticised for low validity and limited reliability. The present study extends this critique by describing seven dogmas in recent work on UEMs. The dogmas include using inadequate procedures and measures for assessment, focusing on win–lose outcomes, holding simplistic models of how usability evaluators work, concentrating on evaluation rather than on design and working from the assumption that usability problems are real. We discuss research approaches that may help move beyond the dogmas. In particular, we emphasise detailed studies of evaluation processes, assessments of the impact of UEMs on design carried out in real-world systems development and analyses of how UEMs may be combined.     

Avoiding metric monsters: A design metrics approach

Metric monsters are stumbling blocks that prevent software metrics-guided methodologies from attaining product and process improvement. Metric monsters can occur during the identification, collection or application of software metrics. In our research, we have developed and tested our design metrics over a five-year period and have found them to be excellent predictors of error-prone modules. Based on this research, we will identify some of the monsters that occur in the quantitative analyses of software and its development processes, and present our approach in formulating a design metrics model that avoids these monsters. This model consists of software tools, guidelines and actions for the application of software design metrics.     

A structured methodology for comparative evaluation of user interface designs using usability criteria and measures

Previous research in software ergonomics has indicated the importance of evaluating the usability of computer user interfaces. This paper presents a quantitative basis for selecting from among multiple alternative interfaces relative to multiple criteria of usability concern. The proposed model consists of two main phases: the prescreening phase and the evaluation phase. The prescreening phase involves expert judgment-based assessment with qualitative criteria. The first phase uses absolute measurement analytic hierarchy process (AHP) to filter possible alternative interfaces to a reasonable subset. The evaluation phase involves user-based assessment such as user testing, with quantitative criteria. The objective of the second phase is to evaluate a subset of alternatives using objective measures and to select the best alternative. A set of criteria and measures for evaluating the usability of computer software designs is presented. The proposed methodology is demonstrated in the interface design of a database system used to analyze trip cases information of nuclear power plant.Relevance to industry

There is currently a focus on the usability of interactive computer software. Software developers, interface designers or human factors engineers often confront the task of comparative evaluation among systems, versions or interface designs. The proposed methodology provides practitioners with a structured approach to select the best interface based on usability criteria and measures.