Usability evaluation methods for the web: A systematic mapping study

Context

In recent years, many usability evaluation methods (UEMs) have been employed to evaluate Web applications. However, many of these applications still do not meet most customers’ usability expectations and many companies have folded as a result of not considering Web usability issues. No studies currently exist with regard to either the use of usability evaluation methods for the Web or the benefits they bring.

Objective

The objective of this paper is to summarize the current knowledge that is available as regards the usability evaluation methods (UEMs) that have been employed to evaluate Web applications over the last 14 years.

Method

A systematic mapping study was performed to assess the UEMs that have been used by researchers to evaluate Web applications and their relation to the Web development process. Systematic mapping studies are useful for categorizing and summarizing the existing information concerning a research question in an unbiased manner.

Results

The results show that around 39% of the papers reviewed reported the use of evaluation methods that had been specifically crafted for the Web. The results also show that the type of method most widely used was that of User Testing. The results identify several research gaps, such as the fact that around 90% of the studies applied evaluations during the implementation phase of the Web application development, which is the most costly phase in which to perform changes. A list of the UEMs that were found is also provided in order to guide novice usability practitioners.

Conclusions

From an initial set of 2703 papers, a total of 206 research papers were selected for the mapping study. The results obtained allowed us to reach conclusions concerning the state-of-the-art of UEMs for evaluating Web applications. This allowed us to identify several research gaps, which subsequently provided us with a framework in which new research activities can be more appropriately positioned, and from which useful information for novice usability practitioners can be extracted.     

To Score or Not to Score? Tripling Insights for Participatory Design

For evaluating visual-analytics tools, many studies confine to scoring user insights into data. For participatory design of those tools, we propose a three-level methodology to make more out of users' insights. The Relational Insight Organizer (RIO) helps to understand how insights emerge and build on one each other.     

Visual methods for analyzing time-oriented data

Providing appropriate methods to facilitate the analysis of time-oriented data is a key issue in many application domains. In this paper, we focus on the unique role of the parameter time in the context of visually driven data analysis. We will discuss three major aspects - visualization, analysis, and the user. It will be illustrated that it is necessary to consider the characteristics of time when generating visual representations. For that purpose we take a look at different types of time and present visual examples. Integrating visual and analytical methods has become an increasingly important issue. Therefore, we present our experiences in temporal data abstraction, principal component analysis, and clustering of larger volumes of time-oriented data. The third main aspect we discuss is supporting user-centered visual analysis. We describe event-based visualization as a promising means to adapt the visualization pipeline to needs and tasks of users.     

Human cytidine deaminase: a three-dimensional homology model of a tetrameric metallo-enzyme inferred from the crystal structure of a distantly related dimeric homologue

Cytidine deaminase (CDA) is a cytosolic metalloprotein whose functional unit can be either a homotetramer (T-CDA) or a homodimer (D-CDA), depending on the species. In 1994, the first crystal structure of the dimeric Escherichia coli CDA has been published. However, a crystal structure of a tetrameric CDA was not determined until 2002. Prior to the disclosure of the experimentally elucidated structure of a tetrameric CDA, we derived a homology model of the human T-CDA employing the crystal structure of the dimeric E. coli CDA as a template. The comparison of our theoretical model with the crystal structure of the human T-CDA, subsequently published in 2004, validates our prediction: not only of the structural features of the monomer and the details of the binding site, but also the multimeric arrangement of the subunits were determined with high accuracy in our model. By means of a phylogenetic analysis conducted on CDAs from various organisms, we demonstrate that the E. coli CDA is one of the furthest known homologues of the human enzyme. Nonetheless, despite the evolutionary distance and, more importantly, the different multimeric arrangement of their functional units, the E. coli CDA proved to have all the necessary information to accurately infer the structure of its human homologue.     

"Very slow" cholangiography in hyperbilirubinemias and in chronic liver diseases]

The "ultra-slow" method for cholangiography in serious icterus due to chronic heptopathy is described. The results are related to different icterus stages. A comparison is drawn between this and conventional methods for examination of the bile ducts, assuming equal degrees of blood bilirubin.     

Thermal performance indicators for refrigerated road vehicles

An experimental evaluation of insulation effectiveness, pull-down times and effectiveness of a mechanical refrigeration unit was performed on five refrigerated panel vans. Additionally, a mapping of temperature variability in the cargo space was carried out during a simulated journey encompassing several door openings. The temperature variability measured in the vans was neither correlated to the effectiveness of the insulation nor the time required to achieve complete cooling of the cargo space. These criteria are common thermal performance indicators used to evaluate refrigerated vehicles in international standards. The efficiency of insulation was correlated to the pull-down times, presenting the possibility of calculating the former as a function of the latter. The temperature variability was correlated with the time required for the unit to recover temperature control after a door opening and the difference between the maximum and minimum temperatures reached during a door opening cycle.     

Recent developments in the understanding of fretting fatigue

Considerable progress has been made in the understanding of fretting fatigue over the last decade. Experiments have become more standardised and carefully controlled and this has provided the data necessary for development of methods for predicting fretting fatigue performance. This paper reviews a number of recent developments, starting with attempts to apply multiaxial initiation criteria to the fretting problem. The importance of the size effect is highlighted and an analogy is made between fretting and notch fatigue. Methods for characterising crack initiation using asymptotic analysis are discussed, together with short crack arrest concepts which provide a means of predicting fretting fatigue limits from plain fatigue data.     

The Role of the Prefrontal Cortex in the Maintenance of Verbal Working Memory: An Event-Related fMRI Analysis.

Neuroimaging studies have been inconclusive in characterizing the role of the prefrontal cortex (PFC) for maintaining increasingly larger amounts of information in working memory (WM). To address this question, the authors collected event-related functional MRI data while participants performed an item-recognition task in which the number of to-be-remembered letters was parametrically modulated. During maintenance of information in WM, the dorsolateral and the ventrolateral PFC exhibited linearly increasing activation in response to increasing WM load. Prefrontal regions could not be distinguished from one another on the basis of load sensitivity, but the dorsolateral PFC had stronger functional connectivity with the parietal and motor cortex than the ventrolateral PFC. These results suggest an increasingly important role for the PFC in actively maintaining information as the amount of that information increases. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Trends in ecstasy use in the United States from 1995 to 2001: Comparison with marijuana users and association with other drug use.

This study aims to estimate changes in the prevalence of ecstasy use over time, analyze the overlap of ecstasy use and other drug use, and compare other drug use in ecstasy versus marijuana users. The authors hypothesized that ecstasy users early in the "epidemic" would be polydrug users and that associations between ecstasy and other drug use would diminish as the prevalence of ecstasy use increased. Data were drawn from public use data files from the 1995, 1997, 1999, and 2001 National Household Survey on Drug Abuse. Ecstasy use increased in the U.S. population and the prevalence was greater in younger age groups. Ecstasy users were likely to use a variety of other drugs; however, association of ecstasy use with other drug use was strongest early in the "epidemic," diminishing as the number of new users increased. Later, more drug-naive adolescents and young adults began experimenting with ecstasy. These results can orient prevention strategies that target ecstasy users. (PsycINFO Database Record (c) 2010 APA, all rights reserved)