High and low spatial frequencies in website evaluations

Statement of Relevance:

Which features of websites are important for users' perceptions regarding aesthetics or usability? This study investigates how evaluations of aesthetic appeal and usability depend on high vs. low spatial frequencies. High spatial frequencies convey information on fine details, whereas low spatial frequencies convey information about the global layout. Participants rated aesthetic appeal and usability of 50 website screenshots from different domains. Screenshots were presented unfiltered, low-pass filtered with blurred targets or high-pass filtered with high-pass filtered targets. The main result is that low spatial frequencies can be seen to have a unique contribution in perceived website aesthetics, thus confirming a central prediction from processing fluency theory. There was no connection between low spatial frequencies and usability evaluations, whereas strong correlations were found between ratings of high-pass filtered websites and those of unfiltered websites in aesthetics and usability. This study thus offers a new perspective on the biological basis of users' website perceptions.

This research links ergonomics to neurocognitive models of visual processing. This paper investigates how high and low spatial frequencies, which are neurologically processed in different visual pathways, independently contribute to users' perceptions of websites. This is very relevant for theories of website perceptions and for practitioners of web design.     

Effects of accessible website design on nondisabled users: age and device as moderating factors

This study examined how implementing recommendations from Web accessibility guidelines affects nondisabled people in different age groups using different technical devices. While recent research showed positive effects of implementing such recommendations for nondisabled users, it remains unclear whether such effects would apply to different age groups and kind of devices. A 2 × 2 × 2 design was employed with website accessibility (high accessibility vs. very low accessibility), age (younger adults vs. older adults) and type of device (laptop vs. tablet) as independent variables. 110 nondisabled participants took part in a usability test, in which performance and satisfaction were measured as dependent variables. The results showed that higher accessibility increased task completion rate, task completion time and satisfaction ratings of nondisabled users. While user age did not have any effects, users showed faster task completion time under high accessibility when using a tablet rather than a laptop. The findings confirmed previous findings, which showed benefits of accessible websites for nondisabled users. These beneficial effects may now be generalised to a wide age range and across different devices.

Practitioner Summary: This work is relevant to the design of websites since it emphasises the need to consider the characteristics of different user groups. Accessible website design (aimed at users with disabilities) leads to benefits for nondisabled users across different ages. These findings provide further encouragement for practitioners to apply WCAG 2.0.     

The influence of product aesthetics and user state in usability testing

An empirical study examined the effects of two influencing factors in usability tests on user performance and usability ratings. Product aesthetics (high vs. low) as the main independent factor and prior usage event (positive vs. negative) as a subsidiary independent factor were varied in a between-participants design. 60 participants took part in the experiment, completing a number of typical tasks of mobile phone users. The results showed that increased product aesthetics had a positive effect on perceived usability and led to longer task completion times. After a negative usage event had been experimentally induced, usability ratings dropped as expected but user performance on subsequent tasks remained unaffected. An important implication of the study is that the aesthetic properties of a product may have multiple effects that go beyond perceived product attractiveness.     

Is beautiful really usable? Toward understanding the relation between usability,aesthetics, and affect in HCI

This paper analyzes the relation between usability and aesthetics. In a laboratory study, 80 participants used one of four different versions of the same online shop, differing in interface-aesthetics (low vs. high) and interface-usability (low vs. high). Participants had to find specific items and rate the shop before and after usage on perceived aesthetics and perceived usability, which were assessed using four validated instruments. Results show that aesthetics does not affect perceived usability. In contrast, usability has an effect on post-use perceived aesthetics. Our findings show that the “what is beautiful is usable” notion, which assumes that aesthetics enhances the perception of usability can be reversed under certain conditions (here: strong usability manipulation combined with a medium to large aesthetics manipulation). Furthermore, our results indicate that the user’s affective experience with the usability of the shop might serve as a mediator variable within the aesthetics–usability relation: The frustration of poor usability lowers ratings on perceived aesthetics. The significance of the results is discussed in context of the existing research on the relation between aesthetics and usability.     

Expressive and classical aesthetics: two distinct concepts with highly similar effect patterns in user–artefact interaction

This study examined the utility of the concept of expressive aesthetics by testing websites that did or did not match this concept. A website scoring highly on this concept was created and was then compared to websites that were either non-aesthetic or corresponded to the concept of classical aesthetics. Sixty website users of a broad age range (18–60 years) were allocated to three experimental groups (expressive, classical, and non-aesthetic) and asked to complete a series of information search tasks. During the experiment, measures were taken of performance, perceived usability, perceived aesthetics, emotion, and trustworthiness. The results showed that expressive aesthetics can be considered a distinct concept. It also emerged that the website scoring high on expressive aesthetics shows a similar pattern of results to classical aesthetics. Both aesthetically appealing websites received higher ratings of perceived usability and trustworthiness than the non-aesthetic website. The effects of website aesthetics on subjective measures were not moderated by age.     

The influence of design aesthetics in usability testing: Effects on user performance and perceived usability

This article examined the effects of product aesthetics on several outcome variables in usability tests. Employing a computer simulation of a mobile phone, 60 adolescents (14-17 yrs) were asked to complete a number of typical tasks of mobile phone users. Two functionally identical mobile phones were manipulated with regard to their visual appearance (highly appealing vs not appealing) to determine the influence of appearance on perceived usability, performance measures and perceived attractiveness. The results showed that participants using the highly appealing phone rated their appliance as being more usable than participants operating the unappealing model. Furthermore, the visual appearance of the phone had a positive effect on performance, leading to reduced task completion times for the attractive model. The study discusses the implications for the use of adolescents in ergonomic research.     

The role of non-visual aesthetics in consumer product evaluation

The present article addresses the impact of non-visual aesthetics of consumer products on the outcomes of usability tests such as perceived usability, user performance and user affect. Building on the research surrounding the impact of visual aesthetics in usability testing, the present work aimed to determine whether the same pattern of effects repeatedly found for visual aesthetics will also be found for non-visual aesthetics. A series of three experiments was carried out, all examining sound and touch as two prominent dimensions of non-visual aesthetics. To increase the robustness of the results, the experiments were conducted with three different consumer products, which were a smartphone (N=60), vacuum cleaner (N=60), and video racing game (N=60). Although manipulation checks confirmed that users generally experienced both sound and tactile product properties as intended by the experimental manipulation, in none of the studies the results showed an effect on perceived usability. Other outcome variables such as affect and performance showed a few selected effects. Overall, this suggests that findings from the field of visual aesthetics cannot be easily transferred to the domain of non-visual aesthetics. The findings of the present studies are discussed within the framework of Schifferstein’s work on sensory dominance.     

The influence of product aesthetics and usability over the course of time: a longitudinal field experiment

A longitudinal field experiment was carried out over a period of 2 weeks to examine the influence of product aesthetics and inherent product usability. A 2 × 2 × 3 mixed design was used in the study, with product aesthetics (high/low) and usability (high/low) being manipulated as between-subjects variables and exposure time as a repeated-measures variable (three levels). A sample of 60 mobile phone users was tested during a multiple-session usability test. A range of outcome variables was measured, including performance, perceived usability, perceived aesthetics and emotion. A major finding was that the positive effect of an aesthetically appealing product on perceived usability, reported in many previous studies, began to wane with increasing exposure time. The data provided similar evidence for emotion, which also showed changes as a function of exposure time. The study has methodological implications for the future design of usability tests, notably suggesting the need for longitudinal approaches in usability research. PRACTITIONER SUMMARY: This study indicates that product aesthetics influences perceived usability considerably in one-off usability tests but this influence wanes over time. When completing a usability test it is therefore advisable to adopt a longitudinal multiple-session approach to reduce the possibly undesirable influence of aesthetics on usability ratings.     

The Engagement of Website Initial Aesthetic Impressions: An Experimental Investigation

ABSTRACT

This study investigates how website design features, web page order and visual complexity, influence users’ initial website aesthetic impressions and how such impressions subsequently enhance engagement and intention to use the website. A laboratory experiment was conducted to test the hypotheses using different levels of web page order (high vs. low), visual complexity (high vs. low), and exposure time (one-second vs. no-time-constraint). Overall, the results from structural equation modeling (SEM) analysis suggest that web page order significantly influences visual appeal, engagement, and intention. In addition, the results of multigroup SEM analysis reveal that users evaluate website design very quickly (within 1 s), and that these evaluations remain remarkably consistent over time.     

Assessing the performance of short multi-item questionnaires in aesthetic evaluation of websites

In recent years, website aesthetics has received a fair amount of attention from the HCI community. This has led to the creation of a variety of multi-item questionnaires aimed at capturing users’ aesthetic judgments. Researchers have used these questionnaires in several HCI studies to investigate the relationship between aesthetics and other evaluative constructs such as usability. However, their usefulness as evaluation tools in visual design practice remains underexplored. Lengthy multi-item questionnaires can be particularly problematic especially in studies where participants must evaluate multiple designs or when they are required to give responses repeatedly in predefined time intervals. Despite the criticism, single-item scales have been used in many past studies in which questionnaire length could be problematic. Another alternative available to practitioners/researchers are short versions of standardised multi-item questionnaires that have been created for the aesthetic evaluations of websites. In this paper, we present a study in which we compare the performance of three such condensed aesthetic questionnaires (i.e. aesthetics scale, AttrakDiff, VisAWI) during a website redesign project. The short versions of those questionnaires were used by 187 users during an evaluation of 7 alternative website designs. The questionnaires were compared on performance criteria such as reliability, validity, and predictive ability. Data analysis showed that although AttrakDiff’s overall performance was better, a considerable amount of variance in aesthetic judgment could not be accounted for by any of the questionnaires.     

The Impact of Cognitive Style on User Preference Based on Usability and Aesthetics for Computer-Based Systems

Understanding target users is a crucial issue in establishing design and marketing strategies for computer-based applications. To contribute to the comprehension of target users, this study examines the effect of cognitive style (imagers vs. verbalizers) on user preference based on perceived usability and perceived aesthetics through an experiment using four simulated systems with different levels of usability and aesthetics. Forty-two imagers and 31 verbalizers participated in the experiment. The results of the analyses of variance indicated that, before actual use, the effect of the aesthetics factor on user preference was significantly different between imagers and verbalizers but that of the usability factor was not. The difference between imagers and verbalizers with respect to the effect of the aesthetics/usability factor on time performance was not sufficiently demonstrated, nor was the difference between the two cognitive styles with regard to the effect of the aesthetics/usability factor on user preference after actual use. For the combined experimental data of users' responses before and after actual use, the interaction effect between cognitive styles and actual use on user preference was not significant. Some possible reasons for these results and the possibilities of an important role of cognitive style in users' preference making are discussed here. Further studies are necessary to better examine the impact of cognitive style.     

Aesthetics and usability of in-vehicle navigation displays

This research evaluates the aesthetics and usability of various in-vehicle electronic navigation map configurations. Study 1 adapted the aesthetics scale (Lavie and Tractinsky, 2004) to accommodate evaluations of map displays. Study 2 examined map displays that vary in the amount of data presented, their abstraction level and color schema, using objective and subjective usability measures. Maps with minimal detail produced best performances and highest evaluations. Abstractions were found to be advantageous when combined with reduced amount of detail and specific color schemas. Moderate abstractions were sufficient for obtaining the desired benefits. The color schema mainly affected the objective measures, pointing to the importance of good contrast between the cursor and the map colors. Study 3 further examined map schemas. Color schemas again had no effect on the perceptions of aesthetics and usability. Overall, similar results and high correlations were found for the perceived aesthetics and usability scales, indicating the connection between perceived aesthetics and usability. Lower correlations were found between the actual usability (performance) and the aesthetics scale. Finally, users’ usability evaluations were not always in line with their actual performance, pointing to the importance of using objective usability measures.     

The influence of laboratory set-up in usability tests: effects on user performance,subjective ratings and physiological measures

This article examines the influences of situational factors on user behaviour in usability tests. Sixty participants carried out two tasks on a computer-simulated prototype of a mobile phone. Employing a 3 × 2 mixed experimental design, laboratory set-up was varied as a between-subjects variable (presence of facilitator and two non-interactive observers, presence of facilitator or no person present) while task difficulty was manipulated as a within-subjects variable (low vs. high). Performance data, subjective measures and physiological parameters (e.g. heart rate variability) were taken. The results showed that the presence of non-interactive observers during a usability test led to a physiological stress response, decreased performance on some measures and affected the emotional state of test participants. The presence of a facilitator (i.e. a participating observer) also influenced the emotional state of the test participant. Practitioners involved in usability testing need to be aware of undue influences of observers, in particular, if the observers are non-interactive. The findings presented in this paper have implications for the practice of usability testing. They indicated a considerable influence of observers on test participants (physiology and emotions) and on the outcomes of usability tests (performance measures). This should be considered when selecting the set-up of a usability testing procedure.     

Understanding internet recruitment via signaling theory and the elaboration likelihood model

A detailed model specifying the linkages between Internet recruitment websites and organizational attraction was examined. Participants (N = 581) viewed Fortune 500 company websites and responded to questions about the content and design of these websites and their resulting attitudes, fit perceptions, and organizational attraction. Results showed that recruitment website content and design influence attitudes toward the recruitment websites, organizational attitudes, and subsequently organizational attraction. The moderating effects of person-organization (P-O) and person-job (P-J) fit were examined. Two sets of hypotheses based on signaling theory (  and ) and the elaboration likelihood model ( Petty & Cacioppo, 1981) were largely supported. Consistent with signaling theory, the amount of job and organizational information on a recruitment website interacted with website usability, such that when less job information was presented, website usability played a greater role in predicting favorable attitudes towards the organization. Consistent with the elaboration likelihood model, when P-J fit was high, website aesthetics were less important in predicting attitudes towards the organization.     

A comparative evaluation of the wearable augmented reality-based data presentation interface and traditional methods for data entry tasks

Data entry is a ubiquitous task performed in today's offices. Persistent data entry is linked with high workload and fatigue due to poor ergonomic workplace design and poor posture. This study aims to alleviate data entry operators' workload and improve data entry performance by applying wearable augmented reality (AR) technology to data entry tasks. An AR-based interface was developed and used to present data to the participants, who entered the data in web-based data entry forms. A total of eighteen participants performed data entry tasks to evaluate the AR interface with traditional methods – extra desktop monitor and paper-based data presentation methods. Each method's performance was judged on the task completion time, typing error rate, workload, and usability. The usability and overall perceived workload while using an AR interface for data entry were similar to the traditional way of using paper, despite the additional burden due to the weight of the AR headset. AR interface did not perform better than the extra desktop monitor interface for usability and overall perceived workload. The results from this study can be utilized to design AR devices that are suited for data entry tasks.     

The impact of age on website usability

As the general and working populations age in most developed nations, the study of website usability for older adults is becoming increasingly relevant. Website usability is concerned with both utilitarian (i.e. functional) and hedonic (i.e. pleasure-related) aspects. A new website usability model is proposed that considers the effects of age on website usability through cognitive antecedents that are most relevant to age-related effects. Specifically, spatial ability is the declining cognitive skill of particular interest in this research. A laboratory experiment was conducted where younger and older participants interacted with an experimental website. The results suggest that age has a pronounced impact on performance as a mediated effect through declining levels spatial ability and mental model accuracy as well as through a direct effect suggesting the presence of other objective and subjective changes associated with aging that could impact performance. Perceived disorientation was also examined within the proposed website usability model, revealing both expected and surprising findings.     

Effects of design features of train electronic guidance interface on visual search,behavior, and usability

In urban rail trains, traditional printed guide information interfaces are being replaced by digital interfaces. An electronic guide screen is an important device for passengers to obtain information about the ride because the train is running underground. In particular, when the train is crowded, passengers must obtain information in advance and make appropriate decisions. Therefore, it is important to efficiently search for guidance interfaces. In this study, use scenarios of the guidance interface were simulated. The typical information layout and display mode in the current electronic guidance interface were the experimental variables. Through eye tracking and subjective evaluation, the effects of design features on user search performance, visual behavior, and usability satisfaction were discussed. The experimental results showed that the information layout and display mode of the guidance interface had an interactive effect on the task completion time, fixation counts, and usability score; they also had a significant effect on the recall accuracy and saccade ratio. Task completion time had a strong positive correlation with usability satisfaction and was correlated with visual behavior. The study confirmed that the split-screen display mode combined with interlaced layout could improve search performance and subjective satisfaction.Relevance to industryPrinted guide signs in subway cars are being replaced by electronic guide screens of different styles. Passengers must search for the required information within a limited period. In this study, the effects of different interface layouts and display modes on search performance, visual behavior, and usability were studied. This had a positive significance in improving user experience.     

A direct touch table-top display as a multi-user information kiosk: Comparing the usability of a single display groupware either by a single user or people cooperating as a group

This study aimed to investigate the usability of a direct touch table-top display (D3TD) application that was designed to be used as a multi-user information kiosk (MUIK). We examined its use by either a single person or multiple user groups to determine the effect of people cooperating as a group on its usability. We compared both groups’ user performance and usability survey results. A one-way MANOVA of overall usability metrics emphasised a significant difference between the groups. Given the significance of the overall test, examining the univariate main effects revealed that the difference between the groups arose in the earlier system use stages due to differences in the success rate. There was no difference in the task completion time between the groups. Participants in the multiple user group achieved a higher task completion rate in the first phase and lower error rates in the following steps. However, the usability survey results did not reveal a significant difference between the groups. We observed that users working on the same individual task tended to help each other when working in a multi-user environment. These mutual aids occurred mostly in the earlier stages, influencing the users’ performance. The results show that a D3TD has a potential to enhance usability in terms of effectiveness when deployed as a MUIK.     

The influence of the search complexity and the familiarity with the website on the subjective appraisal of aesthetics,mental effort and usability

The user experience is defined as ‘a person's perceptions and responses that result from the use and/or anticipated use of a product, system or service’ (ISO FDIS 9241-210, 2009 ISO FDIS 9241-210, 2009. Ergonomics of human system interaction Ergonomics of human system interaction – Part 210: human-centered design for interactive systems (formerly known as 13407). Switzerland: International Organization for Standardization. [Google Scholar]) [Ergonomics of human system interaction Ergonomics of human system interaction – Part 210: human-centered design for interactive systems (formerly known as 13407). Switzerland: International Organization for Standardization]. Accordingly, some authors have argued that an interactive system has to be evaluated not only with regard to its usability and utility levels, but also with regard to emotional, attractiveness, and aesthetic levels. These last aspects play a substantial role on the general assessment of such systems and on the satisfaction of users. Some studies focused on the immediate aesthetic subjective perception of systems, on their subjective usability and preference perceptions. However, few studies, at least to our knowledge, have been focused on the reverse, that is, on the effect of difficulties experienced by individuals in using systems on the aesthetic appraisal. The present study aimed at determining the role of familiarity level with the website and the search complexity on the search performance and post-experiment appraisals of aesthetics, usability, and mental effort. The main results revealed that the search complexity affected negatively search performance, whereas the familiarity level affected only the re-reading of the search questions. The post-use assessments of aesthetics, mental effort, and usability satisfaction were affected by search performance. In addition, these variables were correlated except the expressive aesthetics, which seemed to be independent from the search performance and other subjective appraisals. Then, we discuss these findings in line with prior studies and present future ways of research.     

Emotional design in multimedia learning: Differentiation on relevant design features and their effects on emotions and learning

Previous research into multimedia learning has mainly focused on cognitive factors to investigate different instructional conditions and design principles. Emotional factors have so far been widely neglected. However, recent studies showed that the emotional design of multimedia learning material can evoke positive emotions in learners that in turn facilitate the learning process. Following this lead, our study aims to further explore the potential of an emotional design. We seek to differentiate the current findings by systematically deducing emotionally relevant design features and also taking into account negative emotional states. In order to deduce relevant design features, we adopt concepts from web design. German college students (N = 334) were assigned to one of nine conditions, created by two design factors (classical vs. expressive aesthetics), each with two levels (high vs. low) and a usability factor (high vs. low usability) as well as a control group (no color/gray scale). Unexpectedly, objective differences in aesthetics or usability did not affect learners’ emotional states. However, the perceived aesthetics and usability positively affected the emotional states of the learners. Learners’ emotional states had a minor impact on learning outcomes but a larger impact on learners’ intrinsic motivation, including the motivation to continue working with the material.