A Usability Checklist for the Usability Evaluation of Mobile Phone User Interface

In the last decade, the research of the usability of mobile phones has been a newly evolving area with few established methodologies and realistic practices that ensure capturing usability in evaluation. Thus, there exists growing demand to explore appropriate evaluation methodologies that evaluate the usability of mobile phones quickly as well as comprehensively. This study aims to develop a task-based usability checklist based on heuristic evaluations in views of mobile phone user interface (UI) practitioners. A hierarchical structure of UI design elements and usability principles related to mobile phones were developed and then utilized to develop the checklist. To demonstrate the practical effectiveness of the proposed checklist, comparative experiments were conducted on the usability checklist and usability testing. The majority of usability problems found by usability testing and additional problems were discovered by the proposed checklist. It is expected that the usability checklist proposed in this study could be used quickly and efficiently by usability practitioners to evaluate the mobile phone UI in the middle of the mobile phone development process.     

Content information desired by Chinese users for effective use of information appliances

Many studies have been conducted to determine how to present information on mobile phones in such a way as to enhance usability, but those studies have not considered what information users need for effective decision making. To investigate what users want from mobile phones, we carried out a content preparation study. A questionnaire was constructed based on prior results from website content research, traditional usability studies on consumer electronics, and extensive study on various types of mobile phones; it was completed by 375 Chinese industrial participants. The statistical results revealed nine major factors of mobile phone content: information relating to input/search, functions, operation, multimedia functions, stored files, phone calls, help/service, accessory functions, and messages. Also, users of different ages and genders evidenced different requirements for mobile phone content, especially concerning accessory and multimedia functions. This study suggests guidelines for mobile phone designers targeted at the Chinese market and provides a base for content study of other information appliances.     

Design of Mobile Phones for Older Adults: An Empirical Analysis of Design Guidelines and Checklists for Feature Phones and Smartphones

Design guidelines and checklists are suggested as a useful tool in the development and evaluation of interface design of mobile phones for older adults. Given the intense evolution of mobile phone design, understanding how the design guidelines and checklists have taken into account the advances in mobile phone usability for older adults is important for their correct application and future development. Thus, this study explores the usability dimensions of mobile phone design for older adults and the related changes in terms of time and the type of device (feature phones vs. smartphones) based on an expert coding of the eight mobile phone design guidelines and checklists for older adults published between 2006 and 2014. The results of the expert coding show that design guidelines and checklists most frequently deal with visual and haptic issues (e.g., high contrast, button type, and button size), whilst they hardly ever address various elements of textual interface (e.g., ease of text entry, a button’s feedback, and font type). Over time, the design guidelines and checklists have become more complex in terms of the average number of included usability categories and dimensions. For smartphones, the guidelines, on average, put more emphasis on the screen, touchscreen, text, and exterior related issues, whereas the design guidelines for feature phones stress the usability of the keypad and menus. Besides revealing potential usability dimensions that could be further expanded in the guidelines, this study also highlights the need for research that would empirically validate the design guidelines and checklists in the future.     

The influence of design aesthetics in usability testing: Effects on user performance and perceived usability

This article examined the effects of product aesthetics on several outcome variables in usability tests. Employing a computer simulation of a mobile phone, 60 adolescents (14-17 yrs) were asked to complete a number of typical tasks of mobile phone users. Two functionally identical mobile phones were manipulated with regard to their visual appearance (highly appealing vs not appealing) to determine the influence of appearance on perceived usability, performance measures and perceived attractiveness. The results showed that participants using the highly appealing phone rated their appliance as being more usable than participants operating the unappealing model. Furthermore, the visual appearance of the phone had a positive effect on performance, leading to reduced task completion times for the attractive model. The study discusses the implications for the use of adolescents in ergonomic research.     

Usability risk level evaluation for physical user interface of mobile phone

The mobile phone has become an indispensable device in everyday life. However, many usability problems were generated by the multi-functionality of mobile phones. There was an important increase on the user interface (UI) design and usability. With the introduction of a variety of forms and keypads in mobile phones, the user's need of controllability, grip-stability, and usability were raised in the UI aspect. Therefore, in this study, we investigated the physical user interface (PUI) elements of mobile phones, and defined the degree of usability risk such as key level value, function level value, and grip level value. Also, this study proposed an evaluation framework to quantitatively measure the usability risk in the mobile phone PUI elements. For this, the mobile phone PUI elements were analyzed and classified by key type, function, and form-factor. Hence, in the case study was investigated and evaluated 133 mobile phones in the market by the proposed framework. As a result, the proposed evaluation framework enabled the measurement of the mobile phone usability risk level in the early stages of the concept design. This made possible the prediction of design problems related with the mobile phone PUI.     

Emotional Factors in Advertising Via Mobile Phones

Advertising delivered via mobile phones constitutes a promising approach to marketing because it enables easy targeting, content personalization, and interactive communication. We conducted a laboratory experiment with 48 participants using a 24-item structured questionnaire about important emotional components involved in using mobile phones for advertising. The data revealed 3 factors that explained 63% of the total variance. Factor 1 included activation, restfulness, desire, affection, gratitude, and urgency. Factor 2 included anger, fear, sadness, and irritation. Factor 3 included skepticism and boredom. Stepwise multiple regression analysis indicated that boredom accounted for 45% of the variance in attitudes toward the advertisements. These findings imply that low-intensity negative feelings are important contributors to the success of advertisements presented on mobile phones and that engagingness is the most important emotional component in effective cell phone advertising.     

Comparative studies of perceived vibration strength for commercial mobile phones

A mobile phone, also known as cell phone or hand phone, is among the most popular electrical devices used by people all over the world. The present study examines the vibration perception of mobile phones by co-relating the relevant design parameters such as excitation frequency, and size and mass of mobile phones to the vibration perception survey by volunteers. Five popular commercially available mobile phone models were tested. The main findings for the perception surveys were that higher vibration frequency and amplitude of the peak acceleration would result in stronger vibration perception of the mobile phones. A larger contact surface area with the palms and figures, higher peak acceleration and the associated larger peak inertia force may be the main factors for the relatively higher vibration perception. The future design for the vibration alert of the mobile phones is likely to follow this trend.     

基于云模型的老人手机易用性评估模型研究

目前,老人手机被老年群体广泛使用,但对老人手机易用性评估还尚缺,不利于老人手机研发。针对老人手机易用性评估的问题,提出基于云模型的老人手机易用性评估方法。构建老人手机易用性评估指标体系,并把熵权法和层次分析法相结合来确定各指标间相对权重,利用云模型对指标信息进行评估。实例分析表明该方法可以有效地处理老人手机易用性评估中的不确定度和模糊性,提高易用性评估结果的客观准确性,为老人手机在易用性设计方面提供理论依据。     

The influence of user expertise and phone complexity on performance, ease of use and learnability of different mobile phones

The study focuses on usability, ease of use and learnability of three different mobile phones (Nokia 3210, Siemens C35i, Motorola P7389). The first independent variable refers to the complexity of the menu (depth/breadth of the menu tree) and navigation keys (number/functionality). The Nokia phone had the lowest and the Motorola the highest complexity, with the Siemens phone ranging between them. The second independent variable was user expertise: 30 novices and 30 experts solved six telephone tasks. In order to assess effects of learnability, tasks were presented twice. Differences between the mobile phones regarding effectiveness, efficiency and learnability were found: The best performance was shown by Nokia users. The remaining two phones did not differ significantly, although the most complex phone was superior to the phone of medium complexity which had the lowest performance. Moreover, an effect of expertise was confirmed, though suboptimal interfaces were identified as lessening the advantage of expertise. Specific weaknesses of the tested phones are discussed.     

Examining modality usage in a conversational multimodal application for mobile e-mail access

As Third Generation (3G) networks emerge they provide not only higher data transmission rates but also the ability to transmit both voice and low latency data within the same session. This paper describes the architecture and implementation of a multimodal application (voice and text) that uses natural language understanding combined with a WAP browser to access email messages on a cell phone. We present results from the use of the system by users as part of a laboratory trial that evaluated usage. The user trial also compared the multimodal system with a text-only system that is representative of current products in the market today. We discuss the observed modality issues and highlight implementation problems and usability concerns that were encountered in the trial. Findings indicate that speech was used the majority of the time by participants for both input and navigation even though most of the participants had little or no prior experience with speech systems (yet did have prior experience with text-only access to applications on their phones). To our knowledge this represents the first implementation and evaluation of its kind using this combination of technologies on an unmodified cell phone. Design implications resulting from the study findings and usability issues encountered are presented to inform the design of future conversational multimodal mobile applications.     

The influence of user expertise and phone complexity on performance,ease of use and learnability of different mobile phones

The study focuses on usability, ease of use and learnability of three different mobile phones (Nokia 3210, Siemens C35i, Motorola P7389). The first independent variable refers to the complexity of the menu (depth/breadth of the menu tree) and navigation keys (number/functionality). The Nokia phone had the lowest and the Motorola the highest complexity, with the Siemens phone ranging between them. The second independent variable was user expertise: 30 novices and 30 experts solved six telephone tasks. In order to assess effects of learnability, tasks were presented twice. Differences between the mobile phones regarding effectiveness, efficiency and learnability were found: The best performance was shown by Nokia users. The remaining two phones did not differ significantly, although the most complex phone was superior to the phone of medium complexity which had the lowest performance. Moreover, an effect of expertise was confirmed, though suboptimal interfaces were identified as lessening the advantage of expertise. Specific weaknesses of the tested phones are discussed.     

A survey of what customers want in a cell phone design

The cell phone is an information appliance that has been widely used. It provides instant access to information and makes people more 'connected'. The objective of our study is to investigate the relationship among the design features of the cell phone and identify the most important design features and design factors. In our survey study, we asked 1,006 college students using a 7-point Likert scale structured questionnaire to evaluate their preference of the design features and overall satisfaction of their current cell phone. Nine design factors were derived. Ten cell phone design features and five design factors that significantly impact a user's satisfaction were identified. The most important design features are: the physical appearance, size and menu organisation, which together account for 42% of the total variance of a user's overall satisfaction.     

Examining the impact of cell phone conversations on driving using meta-analytic techniques

OBJECTIVE: The performance costs associated with cell phone use while driving were assessed meta-analytically using standardized measures of effect size along five dimensions. BACKGROUND: There have been many studies on the impact of cell phone use on driving, showing some mixed findings. METHODS: Twenty-three studies (contributing 47 analysis entries) met the appropriate conditions for the meta-analysis. The statistical results from each of these studies were converted into effect sizes and combined in the meta-analysis. RESULTS: Overall, there were clear costs to driving performance when drivers were engaged in cell phone conversations. However, subsequent analyses indicated that these costs were borne primarily by reaction time tasks, with far smaller costs associated with tracking (lane-keeping) performance. Hands-free and handheld phones revealed similar patterns of results for both measures of performance. Conversation tasks tended to show greater costs than did information-processing tasks (e.g., word games). There was a similar pattern of results for passenger and remote (cell phone) conversations. Finally, there were some small differences between simulator and field studies, though both exhibited costs in performance for cell phone use. CONCLUSION: We suggest that (a) there are significant costs to driver reactions to external hazards or events associated with cell phone use, (b) hands-free cell phones do not eliminate or substantially reduce these costs, and (c) different research methodologies or performance measures may underestimate these costs. APPLICATION: Potential applications of this research include the assessment of performance costs attributable to different types of cell phones, cell phone conversations, experimental measures, or methodologies.     

A survey of what customers want in a cell phone design

The cell phone is an information appliance that has been widely used. It provides instant access to information and makes people more ‘connected’. The objective of our study is to investigate the relationship among the design features of the cell phone and identify the most important design features and design factors. In our survey study, we asked 1,006 college students using a 7-point Likert scale structured questionnaire to evaluate their preference of the design features and overall satisfaction of their current cell phone. Nine design factors were derived. Ten cell phone design features and five design factors that significantly impact a user's satisfaction were identified. The most important design features are: the physical appearance, size and menu organisation, which together account for 42% of the total variance of a user's overall satisfaction.     

Turn Your Mobile Into the Ball: Rendering Live Football Game Using Vibration

Vibration offers many potential benefits for the use of mobile phones. In this paper, we propose a new method of rendering live football game on mobile phones using vibration. A mobile phone is “synchronized” with the ball in the real field. By holding the phone, users are able to experience dynamic movements of the ball, to know attacking directions and which team is leading the attack. The usability test of our system shows that vibrotactile display is suitable for rendering live football information on mobile phones by adopting designed coding schemes with a right training process.      

Usability is more valuable predictor than product personality for product choice in human-product physical interaction

Product personality and product usability are two important factors which can influence consumers' product choice. Published literature are available regarding independent impact of product personality and product usability on product choice but no research has been reported so far for understanding their collective influence on product choice. In addition, which factor between usability and product personality contributing more in product choice is still not clear. Current research thus aimed to bridge these research gaps by establishing inter-relationships among product personality, usability and product choice. To achieve this goal, two separate experiments were conducted. Results of first experiment revealed that products having high product usability also possessed strong product personality. Following second experiment, it was observed that solitary influence of product usability on product choice was more than the standalone influence of product personality in human-product physical interaction. Moreover, it unfolded the fact that product usability mediates the influence of product personality towards product choice. Established interrelationships among product personality, usability and product choice, would help designer and ergonomists to decide how product attributes could be manipulated to enhance product personality and/or product usability to ensure product choice.     

A framework for evaluating the usability of mobile phones based on multi-level, hierarchical model of usability factors

As a mobile phone has various advanced functionalities or features, usability issues are increasingly challenging. Due to the particular characteristics of a mobile phone, typical usability evaluation methods and heuristics, most of which are relevant to a software system, might not effectively be applied to a mobile phone. Another point to consider is that usability evaluation activities should help designers find usability problems easily and produce better design solutions. To support usability practitioners of the mobile phone industry, we propose a framework for evaluating the usability of a mobile phone, based on a multi-level, hierarchical model of usability factors, in an analytic way. The model was developed on the basis of a set of collected usability problems and our previous study on a conceptual framework for identifying usability impact factors. It has multi-abstraction levels, each of which considers the usability of a mobile phone from a particular perspective. As there are goal-means relationships between adjacent levels, a range of usability issues can be interpreted in a holistic as well as diagnostic way. Another advantage is that it supports two different types of evaluation approaches: task-based and interface-based. To support both evaluation approaches, we developed four sets of checklists, each of which is concerned, respectively, with task-based evaluation and three different interface types: Logical User Interface (LUI), Physical User Interface (PUI) and Graphical User Interface (GUI). The proposed framework specifies an approach to quantifying usability so that several usability aspects are collectively measured to give a single score with the use of the checklists. A small case study was conducted in order to examine the applicability of the framework and to identify the aspects of the framework to be improved. It showed that it could be a useful tool for evaluating the usability of a mobile phone. Based on the case study, we improved the framework in order that usability practitioners can use it more easily and consistently.     

Understanding of website usability: Specifying and measuring constructs and their relationships

Developing a usable website is pivotal for e-business success. Researchers have devoted effort to develop metrics, guidelines and theories of website usability, yet there still is a lack of consensus on the multifaceted dimensions of website usability and lack of investigation of the nomological networks among website usability constructs. This study first investigated the common dimensions of website usability by integrating the findings of previous studies and a focus group study with website usability experts. Instruments to measure the constructs were developed and empirically validated. Then nomological networks between website usability constructs and between those constructs and online purchase intention and purchase were examined. Three field studies including two questionnaire surveys and a causal mapping analysis were conducted. The research identified ten website usability constructs with strong psychometric properties. A number of nomological networks between usability constructs were discovered, contributing to identification of sources of variances of purchase intention and purchase behavior. Findings of this study are expected to provide useful insights for practitioners to develop more usable websites and for researchers to better assess the effect of website usability on online customer behavior.     

Application of Evolutionary Neural Networks on Optimization Design of Mobile Phone Based on User's Emotional Needs

Taking users’ emotional needs into consideration, this research aims to propose a new method to present product design features exactly and completely. On the basis of genetic algorithm integrated with back‐propagation (BP) neural networks, taking the mobile phone as research object, an optimization design algorithm was finally designed. First, the continuous and discrete design variables that describe mobile phones were screened with methods of dimensions, coordinate label, and morphological analysis. Forty three‐dimensional (3D) mobile phone models were designed by using 3D design software PROE. Accordingly, 12 representative mobile phones were selected through multidimensional scaling analysis and cluster analysis. Fourteen pairwise Kansei image words were obtained by collecting, screening, surveys, and statistical analysis method. Second, a BP neural networks model between design variables and user preference along with Kansei image words was established and verified with questionnaire survey data. Finally, the optimization design model for mobile phones was established considering design requirements and users’ emotional needs. A genetic algorithm integrated with BP neural networks was used to optimize mobile phone design. The results show that the optimization scheme is superior to others, and this paper will provide design suggestion for mobile phone designers.