“Beating” Fitts’ law: virtual enhancements for pointing facilitation

We survey recent research into new techniques for artificially facilitating pointing at targets in graphical user interfaces. While pointing in the physical world is governed by Fitts’ law and constrained by physical laws, pointing in the virtual world does not necessarily have to abide by the same constraints, opening the possibility for “beating” Fitts’ law with the aid of the computer by artificially reducing the target distance, increasing the target width, or both. The survey suggests that while the techniques developed to date are promising, particularly when applied to the selection of single isolated targets, many of them do not scale well to the common situation in graphical user interfaces where multiple targets are located in close proximity.     

Towards a standard for pointing device evaluation, perspectives on 27 years of Fitts’ law research in HCI

This paper makes seven recommendations to HCI researchers wishing to construct Fitts’ law models for either movement time prediction, or for the comparison of conditions in an experiment. These seven recommendations support (and in some cases supplement) the methods described in the recent ISO 9241-9 standard on the evaluation of pointing devices. In addition to improving the robustness of Fitts’ law models, these recommendations (if widely employed) will improve the comparability and consistency of forthcoming publications. Arguments to support these recommendations are presented, as are concise reviews of 24 published Fitts’ law models of the mouse, and 9 studies that used the new ISO standard.     

Speed–accuracy tradeoff in Fitts’ law tasks—on the equivalency of actual and nominal pointing precision

Pointing tasks in human–computer interaction obey certain speed–accuracy tradeoff rules. In general, the more accurate the task to be accomplished, the longer it takes and vice versa. Fitts’ law models the speed–accuracy tradeoff effect in pointing as imposed by the task parameters, through Fitts’ index of difficulty (I_d) based on the ratio of the nominal movement distance and the size of the target. Operating with different speed or accuracy biases, performers may utilize more or less area than the target specifies, introducing another subjective layer of speed–accuracy tradeoff relative to the task specification. A conventional approach to overcome the impact of the subjective layer of speed–accuracy tradeoff is to use the a posteriori “effective” pointing precision W_e in lieu of the nominal target width W. Such an approach has lacked a theoretical or empirical foundation. This study investigates the nature and the relationship of the two layers of speed–accuracy tradeoff by systematically controlling both I_d and the index of target utilization I_u in a set of four experiments. Their results show that the impacts of the two layers of speed–accuracy tradeoff are not fundamentally equivalent. The use of W_e could indeed compensate for the difference in target utilization, but not completely. More logical Fitts’ law parameter estimates can be obtained by the W_e adjustment, although its use also lowers the correlation between pointing time and the index of difficulty. The study also shows the complex interaction effect between I_d and I_u, suggesting that a simple and complete model accommodating both layers of speed–accuracy tradeoff may not exist.     

Behind Fitts’ law: kinematic patterns in goal-directed movements

Half a century ago, Paul Fitts first discovered that the time necessary to complete a pointing movement (MT) linearly increases with the amount of information (ID) necessary to specify the target width (W) relative to the distance (D). The so-called Fitts’ law states that , with ID being a logarithmic function of the D/W ratio. With the rising importance of pointing in human–computer interaction, Fitts’ law is nowadays an important tool for the quantitative evaluation of user interface design. We show that changes in ID give rise to systematic changes in the kinematics patterns that determine MT, and provide evidence that the observed patterns result from the interplay between basic oscillatory motion and visual control processes. We also emphasize the generality and abstract nature of Fitts’ robust model of human psychomotor behavior, and suggest that some adaptations in the design of the (computer-mediated) coupling of perception and production of movement might improve the efficiency of the interaction.     

Characterizing computer input with Fitts’ law parameters—the information and non-information aspects of pointing

Throughput (TP), also known as index of performance or bandwidth in Fitts’ law tasks, has been a fundamental metric in quantifying input system performance. The operational definition of TP is varied in the literature. In part thanks to the common interpretations of International Standard ISO 9241-9, the “Ergonomic requirements for office work with visual display terminals—Part 9: Requirements for non-keyboard input devices”, the measurements of throughput have increasingly converged onto the average ratio of index of difficulty (ID) and trial completion time (MT), i.e. TP=ID/MT. In lieu of the complete Fitts’ law regression results that can only be represented by both slope (b) and intercept (a) (or MT=a+b ID), TP has been used as the sole performance characteristic of input devices, which is problematic. We show that TP defined as ID/MT is an ill-defined concept that may change its value with the set of ID values used for the same input device and cannot be generalized beyond specific experimental target distances and sizes. The greater the absolute value of a is, the more variable TP (=ID/MT) is. ID/MT only equals a constant 1/b when a=0. We suggest that future studies should use the complete Fitts’ law regression characterized by (a, b) parameters to characterize an input system. a reflects the non-informational aspect and b the informational aspect of input performance. For convenience, 1/b can be named as throughput which, unlike ID/MT, is conceptually a true constant.     

A human motor behavior model for distal pointing tasks

Models of human motor behavior are well known as an aid in the design of user interfaces (UIs). Most current models apply primarily to desktop interaction, but with the development of non-desktop UIs, new types of motor behaviors need to be modeled. Distal pointing—pointing directly at a target that is remotely situated with respect to the input device—is such a motor behavior. A model of distal pointing would be particularly useful in the comparison of different interaction techniques, because the performance of such techniques is highly dependent on user strategy, making controlled studies difficult to perform. Inspired by Fitts’ law, we studied four possible models and concluded that movement time for a distal pointing task is best described as a function of the angular amplitude of movement and the angular size of the target. Contrary to Fitts’ law, our model shows that the angular size has a much larger effect on movement time than the angular amplitude and that the growth in the difficulty of the tasks is quadratic, rather than linear. We estimated the model's parameters experimentally with a correlation coefficient of 96%.     

The performance of hand postures in front- and back-of-device interaction for mobile computing

Three studies of different mobile-device hand postures are presented. The first study measures the performance of postures in Fitts’ law tasks using one and two hands, thumbs and index fingers, horizontal and vertical movements, and front- and back-of-device interaction. Results indicate that the index finger performs well on both the front and the back of the device, and that thumb performance on the front of the device is generally worse. Fitts’ law models are created and serve as a basis for comparisons. The second study examines the orientation of shapes on the front and back of a mobile device. It shows that participants’ expectations of visual feedback for finger movements on the back of a device reverse the direction of their finger movements to favor a “transparent device” orientation. The third study examines letter-like gestures made on the front and back of a device. It confirms the performance of the index finger on the front of the device, while showing limitations in the ability for the index finger on the back to perform complex gestures. Taken together, these results provide an empirical foundation upon which new mobile interaction designs can be based. A set of design implications and recommendations are given based directly on the findings presented.     

Social facilitation and human–computer interaction

The Computers As Social Actors (CASA) research paradigm has examined how individuals respond to computers programmed to interact in various ways. In the current research, we extend the principles of CASA to determine whether computer icons can be used to produce social facilitation effects. Varying task difficulty and the presence or absence of a computer icon (i.e., Microsoft word’s Clip), performance on a typing task is considered. Overall, results provide some support for the contention that the mere presence of a computer icon may influence task performance.     

Multiscale traveling: crossing the boundary between space and scale

Adding multiscale interaction capabilities to 3D virtual environments may permit work with huge virtual worlds that might otherwise be too large to manage. Multiscale technology has shown potential to support user interactions. This paper reports an experimental study of two multiscale traveling techniques. Our results show that while allowing a flexible control on travel speed and accuracy is beneficial, directly traversing the space-scale could be a challenge for users, probably due to difficulties in perceiving scalable virtual space and executing scaling operations. The results suggest that more research is needed to improve the understanding of the coupling of space and scale in multiscale user interface and to harness the full potentials of multiscale traveling techniques.     

Wireless Face Interface: Using voluntary gaze direction and facial muscle activations for human-computer interaction

The present aim was to investigate the functionality of a new wireless prototype called Face Interface. The prototype combines the use of voluntary gaze direction and facial muscle activations, for pointing and selecting objects on a computer screen, respectively. The subjective and objective functionality of the prototype was evaluated with a series of pointing tasks using either frowning (i.e., frowning technique) or raising the eyebrows (i.e., raising technique) as the selection technique. Pointing task times and accuracies were measured using three target diameters (i.e., 25, 30, 40 mm), seven pointing distances (i.e., 60, 120, 180, 240, 260, 450, and 520 mm), and eight pointing angles (0°, 45°, 90°, 135°, 180°, 225°, 270°, and 315°). The results showed that the raising technique was faster selection technique than the frowning technique for the objects that were presented in the pointing distances from 60 mm to 260 mm. For those pointing distances the overall pointing task times were 2.4 s for the frowning technique, and 1.6 s for the raising technique. Fitts’ law computations showed that the correlations for the Fitts’ law model were r = 0.77 for the frowning technique and r = 0.51 for the raising technique. Further, the index of performance (IP) value was 1.9 bits/s for the frowning technique and 5.4 bits/s for raising the eyebrows technique. Based on the results, the prototype functioned well and was adjustable so that two different facial activations can be used in combination with gaze direction for pointing and selecting objects on a computer screen.     

Developing Multimodal Adaptation Algorithm for Mobility Impaired Users by Evaluating Their Hand Strength

Recent research on interactive electronic systems like computer, digital TV, smartphones can improve the quality of life of many disabled and elderly people by helping them to engage more fully to the world. Previously, a simulator was developed that reflects the effect of impairment on interaction with electronic devices and thus helps designers in developing accessible systems. In this article, the scope of the simulator has been extended to multiple pointing devices. The way that hand strength affects pointing performance of people with and without mobility impairment in graphical user interfaces was investigated for four different input modalities, and a set of linear equations to predict pointing time and average number of submovements for different devices was developed. These models were used to develop an adaptation algorithm to facilitate pointing in electronic interfaces by users with motor impairment using different pointing devices. The algorithm attracts a pointer when it is near a target and thus helps to reduce random movement during homing and clicking. The algorithm was optimized using the simulator and then tested on a real-life application with multiple distractors involving three different pointing devices. The algorithm significantly reduces pointing time for different input modalities.     

Assisting Visually Impaired People to Acquire Targets on a Large Wall-Mounted Display

Large displays have become ubiquitous in our everyday lives, but these displays are designed for sighted people.This paper addresses the need for visually impaired people to access targets on large wall-mounted displays. We developed an assistive interface which exploits mid-air gesture input and haptic feedback, and examined its potential for pointing and steering tasks in human computer interaction（HCI）. In two experiments, blind and blindfolded users performed target acquisition tasks using mid-air gestures and two different kinds of feedback（i.e., haptic feedback and audio feedback）. Our results show that participants perform faster in Fitts＇ law pointing tasks using the haptic feedback interface rather than the audio feedback interface. Furthermore, a regression analysis between movement time（MT） and the index of difficulty（ID）demonstrates that the Fitts＇ law model and the steering law model are both effective for the evaluation of assistive interfaces for the blind. Our work and findings will serve as an initial step to assist visually impaired people to easily access required information on large public displays using haptic interfaces.     

Effects of user age and target-expansion methods on target-acquisition tasks using a mouse

Target expansion, i.e., the increase of target size according to cursor movement, can be a practical scheme to improve the usability of target-selection tasks using a mouse. This study examined the effects of different user age groups and target-expansion methods on target-acquisition tasks with grouped icons. Twenty-eight subjects performed acquisition tasks under eight experimental conditions: combinations of four expansion areas (no, one-icon, fish-eye, and group expansion) and two expansion techniques (occlusion and push). Older users took longer to acquire targets than younger users; however, they showed no significant difference in accuracy. Target expansion did not substantially improve performance speed compared to the static condition. However, the error rate was lowest when group area was expanded with the push technique, and both age groups were most satisfied with one-icon area expansion with the occlusion technique. We suggest alternative guidelines in designing target-expansion schemes.     

A multiscale preconditioner for stochastic mortar mixed finite elements

The aim of this paper is to introduce a new approach to efficiently solve sequences of problems that typically arise when modeling flow in stochastic porous media. The governing equations are based on Darcy’s law with a stochastic permeability field. Starting from a specified covariance relationship, the log permeability is decomposed using a truncated Karhunen–Loève expansion. Multiscale mortar mixed finite element approximations are used in the spatial domain and a nonintrusive sampling method is used in the stochastic dimensions. A multiscale mortar flux basis is computed for a single permeability, called a training permeability, that captures the main characteristics of the porous media, and is used as a preconditioner for each stochastic realization. We prove that the condition number of the preconditioned interface operator is independent of the subdomain mesh size and the mortar mesh size. Computational results confirm that our approach provides an efficient means to quantify the uncertainty for stochastic flow in porous media.     

基于自适应光标的图形用户界面输入效率优化

提高图形用户界面(graphical user interface)的输入效率,是人机交互中的一项重要研究内容.已有的研究包括点击增强技术和自适应界面技术,前者改变光标的控制方式或呈现方式,后者改变界面上控件的位置布局,但两种技术都存在不足.通过分析界面操作,提出了图形用户界面输入效率的评价模型;然后,在此基础上提出一种人机交互效率优化技术:自适应光标.它以自适应的方式,有选择地对界面上用户可能访问的控件通过点击增强技术支持,实现快速访问.该方法既解决了以往的自适应界面技术因频繁调整控件布局而给用户带来额外认知成本的问题,也克服了点击增强技术仅适用于稀疏控件布局的限制.为了检验其可用性,在控件较多的Visual Studio上实现了自适应光标技术.实验结果表明,使用自适应光标技术可以将获取目标的时间缩短27.7％,显著提高了图形用户界面的输入效率.     

A visual shell interface to a database

This paper describes a visual command language for a workstation with a bit-mapped display and a mouse that can be used to create different user interfaces. Primitive interface components can be combined into more complex user interfaces. The user specifies interconnections between these components over which data and commands can be sent by pointing with a mouse. Primitive interface components are described for creating several different database user interfaces. The design and implementation of the software architecture is described, including the primitives for database interfaces and the communication protocols used by the system.     

Taxonomy for characterizing ensemble methods in classification tasks: A review and annotated bibliography

Ensemble methodology, which builds a classification model by integrating multiple classifiers, can be used for improving prediction performance. Researchers from various disciplines such as statistics, pattern recognition, and machine learning have seriously explored the use of ensemble methodology. This paper presents an updated survey of ensemble methods in classification tasks, while introducing a new taxonomy for characterizing them. The new taxonomy, presented from the algorithm designer’s point of view, is based on five dimensions: inducer, combiner, diversity, size, and members’ dependency. We also propose several selection criteria, presented from the practitioner’s point of view, for choosing the most suitable ensemble method.