The perceived utility of human and automated aids in a visual detection task

Although increases in the use of automation have occurred across society, research has found that human operators often underutilize (disuse) and overly rely on (misuse) automated aids (R. Parasuraman & V. Riley, 1997). Nearly 275 Cameron University students participated in 1 of 3 experiments performed to examine the effects of perceived utility (M. T. Dzindolet, H. P. Beck, L. G. Pierce, & L. A. Dawe, 2001) on automation use in a visual detection task and to compare reliance on automated aids with reliance on humans. Results revealed a bias for human operators to rely on themselves. Although self-report data indicate a bias toward automated aids over human aids, performance data revealed that participants were more likely to disuse automated aids than to disuse human aids. This discrepancy was accounted for by assuming human operators have a "perfect automation" schema. Actual or potential applications of this research include the design of future automateddecision aids and training procedures for operators relying on such aids.     

Misuse of automated decision aids: Complacency, automation bias and the impact of training experience

The present study investigates automation misuse based on complacency and automation bias in interacting with a decision aid in a process control system. The effect of a preventive training intervention which includes exposing participants to rare automation failures is examined. Complacency is reflected in an inappropriate checking and monitoring of automated functions. In interaction with automated decision aids complacency might result in commission errors, i.e., following automatically generated recommendations even though they are false. Yet, empirical evidence proving this kind of relationship is still lacking. A laboratory experiment (N=24) was conducted using a process control simulation. An automated decision aid provided advice for fault diagnosis and management. Complacency was directly measured by the participants’ information sampling behavior, i.e., the amount of information sampled in order to verify the automated recommendations. Possible commission errors were assessed when the aid provided false recommendations. The results provide clear evidence for complacency, reflected in an insufficient verification of the automation, while commission errors were associated with high levels of complacency. Hence, commission errors seem to be a possible, albeit not an inevitable consequence of complacency. Furthermore, exposing operators to automation failures during training significantly decreased complacency and thus represents a suitable means to reduce this risk, even though it might not avoid it completely. Potential applications of this research include the design of training protocols in order to prevent automation misuse in interaction with automated decision aids.     

The role of trust in automation reliance

A recent and dramatic increase in the use of automation has not yielded comparable improvements in performance. Researchers have found human operators often underutilize (disuse) and overly rely on (misuse) automated aids (Parasuraman and Riley, 1997). Three studies were performed with Cameron University students to explore the relationship among automation reliability, trust, and reliance. With the assistance of an automated decision aid, participants viewed slides of Fort Sill terrain and indicated the presence or absence of a camouflaged soldier. Results from the three studies indicate that trust is an important factor in understanding automation reliance decisions. Participants initially considered the automated decision aid trustworthy and reliable. After observing the automated aid make errors, participants distrusted even reliable aids, unless an explanation was provided regarding why the aid might err. Knowing why the aid might err increased trust in the decision aid and increased automation reliance, even when the trust was unwarranted. Our studies suggest a need for future research focused on understanding automation use, examining individual differences in automation reliance, and developing valid and reliable self-report measures of trust in automation.     

Automation-induced monitoring inefficiency: role of display location

Operators can be poor monitors of automation if they are engaged concurrently in other tasks. However, in previous studies of this phenomenon the automated task was always presented in the periphery, away from the primary manual tasks that were centrally displayed. In this study we examined whether centrally locating an automated task would boost monitoring performance during a flight-simulation task consisting of system monitoring, tracking and fuel resource management sub-tasks. Twelve nonpilot subjects were required to perform the tracking and fuel management tasks manually while watching the automated system monitoring task for occasional failures. The automation reliability was constant at 87.5% for six subjects and variable (alternating between 87.5% and 56.25%) for the other six subjects. Each subject completed four 30 min sessions over a period of 2 days. In each automation reliability condition the automation routine was disabled for the last 20 min of the fourth session in order to simulate catastrophic automation failure (0 % reliability). Monitoring for automation failure was inefficient when automation reliability was constant but not when it varied over time, replicating previous results. Furthermore, there was no evidence of resource or speed accuracy trade-off between tasks. Thus, automation-induced failures of monitoring cannot be prevented by centrally locating the automated task.     

Factors affecting performance on a target monitoring task employing an automatic tracker

The experiments in this paper examined the extent to which performance on a task employing an automatic tracker was similar to performance on tasks employing other types of automation that have been studied more extensively. Automated target tracking is being used in many sensor and navigation systems to improve performance and help the operator cope with increased data loads. With many automated systems these goals are not met. In particular, the operator often misses errors made by the automated system and may report no decrease in workload. Several hypotheses have been offered for the operator's failure to monitor an automated system adequately. These include lack of experience with the manual task, a vigilance decrement, complacency, and inappropriate level of automation. The relevance of each of these hypotheses to failure to monitor an automatic tracker adequately was examined. Performance and perceived workload on a target tracking task employing an automatic tracker, in which participants had to detect and then update the position of several targets (e.g. ships) at regular intervals, were measured as a function of number of targets, training with the manual task, experience, and time on task. The results suggested that failure to detect errors made by the automated system was due largely to the lack of visibility of the automation errors relative to other errors. However, complacency could not be ruled out entirely. Unlike some other tasks, the availability of a reliable automatic tracker did lead to a substantial reduction in perceived workload.     

Factors affecting performance on a target monitoring task employing an automatic tracker

The experiments in this paper examined the extent to which performance on a task employing an automatic tracker was similar to performance on tasks employing other types of automation that have been studied more extensively. Automated target tracking is being used in many sensor and navigation systems to improve performance and help the operator cope with increased data loads. With many automated systems these goals are not met. In particular, the operator often misses errors made by the automated system and may report no decrease in workload. Several hypotheses have been offered for the operator's failure to monitor an automated system adequately. These include lack of experience with the manual task, a vigilance decrement, complacency, and inappropriate level of automation. The relevance of each of these hypotheses to failure to monitor an automatic tracker adequately was examined. Performance and perceived workload on a target tracking task employing an automatic tracker, in which participants had to detect and then update the position of several targets (e.g. ships) at regular intervals, were measured as a function of number of targets, training with the manual task, experience, and time on task. The results suggested that failure to detect errors made by the automated system was due largely to the lack of visibility of the automation errors relative to other errors. However, complacency could not be ruled out entirely. Unlike some other tasks, the availability of a reliable automatic tracker did lead to a substantial reduction in perceived workload.     

Automation transparency: implications of uncertainty communication for human-automation interaction and interfaces

Operators of highly automated driving systems may exhibit behaviour characteristic for overtrust issues due to an insufficient awareness of automation fallibility. Consequently, situation awareness in critical situations is reduced and safe driving performance following emergency takeovers is impeded. A driving simulator study was used to assess the impact of dynamically communicating system uncertainties on monitoring, trust, workload, takeovers, and physiological responses. The uncertainty information was conveyed visually using a stylised heart beat combined with a numerical display and users were engaged in a visual search task. Multilevel analysis results suggest that uncertainty communication helps operators calibrate their trust and gain situation awareness prior to critical situations, resulting in safer takeovers. In addition, eye tracking data indicate that operators can adjust their gaze behaviour in correspondence with the level of uncertainty. However, conveying uncertainties using a visual display significantly increases operator workload and impedes users in the execution of non-driving related tasks.

Practitioner Summary: This article illustrates how the communication of system uncertainty information helps operators calibrate their trust in automation and, consequently, gain situation awareness. Multilevel analysis results of a driving simulator study affirm the benefits for trust calibration and highlight that operators adjust their behaviour according to multiple uncertainty levels.     

Experience of automation failures in training: effects on trust,automation bias,complacency and performance

This work examined the effects of operators’ exposure to various types of automation failures in training. Forty-five participants were trained for 3.5 h on a simulated process control environment. During training, participants either experienced a fully reliable, automatic fault repair facility (i.e. faults detected and correctly diagnosed), a misdiagnosis-prone one (i.e. faults detected but not correctly diagnosed) or a miss-prone one (i.e. faults not detected). One week after training, participants were tested for 3?h, experiencing two types of automation failures (misdiagnosis, miss). The results showed that automation bias was very high when operators trained on miss-prone automation encountered a failure of the diagnostic system. Operator errors resulting from automation bias were much higher when automation misdiagnosed a fault than when it missed one. Differences in trust levels that were instilled by the different training experiences disappeared during the testing session.

Practitioner Summary: The experience of automation failures during training has some consequences. A greater potential for operator errors may be expected when an automatic system failed to diagnose a fault than when it failed to detect one.     

The effects of heuristic rule training on operator performance in a simulated process control environment

In complex work environments, the occurrence of novel system states represents a particular challenge for the design of training. This article is concerned with the use of heuristic rules to prepare operators for the management of unfamiliar fault states. An experiment was carried out to examine the effects of heuristic rule training on operator performance and system management behaviour. Thirty-nine trainee operators from the chemical industry took part in the study. They were trained for 4 h on a PC-based simulation of a process control task. Operators in the experimental group received training on heuristic rules while operators in the control group did not. One week later the operators participated in a 70-min testing session. While the results showed that heuristic rules training led to better diagnostic performance, it was also associated with increased operator fatigue and impaired secondary task performance. The implications of the findings for using heuristic rule training are discussed.     

Adaptability of training in simulated process control: knowledge- versus rule-based guidance under task changes and environmental stress

OBJECTIVE: The study examined the adaptability of different types of process control training across changes in task and environmental stress. BACKGROUND: The literature on training leads us to expect greater flexibility for system-based training, as opposed to procedure-based training. However, the stress literature suggests that knowledge-based strategies (making use of executive control) may be more vulnerable under stress conditions. METHOD: Two groups were given 6 hr of training on the Cabin Air Management System (CAMS), a complex, multilevel, PC-based process control task, emphasizing either system knowledge or use of procedures. They were then required to carry out the task for 3 hr (with noise during the middle 1 hr) across a range of both familiar and unfamiliar fault scenarios. RESULTS: For the primary control task, the system-trained group performed better, especially for less familiar and complex faults. However, for lower priority tasks requiring executive control, procedure-trained operators performed better and were less impaired by noise. CONCLUSION: System training was more effective for managing unexpected task events, whereas procedural training was better under noise. The results are interpreted in terms of the rationale for instructing operators in the range of strategies required for effective process skills in complex work environments. APPLICATION: Training methodologies for safety critical applications should aim to develop skill in the use of both procedural and system knowledge strategies. Operators should be trained in the most effective deployment of these strategies during unfamiliar task events and environmental stress and given stress exposure training.     

The effects of heuristic rule training on operator performance in a simulated process control environment

In complex work environments, the occurrence of novel system states represents a particular challenge for the design of training. This article is concerned with the use of heuristic rules to prepare operators for the management of unfamiliar fault states. An experiment was carried out to examine the effects of heuristic rule training on operator performance and system management behaviour. Thirty-nine trainee operators from the chemical industry took part in the study. They were trained for 4 h on a PC-based simulation of a process control task. Operators in the experimental group received training on heuristic rules while operators in the control group did not. One week later the operators participated in a 70-min testing session. While the results showed that heuristic rules training led to better diagnostic performance, it was also associated with increased operator fatigue and impaired secondary task performance. The implications of the findings for using heuristic rule training are discussed.     

A comparison of adaptive and adaptable automation under different levels of environmental stress

The effectiveness of different forms of adaptive and adaptable automation was examined under low- and high-stress conditions, in the form of different levels of noise. Thirty-six participants were assigned to one of the three types of variable automation (adaptive event-based, adaptive performance-based and adaptable serving as a control condition). Participants received 3 h of training on a simulation of a highly automated process control task and were subsequently tested during a 4-h session under noise exposure and quiet conditions. The results for performance suggested no clear benefits of one automation control mode over the other two. However, it emerged that participants under adaptable automation adopted a more active system management strategy and reported higher levels of self-confidence than in the two adaptive control modes. Furthermore, the results showed higher levels of perceived workload, fatigue and anxiety for performance-based adaptive automation control than the other two modes. PRACTITIONER SUMMARY: This study compared two forms of adaptive automation (where the automated system flexibly allocates tasks between human and machine) with adaptable automation (where the human allocates the tasks). The adaptable mode showed marginal advantages. This is of relevance, given that this automation mode may also be easier to design.     

Explicit control of adaptive automation under different levels of environmental stress

This article examines the effectiveness of three different forms of explicit control of adaptive automation under low- and high-stress conditions, operationalised by different levels of noise. In total, 60 participants were assigned to one of three types of automation design (free, prompted and forced choice). They were trained for 4?h on a highly automated simulation of a process control environment, called AutoCAMS. This was followed by a 4-h testing session under noise exposure and quiet conditions. Measures of performance, psychophysiology and subjective reactions were taken. The results showed that all three modes of explicit control of adaptive automation modes were able to attenuate the negative effects of noise. This was partly due to the fact that operators opted for higher levels of automation under noise. It also emerged that forced choice showed marginal advantages over the two other automation modes. Statement of Relevance: This work is relevant to the design of adaptive automation since it emphasises the need to consider the impact of work-related stressors during task completion. During the presence of stressors, different forms of operator support through automation may be required than under more favourable working conditions.     

Automation failures on tasks easily performed by operators undermine trust in automated aids

OBJECTIVE: We tested the hypothesis that automation errors on tasks easily performed by humans undermine trust in automation. BACKGROUND: Research has revealed that the reliability of imperfect automation is frequently misperceived. We examined the manner in which the easiness and type of imperfect automation errors affect trust and dependence. METHOD: Participants performed a target detection task utilizing an automated aid. In Study 1, the aid missed targets either on easy trials (easy miss group) or on difficult trials (difficult miss group). In Study 2, we manipulated both easiness and type of error (miss vs. false alarm). The aid erred on either difficult trials alone (difficult errors group) or on difficult and easy trials (easy miss group; easy false alarm group). RESULTS: In both experiments, easy errors led to participants mistrusting and disagreeing more with the aid on difficult trials, as compared with those using aids that generated only difficult errors. This resulted in a downward shift in decision criterion for the former, leading to poorer overall performance. Misses and false alarms led to similar effects. CONCLUSION: Automation errors on tasks that appear "easy" to the operator severely degrade trust and reliance. APPLICATION: Potential applications include the implementation of system design solutions that circumvent the negative effects of easy automation errors.     

Effects of display design on performance in a simulated ship navigation environment

Although automation is playing an increasing role on the ship's bridge, empirical research on the effectiveness of alternative bridge designs is limited. In this paper, we describe an experimental study of the benefits of integrated information display, using a computerized simulation of a highly automated ship's bridge. The study compared three types of interface design, which presented radar and electronic chart information to the operator in different ways: (a) integrated display, (b) functionally-separate display, and (c) spatially-separate display. Effects were examined in relation to time on watch and scenario complexity. Following extensive training on the task, 39 participants were tested over a 4-h experimental session, during which they encountered a sequence of collision scenarios of varying complexity. Using a dual-task methodology, a range of measures of primary and secondary task performance were taken, together with assessment of information sampling behaviour and subjective operator state (workload, fatigue, anxiety and situation awareness). The results indicated slight navigational advantages of the integrated display over the two alternative display types, although it also incurred higher levels of operator cost, particularly fatigue. There were no marked effects of time on watch, but more complex scenarios were associated with impaired performance, increased workload and reduced situation awareness. Overall, the findings have suggested some benefits of integrating primary information sources in a ship's bridge environment. The study further confirms the value of experimental simulations as tools for investigating design issues for ship's bridge automation.     

Agency modulates interactions with automation technologies

The increasing presence of automation between operators and automated systems tends to disrupt operators from action outcomes, leading them to leave the control loop. The theoretical framework of agency suggests that priming the operator about the system’s upcoming behaviour could help restore an appropriate sense of control and increase user acceptance of what the system is doing. In a series of two experiments, we test whether providing information about what the system is about to do next leads to an increase in the level of user acceptance, concomitant with an increase in control and performance. Using an aircraft supervision task, we demonstrated the benefit of prime messages regarding system acceptance and performance. Taken together, our results indicate that the principles proposed by this framework could be used to improve human–machine interaction and maintain a high level of sense of control in supervisory tasks.

Practitioner Summary: The out-of-the-loop performance problem is a major potential consequence of automation, leaving operators helpless to takeover automation in case of failure. Using an aircraft supervision task, the following article illustrates how the psychological approach of agency can help improving human–system interactions by designing more acceptable and more controllable automated interfaces     

Announcing Automated Lane Changes: Active Vehicle Roll Motions as Feedback for the Driver

ABSTRACT

As supervisor of the automation system during partially automated driving, it is essential for the driver to have a good awareness of the automation to fulfill this new task sufficiently. Therefore, feedback about intentions of the automation, for example lane changes, is crucial. So far, this feedback is mainly presented visually to the driver. Conversely, in this article, feedback for announcing lane changes is realized via active vehicle roll motions. Several designs are implemented in an automated test vehicle and are evaluated in four different driving scenarios on a test track. Totally, 39 participants rated the vehicle roll motions, for example, regarding the items roll direction, intensity, usefulness, and the predictability of the driving behavior. The results show that active roll motions as feedback for announcing automated lane changes should be clearly perceptible and are considered useful, not misleading, and support the drivers regarding their mode/system awareness.     

Relations between complexity,quality and cognitive automation in mixed-model assembly

Modern assembly systems are adapting to the increased mass customization resulting in shorter cycle times, more variants and increased complexity for final assembly operators. More variants require additional support functions targeted for assembly operators to avoid assembly errors. An industrial case study was carried out in order to examine the relations between complexity, quality and cognitive automation. Complexity was quantified by the measure Operator Choice Complexity (OCC). Assembly errors were measured from historical data and cognitive automation was assessed on a task level. Results show that complexity positively correlates with assembly errors and that the usage of cognitive support is low. Over 60% of all tasks in the study were performed based on own experience. Increased usage of cognitive automation is needed in final assembly to minimize the negative effects of complexity.     

Expert decision support system use,disuse, and misuse: a study using the theory of planned behavior

Researchers in the past decade have been actively investigating technology use and disuse among conventional and communications technologies. However, recent advancements in expert systems technology has led to new questions about technology use. Where communications technology, such as e-mail or group collaboration software, facilitates co-evolution of problem solving and decision making among people, expert systems create a transaction between user and computer where ultimately, the computer generates the recommended courses of action. This also differs from conventional decision support tools that merely gather information to inform a human decision maker.This empirical study used theory of planned behavior to formulate hypotheses about the use, disuse, and misuse of an expert system decision support (EDSS) technology. It was found that EDSS use was negatively related to errors, whereas misuse of EDSS was positively related to errors. More positive attitudes and social influences led to increased EDSS use, while perceptions of control had no apparent effect. The interaction of social influences and attitudes had a significant non-linear relationship with EDSS misuse.     

Effects of display design on performance in a simulated ship navigation environment

Although automation is playing an increasing role on the ship's bridge, empirical research on the effectiveness of alternative bridge designs is limited. In this paper, we describe an experimental study of the benefits of integrated information display, using a computerized simulation of a highly automated ship's bridge. The study compared three types of interface design, which presented radar and electronic chart information to the operator in different ways: (a) integrated display, (b) functionally-separate display, and (c) spatially-separate display. Effects were examined in relation to time on watch and scenario complexity. Following extensive training on the task, 39 participants were tested over a 4-h experimental session, during which they encountered a sequence of collision scenarios of varying complexity. Using a dual-task methodology, a range of measures of primary and secondary task performance were taken, together with assessment of information sampling behaviour and subjective operator state (workload, fatigue, anxiety and situation awareness). The results indicated slight navigational advantages of the integrated display over the two alternative display types, although it also incurred higher levels of operator cost, particularly fatigue. There were no marked effects of time on watch, but more complex scenarios were associated with impaired performance, increased workload and reduced situation awareness. Overall, the findings have suggested some benefits of integrating primary information sources in a ship's bridge environment. The study further confirms the value of experimental simulations as tools for investigating design issues for ship's bridge automation.