Auditory alerts for in-vehicle information systems: the effects of temporal conflict and sound parameters on driver attitudes and performance

In-vehicle information systems will soon confront drivers with an increasing number of warnings and alerts for situations ranging from imminent collisions to the arrival of e-mail messages. Coordinating these alerts can ensure that they enhance rather than degrade driving safety. Two experiments examined how temporal conflict and sound parameters affect driver performance and acceptance. The temporal conflict of an e-mail alert occurring 300 ms before a collision warning interfered with the response to the collision warning, but an e-mail alert occurring 1000 ms before the collision warning had the opposite effect and enhanced the response to the collision warning. These results emphasize the need to consider how in-vehicle devices influence drivers' strategic anticipation of high-demand situations. Regarding sound parameters, results showed that highly urgent sounds tended to speed drivers' accelerator release, but the annoyance associated with highly urgent sounds increased workload. In fact, there was a strong positive association between ratings of annoyance and subjective workload. Consistent with the urgency mapping principle, there was a slight negative association between the differences in the rated urgency of collision warnings and e-mail alerts and subjective workload. The results suggest that warning and alert design should consider an annoyance trade-off in addition to urgency mapping.     

Alerts for in-vehicle information systems: annoyance, urgency, and appropriateness

OBJECTIVE: This study assesses the influence of the auditory characteristics of alerts on perceived urgency and annoyance and whether these perceptions depend on the context in which the alert is received. BACKGROUND: Alert parameters systematically affect perceived urgency, and mapping the urgency of a situation to the perceived urgency of an alert is a useful design consideration. Annoyance associated with environmental noise has been thoroughly studied, but little research has addressed whether alert parameters differentially affect annoyance and urgency. METHOD: Three 2(3) x 3 mixed within/between factorial experiments, with a total of 72 participants, investigated nine alert parameters in three driving contexts. These parameters were formant (similar to harmonic series), pulse duration, interpulse interval, alert onset and offset, burst duty cycle, alert duty cycle, interburst period, and sound type. Imagined collision warning, navigation alert, and E-mail notification scenarios defined the driving context. RESULTS: All parameters influenced both perceived urgency and annoyance (p < .05), with pulse duration, interpulse interval, alert duty cycle, and sound type influencing urgency substantially more than annoyance. There was strong relationship between perceived urgency and rated appropriateness for high-urgency driving scenarios and a strong relationship between annoyance and rated appropriateness for low-urgency driving scenarios. CONCLUSION: Sound parameters differentially affect annoyance and urgency. Also, urgency and annoyance differentially affect perceived appropriateness of warnings. APPLICATION: Annoyance may merit as much attention as urgency in the design of auditory warnings, particularly in systems that alert drivers to relatively low-urgency situations.     

Use of auditory icons as emergency warnings: evaluation within a vehicle collision avoidance application.

In the context of emergency warnings, auditory icons, which convey information about system events by analogy with everyday events, have the potential to be understood more quickly and easily than abstract sounds. To test this proposal, an experiment was carried out to evaluate the use of auditory icons for an in-vehicle collision avoidance application. Two icons, the sounds of a car horn and of skidding tyres, were compared with two conventional warnings, a simple tone and a voice saying 'ahead'. Participants sat in an experimental vehicle with a road scene projected ahead, and they were required to brake in response to on-screen collision situations and their accompanying warning sounds. The auditory icons produced significantly faster reaction times than the conventional warnings, but suffered from more inappropriate responses, where drivers reacted with a brake press to a non-collision situation. The findings are explained relative to the perceived urgency and inherent meaning of each sound. It is argued that optimal warnings could be achieved by adjusting certain sound attributes of auditory icons, as part of a structured, user-centred design and evaluation procedure.     

Use of auditory icons as emergency warnings: evaluation within a vehicle collision avoidance application

In the context of emergency warnings, auditory icons, which convey information about system events by analogy with everyday events, have the potential to be understood more quickly and easily than abstract sounds. To test this proposal, an experiment was carried out to evaluate the use of auditory icons for an invehicle collision avoidance application. Two icons, the sounds of a car horn and of skidding tyres, were compared with two conventional warnings, a simple tone and a voice saying ‘ahead’. Participants sat in an experimental vehicle with a road scene projected ahead, and they were required to brake in response to on-screen collision situations and their accompanying warning sounds. The auditory icons produced significantly faster reaction times than the conventional warnings, but suffered from more inappropriate responses, where drivers reacted with a brake press to a non-collision situation. The findings are explained relative to the perceived urgency and inherent meaning of each sound. It is argued that optimal warnings could be achieved by adjusting certain sound attributes of auditory icons, as part of a structured, user-centred design and evaluation procedure.     

Verbal collision avoidance messages during simulated driving: perceived urgency, alerting effectiveness and annoyance

Matching the perceived urgency of an alert with the relative hazard level of the situation is critical for effective alarm response. Two experiments describe the impact of acoustic and semantic parameters on ratings of perceived urgency, annoyance and alerting effectiveness and on alarm response speed. Within a simulated driving context, participants rated and responded to collision avoidance system (CAS) messages spoken by a female or male voice (experiments 1 and 2, respectively). Results indicated greater perceived urgency and faster alarm response times as intensity increased from -2 dB signal to noise (S/N) ratio to +10 dB S/N, although annoyance ratings increased as well. CAS semantic content interacted with alarm intensity, indicating that at lower intensity levels participants paid more attention to the semantic content. Results indicate that both acoustic and semantic parameters independently and interactively impact CAS alert perceptions in divided attention conditions and this work can inform auditory alarm design for effective hazard matching. Matching the perceived urgency of an alert with the relative hazard level of the situation is critical for effective alarm response. Here, both acoustic and semantic parameters independently and interactively impacted CAS alert perceptions in divided attention conditions. This work can inform auditory alarm design for effective hazard matching. STATEMENT OF RELEVANCE: Results indicate that both acoustic parameters and semantic content can be used to design collision warnings with a range of urgency levels. Further, these results indicate that verbal warnings tailored to a specific hazard situation may improve hazard-matching capabilities without substantial trade-offs in perceived annoyance.     

A psychophysiological evaluation of the perceived urgency of auditory warning signals

One significant concern that pilots have about cockpit auditory warnings is that the signals presently used lack a sense of priority. The relationship between auditory warning sound parameters and perceived urgency is, therefore, an important topic of enquiry in aviation psychology. The present investigation examined the relationship among subjective assessments of urgency, reaction time, and brainwave activity with three auditory warning signals. Subjects performed a tracking task involving automated and manual conditions, and were presented with auditory warnings having various levels of perceived and situational urgency. Subjective assessments revealed that subjects were able to rank warnings on an urgency scale, but rankings were altered after warnings were mapped to a situational urgency scale. Reaction times differed between automated and manual tracking task conditions, and physiological data showed attentional differences in response to perceived and situational warning urgency levels. This study shows that the use of physiological measures sensitive to attention and arousal, in conjunction with behavioural and subjective measures, may lead to the design of auditory warnings that produce a sense of urgency in an operator that matches the urgency of the situation.     

A new class of auditory warning signals for complex systems: auditory icons

This simulator-based study examined conventional auditory warnings (tonal, nonverbal sounds) and auditory icons (representational, nonverbal sounds), alone and in combination with a dash-mounted visual display, to present information about impending collision situations to commercial motor vehicle operators. Brake response times were measured for impending front-to-rear collision scenarios under 6 display configurations, 2 vehicle speeds, and 2 levels of headway. Accident occurrence was measured for impending side collision scenarios under 2 vehicle speeds, 2 levels of visual workload, 2 auditory displays, absence/presence of mirrors, and absence/presence of a dash-mounted iconic visual display. For both front-to-rear and side collision scenarios, auditory icons elicited significantly improved driver performance over conventional auditory warnings. Driver performance improved when collision warning information was presented through multiple modalities. Brake response times were significantly faster for impending front-to-rear collision scenarios using the longer headway condition. The presence of mirrors significantly reduced the number of accidents for impending side collision scenarios. Subjective preference data indicated that participants preferred multimodal displays over single-modality displays. Actual or potential applications for this research include auditory displays and warnings, information presentation, and the development of alternative user interfaces.     

Mapping candidate within-vehicle auditory displays to their referents

OBJECTIVE: This study investigated speech, environmental sounds (naturally occurring sounds with arbitrary meanings), auditory icons (natural or synthetic sounds with specific meanings), and abstract synthetic warnings as candidates for within-vehicle interfaces. BACKGROUND: Auditory displays and warnings must satisfy certain criteria, such as being appropriately urgent and commanding appropriately fast response times. However, a semiotic analysis suggests that displays, as signals interpreted by users, should also be mapped successfully onto their referents. METHOD: Response times and accuracy were recorded in a computer task of identifying learned mappings of candidate displays to a range of referent driving events (such as "headway closing"); perceived urgency and pleasantness were assessed separately. RESULTS: Speech and auditory icons produced near-ceiling performance in response times and identification accuracy. Abstract sounds produced notably slower response times and less accuracy. Environmental sounds showed an intermediate pattern of performance for accuracy, but the response times were similar to those of the abstract sounds. Speech utterances were similarly and consistently rated as pleasant but also of intermediate perceived urgency. The three other sound types showed a consistent mapping of their perceived urgency to the situational urgency of their referents; for these sounds, perceived urgency and pleasantness were negatively correlated. CONCLUSION: The results point to the importance of considering the role of signal-referent relationships in designing auditory displays. APPLICATION: The results have applicability for auditory displays in the vehicle interface, whereas the theoretical framework is of value in auditory display design in a broader context.     

A user-centred approach to the design and evaluation of auditory warning signals: 1. Methodology

This paper presents a method for the design and evaluation of auditory warning signals modelled on an existing internationally standardized method for evaluating public information systems (ISO/DIS 7001: 1979). The procedure is essentially user-centred, capitalizing upon users' associations between sounds and their meanings. The procedure is presented in a step-by-step manner, from the initial identification of referents for which warnings might be required, through the generation of ideas for warning sounds, an appropriateness ranking test, a learning and confusion test, an urgency mapping test, a recognition test and an operational test. Practical issues are discussed with respect to each of the stages, and suggestions are made as to courses of action that might be taken if problems are encountered. Theory behind the relationship between sound and meaning is discussed with reference to the practical issues addressed.     

A comparison of tactile, visual, and auditory warnings for rear-end collision prevention in simulated driving

OBJECTIVE: This study examined the effectiveness of rear-end collision warnings presented in different sensory modalities as a function of warning timing in a driving simulator. BACKGROUND: The proliferation of in-vehicle information and entertainment systems threatens driver attention and may increase the risk of rear-end collisions. Collision warning systems have been shown to improve inattentive and/or distracted driver response time (RT) in rear-end collision situations. However, most previous rear-end collision warning research has not directly compared auditory, visual, and tactile warnings. METHOD: Sixteen participants in a fixed-base driving simulator experienced four warning conditions: no warning, visual, auditory, and tactile. The warnings activated when the time-to-collision (TTC) reached a critical threshold of 3.0 or 5.0 s. Driver RT was captured from a warning below critical threshold to brake initiation. RESULTS: Drivers with a tactile warning had the shortest mean RT. Drivers with a tactile warning had significantly shorter RT than drivers without a warning and had a significant advantage over drivers with visual warnings. CONCLUSION: Tactile warnings show promise as effective rear-end collision warnings. APPLICATION: The results of this study can be applied to the future design and evaluation of automotive warnings designed to reduce rear-end collisions.     

Effects of single versus multiple warnings on driver performance

OBJECTIVE: To explore how a single master alarm system affects drivers' responses when compared with multiple, distinct warnings. BACKGROUND: Advanced driver warning systems are intended to improve safety, yet inappropriate integration may increase the complexity of driving, especially in high workload situations. This study investigated the effects of auditory alarm scheme, reliability, and collision event type on driver performance. METHOD: Using a 2 x 2 x 4 mixed factorial design, we investigated the impact of two alarm schemes (master vs. individual) and two levels of alarm reliability (high and low) on distracted drivers' performance across four collision event types (frontal collision warnings, left and right lane departure warnings, and warnings for a fast-approaching following vehicle). RESULTS: Participants' reaction times and accuracy rates were significantly affected by the type of collision event and alarm reliability. The use of individual alarms, rather than a single master alarm, did not significantly affect driving performance in terms of reaction time or response accuracy. CONCLUSION: Even though a master alarm is a relatively uninformative warning, it produced statistically no different reaction times or accuracy results when compared with information-rich auditory icons, some of which were spatially located. In addition, unreliable alarms negatively impacted driver performance, regardless of event type or alarm scheme. APPLICATION: These results have important implications for the development and implementation of multiple driver warning systems.     

On using psychophysical techniques to achieve urgency mapping in auditory warnings

It is well established that warning implementation should aim to achieve urgency mapping between the perceived urgency of the warning itself and the situational urgency of the condition that it indicates. This paper describes how Stevens Power Law [Psychological Review, 64, 153 181, 1957], which quantifies the relationship between objective parameters (such as the pitch of a warning) and subjective parameters (such as perceived urgency), can be applied to the design of auditory warnings to facilitate such urgency mapping. Studies that have quantified and predicted the effects of different warning parameters on perceived urgency using an application of Stevens Power Law are reported.     

Driver sensitivity to brake pulse duration and magnitude

Adaptive cruise control (ACC) requires that the driver intervene in situations that exceed the capability of ACC. A brake pulse might provide a particularly compatible means of alerting the driver to situations in which the acceleration authority of the ACC has been exceeded. This study examined the sensitivity of the driver to brake pulses of five different amplitudes (0.01–0.025 g) and five different durations (50–800 ms). Drivers were sensitive to accelerations as low as 0.015 g. Pulse duration interacted with pulse amplitude, such that moderate duration pulses were more detectable than long and short duration pulses at intermediate levels of pulse amplitude. A power function with an exponent of 1.0 accounted for 99% of the variance in drivers' sensitivity to pulse amplitude; however, a power function with an exponent of 0.23 accounted for only 70% of the variance in drivers' sensitivity to pulse duration. These results can help designers create ACC algorithms and develop brake pulse warnings.     

Cough once for danger: icons versus abstract warnings as informative alerts in civil aviation

OBJECTIVE: An experiment investigated the efficacy of auditory icons as warning signals in an aviation context. BACKGROUND: Iconic signals, such as a cough to signal dangerous levels of carbon monoxide, convey information about the nature of an incident and alert the operator that there is a problem, whereas signals that are arbitrarily associated with a critical incident provide relatively less information. Warning recognition speed and accuracy are likely to be influenced by modality of presentation (visual, auditory, auditory + visual) and task demand (low, high). METHODS: The 172 participants completed a computer-based training session and test task that involved responding to abstract or iconic auditory (1 s), visual, or auditory + visual warnings associated with seven critical incidents while performing low- and high-demand concurrent tasks. RESULTS: Significantly fewer training trials were required to learn iconic warnings than abstract warnings. An advantage for iconic warnings persisted into the test phase, evident most consistently as greater warning recognition accuracy. The effect was observed in both high- and low-demand conditions. Auditory abstract warnings, in particular, elicited slow reaction times and poor accuracy. CONCLUSION: Associations between a small number of meaningful environmental sounds and critical incidents can be learned with ease relative to more abstract associations, although training is required and response times are relatively slow. APPLICATION: Sets of distinctive auditory iconic warnings can be designed to alert and inform pilots about non-time-pressured events. Potential applications of language-neutral icons as informative warnings include civil, commercial, and defense aircraft.     

Perceived urgency of and response time to multi-tone and frequency-modulated warning signals in broadband noise

Several pulse parameters that were believed to affect the perceived urgency and response time to auditory warning signals were investigated in a factorial experiment. The independent variables included pulse format (sequential, simultaneous, and frequency-modulated pulses), pulse level (65 and 79dBC), and inter-pulse interval (0, 150 and 300 ms). The applications environments of interest were those having steady-state broadband noise. A probability monitoring task from the Criterion Task Set was used as an operator loading task to impose additional attentional demands during the signal detection and response task. The psychophysical methods of free-modulus magnitude estimation and paired comparison were used to measure subjective perceived urgency. An objective measure of response time to the signal was also obtained. Multivariate statistical analyses indicated that response time decreased significantly as perceived urgency increased. Perceived urgency of the signal increased and response time decreased as pulse level increased. Sequential signals took longer to detect and were rated as less urgent than the other two signal types. Shorter inter-pulse interval was associated with greater perceived signal urgency.     

The impact of alerting designs on air traffic controller’s eye movement patterns and situation awareness

Abstract

This research investigated controller’ situation awareness by comparing COOPANS’s acoustic alerts with newly designed semantic alerts. The results demonstrate that ATCOs’ visual scan patterns had significant differences between acoustic and semantic designs. ATCOs established different eye movement patterns on fixations number, fixation duration and saccade velocity. Effective decision support systems require human-centered design with effective stimuli to direct ATCO’s attention to critical events. It is necessary to provide ATCOs with specific alerting information to reflect the nature of the critical situation in order to minimise the side effects of startle and inattentional deafness. Consequently, the design of a semantic alert can significantly reduce ATCOs’ response time, therefore providing valuable extra time in a time-limited situation to formulate and execute resolution strategies in critical air safety events. The findings of this research indicate that the context-specified design of semantic alerts could improve ATCO’s situational awareness and significantly reduce response time in the event of Short Term Conflict Alert (STCA) activation which alerts to two aircraft having less than the required lateral or vertical separation.

Practitioner Summary: Eye movements are closely linked with visual attention and can be analysed to explore shifting attention whilst performing monitoring tasks. This research has found that context-specific designed semantic alerts facilitated improved ATCO cognitive processing by integrating visual and auditory resources. Semantic designs have been demonstrated to be superior to acoustic design by directing the operator’s attention more quickly to critical situations.Abbreviations: APW: area proximity warning; ASRS: aviation safety reporting system; ATC: air traffic control; ATCO: air traffic controller; ATM: air traffic management; COOPANS: cooperation between air navigation service providers; HCI: human-computer interaction; IAA: irish aviation authority; MSAW: minimum safe altitude warning; MTCD: medium-term conflict detection; SA: situation awareness; STCA: short term conflict alert; TP: trajectory prediction     

Toward developing an approach for alerting drivers to the direction of a crash threat

OBJECTIVE: This study explored the potential for auditory and haptic spatial cuing approaches to alert drivers to the direction of a crash threat. BACKGROUND: For an automobile equipped with multiple crash avoidance systems, effective cuing of the crash threat direction may help the driver avoid the crash. Because the driver may not be looking in the direction of a visual crash alert, nonvisual crash alerts were explored as an additional means of directing attention to a potential crash situation. METHODS: In this in-traffic study, 32 drivers were asked to verbally report alert direction in the absence of any crash threats. Driver localization accuracy and response time were examined as a function of eight alert locations surrounding the vehicle and four directional alert approaches (auditory, haptic, haptic and auditory, and haptic and nondirectional auditory). The auditory directional alert approach used four speakers and broadband alert sounds, and the haptic directional alert approach used vibrations generated at various locations on the bottom of the driver's seat. RESULTS: Overall, relative to the auditory alert approach, the three approaches that included the haptic seat alert component reduced correct localization response times by 257 ms and increased percentage correct localization from 32% to 84%. CONCLUSION: These results suggest that seat vibration alerts are a promising candidate for alerting drivers to the direction of a crash threat. APPLICATION: These findings should facilitate developing a multimodality integrated crash alert approach for vehicles equipped with multiple crash avoidance systems.     

基于SD卡的文字声光警示系统

以铁路道口应用为例,设计了一种基于SD卡的信息数据存储警示系统。该系统可在需要警示的情况下,通过人工操作或自动触发发出相应的警示信息,包括LED显示屏显示文字警示信息、语音系统播放警示语音、警灯闪烁进行灯光警示。文字及语音警示信息的原始数据存储在SD卡中,针对不同的应用需求,只需修改SD卡中的内容,可适用于多种应用场所。     

Imperfect in-vehicle collision avoidance warning systems can aid drivers

An experiment was conducted to determine the effects of an in-vehicle collision avoidance warning system (IVCAWS) on driver performance. A driving simulator was driven by 135 licensed drivers. Of these, 120 received alerts from the IVCAWS when their headway to a lead car was less than 2 s, and the other 15 (the control group) received no alerts. Drivers received varied alert interfaces: auditory, visual, and multimodal. The system had varied levels of reliability, determined by both false alarm rate and failure of the IVCAWS to alert to short headway. Results indicated that the IVCAWS led to safer (longer) headway maintenance. High false alarm rates induced drivers to slow down unnecessarily; large numbers of missed alerts did not have any significant impact on drivers. Driver acceptance of the system was mixed. Interface played a role in driver reliance on the system, with the multimodal interfaces generating least reliance. Actual or potential applications of this research include IVCAWS interface selection for greater system efficacy and user acceptance and the advisability of implementation, even of imperfect systems, for drivers who seek to maintain a safer headway.     

Warn me now or inform me later: Drivers' acceptance of real-time and post-drive distraction mitigation systems

Vehicle crashes caused by driver distraction are of increasing concern. One approach to reduce the number of these crashes mitigates distraction by giving drivers feedback regarding their performance. For these mitigation systems to be effective, drivers must trust and accept them. The objective of this study was to evaluate real-time and post-drive mitigation systems designed to reduce driver distraction. The real-time mitigation system used visual and auditory warnings to alert the driver to distracting behavior. The post-drive mitigation system coached drivers on their performance and encouraged social conformism by comparing their performance to peers. A driving study with 36 participants between the ages of 25 and 50 years old (M=34) was conducted using a high-fidelity driving simulator. An extended Technology Acceptance Model captured drivers' acceptance of mitigation systems using four constructs: perceived ease of use, perceived usefulness, unobtrusiveness, and behavioral intention to use. Perceived ease of use was found to be the primary determinant and perceived usefulness the secondary determinant of behavioral intention to use, while the effect of unobtrusiveness on intention to use was fully mediated by perceived ease of use and perceived usefulness. The real-time system was more obtrusive and less easy to use than the post-drive system. Although this study included a relatively narrow age range (25 to 50 years old), older drivers found both systems more useful. These results suggest that informing drivers with detailed information of their driving performance after driving is more acceptable than warning drivers with auditory and visual alerts while driving.