The validity of driving simulation for assessing differences between in-vehicle informational interfaces: A comparison with field testing

Data from on-road and simulation studies were compared to assess the validity of measures generated in the simulator. In the on-road study, driver interaction with three manual address entry methods (keypad, touch screen and rotational controller) was assessed in an instrumented vehicle to evaluate relative usability and safety implications. A separate group of participants drove a similar protocol in a medium fidelity, fixed-base driving simulator to assess the extent to which simulator measures mirrored those obtained in the field. Visual attention and task measures mapped very closely between the two environments. In general, however, driving performance measures did not differentiate among devices at the level of demand employed in this study. The findings obtained for visual attention and task engagement suggest that medium fidelity simulation provides a safe and effective means to evaluate the effects of in-vehicle information systems (IVIS) designs on these categories of driver behaviour.

Statement of Relevance: Realistic evaluation of the user interface of IVIS has significant implications for both user acceptance and safety. This study addresses the validity of driving simulation for accurately modelling differences between interface methodologies by comparing results from the field with those from a medium fidelity, fixed-base simulator.     

Effects of using head-up display in automobile context on attention demand and driving performance

This study aimed to investigate the difference in driving performance between drivers’ attention on the head-up display (HUD)/road under low/high road conditions via a driving simulator experiment. Experimental driving included four driving scenarios with attention-on-the-HUD followed by attention-on-the-road or vice versa under high or low driving load conditions. Each scenario took about a 30-min driving consisting of two 15-min sections for each attention location. Forty-eight participants, divided into four groups, drove one of the four scenarios once. Besides driving safely within speed limit, participants were also required to perform detection task and speed limit sign response task. Results revealed that drivers paying attention to the HUD, under both low and high driving load conditions, reacted faster to speed limit sign changes than when paying attention to the road. In addition, attention-to-the-HUD under low driving load condition caused the smallest variation in steering wheel angle and lateral acceleration. These differences can be attributed to the driver's enhanced awareness and the cognitive capture effect, and tended to diminish with increasing driving workload. Finally, attention shift of drivers and the so-called novelty effect for using new technology product were also found.     

A comparison of two contemporary types of in-car multifunctional interfaces

A driving simulator study was conducted to investigate the effects of carrying out a variety of tasks using two different types of contemporary in-car multifunctional interfaces: a touch screen interface and an interface manoeuvred by a rotary control. Participants drove on a curved rural road while performing tasks such as list scrolling, radio tuning, alphanumeric input and continuous adjustments. The results indicate that, in terms of task completion time and the number of glances made to the display, the optimal interface is dependent on the task being performed. The touch screen interface was better for alphanumeric input tasks and the interface manoeuvred by a rotary control was better for continuous adjustments and list scrolling. Alphanumeric input seems to be more demanding than other tasks, independent of the interface used. It was apparent in this simulator study that both interfaces affected the lateral control performance, but lateral control performance deteriorated to a greater extent when the touch screen interface was used, probably partially as a result of the lower display position.     

Effects of visual fidelity on curve negotiation,gaze behaviour and simulator discomfort

Technological developments have led to increased visual fidelity of driving simulators. However, simplified visuals have potential advantages, such as improved experimental control, reduced simulator discomfort and increased generalisability of results. In this driving simulator study, we evaluated the effects of visual fidelity on driving performance, gaze behaviour and subjective discomfort ratings. Twenty-four participants drove a track with 90° corners in (1) a high fidelity, textured environment, (2) a medium fidelity, non-textured environment without scenery objects and (3) a low-fidelity monochrome environment that only showed lane markers. The high fidelity level resulted in higher steering activity on straight road segments, higher driving speeds and higher gaze variance than the lower fidelity levels. No differences were found between the two lower fidelity levels. In conclusion, textures and objects were found to affect steering activity and driving performance; however, gaze behaviour during curve negotiation and self-reported simulator discomfort were unaffected.

Practitioner Summary: In a driving simulator study, three levels of visual fidelity were evaluated. The results indicate that the highest fidelity level, characterised by a textured environment, resulted in higher steering activity, higher driving speeds and higher variance of horizontal gaze than the two lower fidelity levels without textures.     

Curve negotiation performance in a driving simulator as a function of curve geometry

A study was conducted to investigate driver performance on curves. The between-trial factors were Blood Alcohol Content (BAC) level (0.00, 0.7, 0.12 %) and type of driving scenario (eventful versus uneventful). The within-session factors were edgeline width, type of curve-warning sign, and curve type. Twelve male drivers drove continuously for two hours on each of three nights. Each subject negotiated 150 curves during each two-hour drive. Curve radii ranged from 57.3 to 94.2 m (188 to 309.2 ft). Advisory speeds presented on curve-warning signs ranged from 32.2 to 72.4 km/h (20 to 45 mile/h). The driving simulator was a completely instrumented cab resting on a fixed base. The results showed that curve-entry speed increased as radius of curvature increased. Lateral position error was greater on the curve with the smallest radius and least on the curve with the shortest length. Heading error first increased then decreased as curve radius increased. Neither the amount of road used nor the mean computed lateral acceleration were related to curve radius, heading change or length. These results are attributed to the absence of lateral-acceleration cues in the driving simulator.     

The immediate effects of glare and electrochromic glare-reducing mirrors in simulated truck driving

In this experiment 12 experienced truck drivers drove a fixed-base driving simulator for three 8-h sessions under simulated nighttime driving conditions. Sessions included (a) no glare, (b) intermittent glare presented in the exterior rearview mirrors to simulate following vehicles, and (c) intermittent glare with electrochromic glare reduction. The driving task combined vehicle control on straight and curved road segments with detection of pedestrians appearing alongside the road and targets appearing in the rearview mirrors. The presence of glare slowed detection of pedestrians and, to a lesser extent, slowed the detection of targets appearing in mirrors. Glare was also associated with increased lane position variability, reduced speed on curves, and, most consistently, increased steering variability. We found only meager evidence that electrochromic glare reduction improved target detection performance and no evidence that glare reduction improved vehicle control, despite the fact that participants consistently voiced positive preferences for glare reduction. The results will aid decision making that requires incorporation of the benefits of electrochromic glare-reducing mirrors.     

Effects of age and illumination on night driving: a road test

OBJECTIVE: This study investigated the effects of drivers' age and low light on speed, lane keeping, and visual recognition of typical roadway stimuli. BACKGROUND: Poor visibility, which is exacerbated by age-related changes in vision, is a leading contributor to fatal nighttime crashes. There is little evidence, however, concerning the extent to which drivers recognize and compensate for their visual limitations at night. METHOD: Young, middle-aged, and elder participants drove on a closed road course in day and night conditions at a "comfortable" speed without speedometer information. During night tests, headlight intensity was varied over a range of 1.5 log units using neutral density filters. RESULTS: Average speed and recognition of road signs decreased significantly as functions of increased age and reduced illumination. Recognition of pedestrians at night was significantly enhanced by retroreflective markings of limb joints as compared with markings of the torso, and this benefit was greater for middle-aged and elder drivers. Lane keeping showed nonlinear effects of lighting, which interacted with task conditions and drivers' lateral bias, indicating that older drivers drove more cautiously in low light. CONCLUSION: Consistent with the hypothesis that drivers misjudge their visual abilities at night, participants of all age groups failed to compensate fully for diminished visual recognition abilities in low light, although older drivers behaved more cautiously than the younger groups. APPLICATION: These findings highlight the importance of educating all road users about the limitations of night vision and provide new evidence that retroreflective markings of the limbs can be of great benefit to pedestrians' safety at night.     

Driving and side task performance: the effects of display clutter, separation, and modality

In-vehicle technologies (IVTs) create additional tasks for the driver. To the extent that these devices degrade driving performance, there will be safety concerns. This study examines the effects of display clutter from overlay, display separation, and modality on driving and IVT task performance. In a fixed-base simulator, 22 drivers drove different routes and responded to infrequent, unexpected road hazards while engaging in a phone number task presented by different displays. Visual displays were located on a head-up (overlaid on the visual horizon or adjacently, just above the vehicle hood) or head-down display (HDD) located near the midconsole. Alternatively, digits were presented auditorily. In general, there were no differences in performance for the adjacent and overlay displays; however, there were costs associated with the HDD and auditory display for some measures. In particular, responses to hazard events were slowed when drivers used the HDD. Overall, the adjacent display best supported performance on all relevant tasks. Potential applications of this research include the design of IVTs with respect to location and modality.     

Differences between vehicle lateral displacement on the road and in a fixed-base simulator

This work investigates differences in lateral displacement when driving on curved and straight road sections in real-road and simulator conditions. We observed 100 licensed drivers on a rural road and 100 in a fixed-base simulator. Speed and lateral position on the real road were measured using videocameras. The analysis indicates that the mean vehicle lateral displacement is in general higher on the real road than in the simulator. However, these differences decrease for higher speeds at curved sections and for lower speeds at straight sections. It was also found that the standard deviation of the vehicle lateral displacement is significantly lower on the real road than the corresponding values in the simulator, at either curved or straight sections. Actual or potential applications of this research are related to a more realistic assessment of driving behavior scenarios derived on the basis of simulation experiment results.     

Address entry while driving: speech recognition versus a touch-screen keyboard

A driving simulator experiment was conducted to determine the effects of entering addresses into a navigation system during driving. Participants drove on roads of varying visual demand while entering addresses. Three address entry methods were explored: word-based speech recognition, character-based speech recognition, and typing on a touch-screen keyboard. For each method, vehicle control and task measures, glance timing, and subjective ratings were examined. During driving, word-based speech recognition yielded the shortest total task time (15.3 s), followed by character-based speech recognition (41.0 s) and touch-screen keyboard (86.0 s). The standard deviation of lateral position when performing keyboard entry (0.21 m) was 60% higher than that for all other address entry methods (0.13 m). Degradation of vehicle control associated with address entry using a touch screen suggests that the use of speech recognition is favorable. Speech recognition systems with visual feedback, however, even with excellent accuracy, are not without performance consequences. Applications of this research include the design of in-vehicle navigation systems as well as other systems requiring significant driver input, such as E-mail, the Internet, and text messaging.     

Stress training and simulator complexity: why sometimes more is less

Through repeated practice under conditions similar to those in real-world settings, simulator training prepares an individual to maintain effective performance under stressful work conditions. Interfaces offering high fidelity and immersion can more closely reproduce real-world experiences and are generally believed to result in better learning outcomes. However, absolute fidelity in stress training is not critical for skills to be transferable. The present study compared the performance outcomes achieved by trainees using two different simulator types to complete a training program aimed at improving decision-making skills. The purpose of this research was to assess both the overall level of training effectiveness and to determine whether performance levels were influenced when high (160 degree curved wide screen) versus low fidelity (small cab-based flat screen) simulator types were in use. Sixty-three train drivers drove for 40 min on a simulated track on which they encountered four major high stress driving events. One year later, 42 of the original drivers returned and repeated the training scenario a second and third time. Results revealed trainees using the lower fidelity flat screen simulator made fewer errors in both years than trainees using the high fidelity curved screen simulator. The implications of these results are discussed.     

Behavioural effects of mobile telephone use during simulated driving

The effects on driving performance of using a hands-free, mobile telephone were investigated in a pursuit-tracking task that simulated driving. Twenty subjects in two age groups, 19-26 years (median = 21 years) and 40-51 years (median 45·5 years), participated, with five males and five females in each group. The primary task was driving safely. The subjects drove for 20?min in each of three secondary task blocks with (i) a simple telephone conversation about a familiar topic, (ii) a difficult telephone conversation, incorporating a test of working memory, and (iii) car radio tuning and listening. Half of the driving was done on a simulated firm road surface and half on a slippery road surface. The subjects behaviour was subsequently observed and classified in four activity categories, two without and two with a secondary task, with driving (i) on a clear road, and (ii) with obstacles, and with driving involving the secondary task components of (iii) communication, and (iv) instrument manipulation. The results show different patterns of driving performance on the two road surfaces. For driving on the slippery road, a deterioration was especially marked during manipulation of the instruments, in particular the radio, which required more prolonged manipulation than the hands-free telephone. Driving during an easy telephone conversation was associated with the least performance decrement, and could, in some cases, be seen as facilitatory. The female subjects tended to perform less well than the male subjects while driving on a slippery road. Some of this difference could be attributed to less previous driving experience. In general, the male drivers exhibited better control while driving under difficult conditions. There was no difference in driving proficiency between the age groups. It is concluded that simply conversing over a hands-free telephone while driving does not in itself impair performance. However, a difficult conversation may affect the driving adversely, and any prolonged manipulation of the telephone is liable to produce a performance decrement, particularly under conditions that put heavy demands on the driver's attention and skill.     

Relationships between driving simulator performance and driving test results

This article is considered relevant because: 1) car driving is an everyday and safety-critical task; 2) simulators are used to an increasing extent for driver training (related topics: training, virtual reality, human – machine interaction); 3) the article addresses relationships between performance in the simulator and driving test results–a relevant topic for those involved in driver training and the virtual reality industries; 4) this article provides new insights about individual differences in young drivers' behaviour. Simulators are being used to an increasing extent for driver training, allowing for the possibility of collecting objective data on driver proficiency under standardised conditions. However, relatively little is known about how learner drivers' simulator measures relate to on-road driving. This study proposes a theoretical framework that quantifies driver proficiency in terms of speed of task execution, violations and errors. This study investigated the relationships between these three measures of learner drivers' (n = 804) proficiency during initial simulation-based training and the result of the driving test on the road, occurring an average of 6 months later. A higher chance of passing the driving test the first time was associated with making fewer steering errors on the simulator and could be predicted in regression analysis with a correlation of 0.18. Additionally, in accordance with the theoretical framework, a shorter duration of on-road training corresponded with faster task execution, fewer violations and fewer steering errors (predictive correlation 0.45). It is recommended that researchers conduct more large-scale studies into the reliability and validity of simulator measures and on-road driving tests.     

Relationships between driving simulator performance and driving test results

This article is considered relevant because: 1) car driving is an everyday and safety-critical task; 2) simulators are used to an increasing extent for driver training (related topics: training, virtual reality, human-machine interaction); 3) the article addresses relationships between performance in the simulator and driving test results--a relevant topic for those involved in driver training and the virtual reality industries; 4) this article provides new insights about individual differences in young drivers' behaviour. Simulators are being used to an increasing extent for driver training, allowing for the possibility of collecting objective data on driver proficiency under standardised conditions. However, relatively little is known about how learner drivers' simulator measures relate to on-road driving. This study proposes a theoretical framework that quantifies driver proficiency in terms of speed of task execution, violations and errors. This study investigated the relationships between these three measures of learner drivers' (n=804) proficiency during initial simulation-based training and the result of the driving test on the road, occurring an average of 6 months later. A higher chance of passing the driving test the first time was associated with making fewer steering errors on the simulator and could be predicted in regression analysis with a correlation of 0.18. Additionally, in accordance with the theoretical framework, a shorter duration of on-road training corresponded with faster task execution, fewer violations and fewer steering errors (predictive correlation 0.45). It is recommended that researchers conduct more large-scale studies into the reliability and validity of simulator measures and on-road driving tests.     

Cardiac measures of driver workload during simulated driving with and without visual occlusion

Cardiac (heart rate, pre-ejection period, and respiratory sinus arrhythmia), performance, and visual demand measures of driver workload were obtained from 15 male university students who drove a simulated course multiple times at a fixed speed of 72.4 km/h. The course contained curves of 3 different radii (582, 291, and 194 m) and was driven with and without visual occlusion of the road scene to manipulate driver workload. Visual occlusion of the road scene significantly reduced driving performance but did not affect the cardiac measures. Driving performance significantly deteriorated and visual demand significantly increased as curve radius decreased. The cardiac measures were differentially affected by curve radius, indicating different modes of autonomic control for the 291-m curve as compared with the 582- and 194-m curves. The patterns of dissociation across the cardiac, performance, and visual demand measures were interpreted as being capable of isolating the perceptual demands of driving from the central and motor processing demands. A potential application of this research is that the combination of psychophysiological and visual occlusion methodologies are a powerful research tool to assess performance and processing resource cost trade-offs associated with using advanced in-vehicle technologies.     

The effects of alcohol dosing on driving performance on a closed course and in a driving simulator†

The effect of alcohol consumption on driving performance was examined in two studies. In the first, six subjects drove for two hours over a closed-loop, two-lane course. In the second, 12 subjects drove for two hours in a driving simulator. In both studies, target blood alcohol concentrations (BAC) were 000%, 007%, or 0-12%. Multiple measures of vehicle control, tracking and information processing were recorded. In general, the standard deviations of these measures increased as BAC increased. Differences in the results between the two studies were related to differences in facilities (i.e. closed course vs. driving simulator).     

Effects of apparent image velocity and complexity on the dynamic visual field using a high-speed train driving simulator

Train driving is a highly visual task. The visual capabilities of the train driver affects driving safety and driving performance. Understanding the effects of train speed and background image complexity on the visual behavior of the high-speed train driver is essential for optimizing performance and safety. This study investigated the role of the apparent image velocity and complexity on the dynamic visual field of drivers. Participants in a repeated-measures experiment drove a train at nine different speeds in a state-of-the-art high-speed train simulator. Eye movement analysis indicated that the effect of image velocity on the dynamic visual field of high-speed train driver was significant while image complexity had no effect on it. The fixation range was increasingly concentrated on the middle of the track as the speed increased, meanwhile there was a logarithmic decline in fixation range for areas surrounding the track. The extent of the visual search field decreased gradually, both vertically and horizontally, as the speed of train increased, and the rate of decrease was more rapid in the vertical direction. A model is proposed that predicts the extent of this tunnel vision phenomenon as a function of the train speed.Relevance to industryThis finding can be used as a basis for the design of high-speed railway system and as a foundation for improving the operational procedures of high-speed train driver for safety.     

Distraction from multiple in-vehicle secondary tasks: vehicle performance and mental workload implications

This study investigates the impact of multiple in-vehicle information systems on the driver. It was undertaken using a high fidelity driving simulator. The participants experienced, paced and unpaced single tasks, multiple secondary tasks and an equal period of ‘normal’ driving. Results indicate that the interaction with secondary tasks led to significant compensatory speed reductions. Multiple secondary tasks were shown to have a detrimental affect on vehicle performance with significantly reduced headways and increased brake pressure being found. The drivers reported interaction with the multiple in-vehicle systems to significantly impose more subjective mental workload than either a single secondary task or ‘normal driving’. The implications of these findings and the need to integrate and manage complex in-vehicle information systems are discussed.     

Sensitivity of the lane change test as a measure of in-vehicle system demand

The Lane Change Test (LCT) is one of the growing number of methods developed to quantify driving performance degradation brought about by the use of in-vehicle devices. Beyond its validity and reliability, for such a test to be of practical use, it must also be sensitive to the varied demands of individual tasks. The current study evaluated the ability of several recent LCT lateral control and event detection parameters to discriminate between visual-manual and cognitive surrogate In-Vehicle Information System tasks with different levels of demand. Twenty-seven participants (mean age 24.4 years) completed a PC version of the LCT while performing visual search and math problem solving tasks. A number of the lateral control metrics were found to be sensitive to task differences, but the event detection metrics were less able to discriminate between tasks. The mean deviation and lane excursion measures were able to distinguish between the visual and cognitive tasks, but were less sensitive to the different levels of task demand. The other LCT metrics examined were less sensitive to task differences. A major factor influencing the sensitivity of at least some of the LCT metrics could be the type of lane change instructions given to participants. The provision of clear and explicit lane change instructions and further refinement of its metrics will be essential for increasing the utility of the LCT as an evaluation tool.     

Benefits and costs of adaptive user interfaces

The paper examines the positive and the possible adverse effects of adaptive user interfaces (AUIs) in the context of an in-vehicle telematic system as a function of four factors: (1) four different levels of adaptivity (ranging from manual to fully adaptive with intermediate levels); (2) different tasks; (3) routine (familiar) and non-routine (unfamiliar) situations; and (4) different user age groups. Both experiments included three sessions during which participants drove a simple driving simulator and performed tasks with the telematic system at one of the adaptivity levels. We measured task performance times and lane position variance. Adaptivity was not always equally beneficial, and its benefits depended on a number of factors, including the frequency in which the tasks were performed, the user’s age, the difficulty of the task and the user's involvement in the task. In familiar, routine situations, a fully adaptive system was beneficial for all participants, particularly older ones. In unfamiliar situations, to which the AUI was not adjusted, cognitive workload increased substantially, adversely affecting performance. Intermediate levels of adaptivity keep users involved in the task and help them become more proficient when performing both routine and non-routine tasks. However, intermediate levels of adaptivity should also be implemented with care, because they may also have adverse effects when users encounter non-routine situations.