The virtual landing pad: facilitating rotary-wing landing operations in degraded visual environments

The safety of rotary-wing operations is significantly affected by the local weather conditions, especially during key phases of flight including hover and landing. Despite the operational flexibility of rotary-wing craft, such craft accounts for a significantly greater proportion of accidents than their fixed-wing counterparts. A key period of risk when operating rotary-wing aircraft is during operations that occur in degraded visual environments, for example as a result of thick fog. During such conditions, pilots’ workload significantly increases and their situation awareness can be greatly impeded. The current study examines the extent to which providing information to pilots via the use of a head-up display (HUD) influenced perceived workload and situation awareness, when operating in both clear and degraded visual environments. Results suggest that whilst the HUD did not benefit pilots during clear conditions, workload was reduced when operating in degraded visual conditions. Overall results demonstrate that access to the HUD reduces the difficulties associated with flying in degraded visual environments.     

Examining the Effects of Conformal Terrain Features in Advanced Head‐Up Displays on Flight Performance and Pilot Situation Awareness

Synthetic vision systems (SVS) render terrain features for pilots through cockpit displays using a GPS database and three‐dimensional graphical models. Enhanced vision systems (EVS) present infrared imagery of terrain using a forward‐looking sensor in the nose of an aircraft. The ultimate goal of SVS and EVS technologies is to support pilots in achieving safety under low‐visibility and night conditions comparable to clear, day conditions. This study assessed pilot performance and situation awareness (SA) effects of SVS and EVS imagery in an advanced head‐up display (HUD) during a simulated landing approach under instrument meteorological conditions. Videos of the landing with various HUD configurations were presented to eight pilots with a superimposed tracking task. The independent variables included four HUD feature configurations (baseline [no terrain imagery], SVS, EVS, and a combination of SVS and EVS), two visibility conditions, and four legs of the flight. Results indicated that SVS increased overall SA but degraded flight path control performance because of visual confusion with other display features. EVS increased flight path control accuracy but decreased system (aircraft) awareness because of visual distractions. The combination of SVS and EVS generated offsetting effects. Display configurations did not affect pilot spatial awareness. Flight performance was not different among phases of the approach, but levels and types of pilot SA did vary from leg to leg. These results are applicable to development of adaptive HUD features to support pilot performance. They support the use of multidimensional measures of SA for insight on pilot information processing with advanced aviation displays. © 2012 Wiley Periodicals, Inc.     

Variations in ATC-Work Load as a Function of Variations in Cockpit Workload

Abstract

The relation between pilots‘ workload and radar controllers‘ workload was investigated. Pilots‘ workload served as the independent variable. It was assumed that a number of levels of workload can be distinguished in a standard airport, traffic circuit under visual flight rules. The dependent variable (controllers’ workload) was measured by response frequency on an auditory binary choice task. Results indicate a rise in radar controllers’ workload in a predicted direction for a number of pilots’ workload levels.     

Workload benefits of colour coded head-up flight symbology during high workload flight

The manipulation of colour in display symbology design has been recognised as a method to improve operator experience and performance. An earlier paper by the authors demonstrated that redundantly colour coding head-up flight symbology supported the manual flying performance of both professional and non-professional pilots during low-workload flying scenarios. In this study the workload and performance of 12 professional airline pilots was evaluated in high workload conditions whilst they flew manoeuvres and an instrument landing system (ILS) approach with and without the presence of colour feedback on a head up display (HUD). Workload was manipulated by presenting pilots with a concurrent auditory n-back task. Colour coded flight symbology reduced the subjective workload of the pilots during high workload conditions. In contrast, manual flying performance during high workload was not improved by the presence of colour coded feedback.     

With flying colours: Pilot performance with colour-coded head-up flight symbology

The manipulation of colour in display symbology design has long been recognised as a method to improve operator experience and performance. Recent developments in colour head-up display (HUD) and helmet-mounted display (HMD) technology underline the necessity to understand the human factors considerations of symbology colour coding against conventional monochrome symbology formats. In this low-fidelity desktop human-in-the-loop experiment, the colour of flight symbology on an overlaid symbology set was coded as a redundant cue to indicate the accuracy of professional and non-professional pilots’ flight profile across a range of simulated flight manoeuvres. The main finding of this study was that colour coding flight symbology supported the manual flying performance of both professional and non-professional pilots. Notably, colour-coding of the bank indicator and airspeed tape minimised performance error during turning and altitude change manoeuvres, respectively. The usability of colour coded symbology was also rated higher than the monochrome symbology. We conclude that colour coded HUD/HMD symbology is preferred by the user and may improve performance during low workload manual flying tasks. A fuller understanding of performance and workload effects will require future studies to employ higher workload flying tasks and examine the utility of colour coding within higher fidelity environments.     

The influence of training level on manual flight in connection to performance,scan pattern,and task load

This work focuses on the analysis of pilots’ performance during manual flight operations in different stages of training and their influence on gaze strategy. The secure and safe operation of air traffic is highly dependent on the individual performances of the pilots. Before becoming a pilot, he/she has to acquire a broad set of skills by training to pass all the necessary qualification and licensing standards. A basic skill for every pilot is manual control operations, which is a closed-loop control process with several cross-coupled variables. Even with increased automation in the cockpit, the manual control operations are essential for every pilot as a last resort in the event of automation failure. A key element in the analysis of manual flight operations is the development over time in relation to performance and visual perception. An experiment with 28 participants (including 11 certified pilots) was conducted in a Boeing 737 simulator. For defined flight phases, the dynamic time warping method was applied to evaluate the performance for selected criteria, and eye-tracking methodology was utilized to analyze the gaze-pattern development. The manipulation of workload and individual experience influences the performance and the gaze pattern at the same time. Findings suggest that the increase of workload has an increased influence on pilots depending on the flight phase. Gaze patterns from experienced pilots provide insights into the training requirements of both novices and experts. The connection between workload, performance and gaze pattern is complex and needs to be analyzed under as many differing conditions. The results imply the necessity to evaluate manual flight operations with respect to more flight phases and a detailed selection of performance indications.

     

LabWindows/CVI5.0在平显模拟系统中的应用

平显模拟系统以功能强大的交互式可视化的LabWindows/CVI5 0和OpenGL为编程平台开发应用软件 ,实现逼真模拟平显的功能。介绍了构建平显模拟系统的硬件组成 ,重点讨论了双机通讯、平显画面的显示。其特点是开发方便 ,投资少 ,具有较高的经济和军事效益     

Comparison of NASA-TLX scale,modified Cooper–Harper scale and mean inter-beat interval as measures of pilot mental workload during simulated flight tasks

Abstract

The sensitivity of NASA-TLX scale, modified Cooper–Harper (MCH) scale and the mean inter-beat interval (IBI) of successive heart beats, as measures of pilot mental workload (MWL), were evaluated in a flight training device (FTD). Operational F/A-18C pilots flew instrument approaches with varying task loads. Pilots’ performance, subjective MWL ratings and IBI were measured. Based on the pilots’ performance, three performance categories were formed; high-, medium- and low-performance. Values of the subjective rating scales and IBI were compared between categories. It was found that all measures were able to differentiate most task conditions and there was a strong, positive correlation between NASA-TLX and MCH scale. An explicit link between IBI, NASA-TLX, MCH and performance was demonstrated. While NASA-TLX, MCH and IBI have all been previously used to measure MWL, this study is the first one to investigate their association in a modern FTD, using a realistic flying mission and operational pilots.

Practitioner summary: NASA-TLX scale, MCH scale and the IBI were evaluated in a flight training device. All measures were able to differentiate most task conditions and there was a positive correlation between NASA-TLX and MCH scale. An explicit link between IBI, NASA-TLX, MCH and performance was demonstrated.

Abbreviations: ANOVA: Analysis of Variance; ECG: Electrocardiograph; F/A: fighter/attack; ft: feet; FTD: flight training device; G: Gravity; km: kilometer; m: meter; m/s: meters per second; MWL: mental workload; MCH: modified cooper-harper; NASA-TLX: NASA Task Load Index; NM: Nautical Mile; NN: normal-to-normal; IBI: inter-beat interval; ILS: Instrument Landing System; RR: R-Wave to R-Wave; SD: standard deviation; TTP: tactics, techniques and procedures; WTSAT: Weapon Tactics and Situation Awareness Trainer     

Synthetic vision systems: the effects of guidance symbology, display size, and field of view

Two experiments conducted in a high-fidelity flight simulator examined the effects of guidance symbology, display size, and geometric field of view (GFOV) within a synthetic vision system (SVS). In Experiment 1, 18 pilots flew highlighted and low-lighted tunnel-in-the-sky displays, as well as a less cluttered follow-me aircraft (FMA), through a series of curved approaches over rugged terrain. The results revealed that both tunnels supported better flight path tracking and lower workload levels than did the FMA because of the availability of more preview information. Increasing tunnel intensity had no benefit on tracking and, in fact, degraded traffic awareness because of clutter and attentional tunneling. In Experiment 2, 24 pilots flew a lowlighted tunnel configured according to different display sizes (small or large) and GFOVs (30 degrees or 60 degrees). Measures of flight path tracking and terrain awareness generally favored the 60 degrees GFOV; however, there were no effects of display size. Actual or potential applications of this research include understanding the impact of SVS properties on flight path tracking, traffic and terrain awareness, workload, and the allocation of attention.     

Hate to interrupt you,but… analyzing turn-arounds from a cockpit perspective

This study aimed to analyze aircraft ground operation processes from a human factors perspective with special emphases on the occurrence and influence of interruptions on pilots’ workload. Interruptions have been shown to increase workload and error probability as well as to contribute to fatal accidents in various fields. Countermeasures have been initiated especially in high-risk environments such as those involving medical issues. In aviation, more explicitly during turn-around processes, interruptions might occur frequently and impair flight safety. One hundred and sixty fully certified pilots working for a European airline were observed during their turn-around while performing real operations. Pilots’ interruptions were documented and classified in order to predict subjectively perceived workload by use of multiple linear regression analysis. External factors such as weather conditions, technical problems, and time pressure were considered as covariates. On average, a pilot experienced about eight interruptions during a turn-around. Overall workload estimates showed a level comparable to that of manual flying in a simulator. Interruptions from colleagues or from outside the cockpit were found to predict pilots’ workload; however, further external factors such as poor weather conditions impacted workload even more strongly. We suggest two approaches based on our results to handling the high rate of interruptions. We first recommend procedural changes to diminish the interruption rate; second, we recommend comprehensive, line-oriented flight training for airline and ground staff to raise awareness about the negative influence of interruptions.     

平视显示器字符亮度及线宽测量系统

传统平视显示器字符亮度及线宽测量方法采用人工点对点式测量,费时,工作量大,测量结果易受主观因素影响。为实现标准化自动快速测量,本文提出了基于CCD式亮度计的字符亮度及线宽的测量系统。通过对平视显示器字符显示特性分析,确定了测量系统中的亮度测量的关键参数和线宽测量的高斯拟合半亮度线宽算法,并结合六自由度电控旋转平移台搭建了相应的测量系统,最后通过亮度测试和线宽测试实验验证了本系统的可靠性与准确性。     

现代运输类飞机HUD应用人为因素研究

本文论述了现代运输类飞机HUD功能及应用原理,通过工程心理学相关理论分析了HUD应用存在的人为因素问题,并提出了HUD在驾驶舱应用的成功准则和方法。     

Investigating pilot performance using mixed-modality simulated data link

OBJECTIVE: General aviation (GA) pilot performance utilizing a mixed-modality simulated data link was objectively evaluated based on the time required in accessing, understanding, and executing data link commands. Additional subjective data were gathered on workload, situation awareness (SA), and preference. BACKGROUND: Research exploring mixed-modality data link integration to the single-pilot GA cockpit is lacking, especially with respect to potential effects on safety. METHODS: Sixteen visual flight rules (VFR)-rated pilots participated in an experiment using a flight simulator equipped with a mixed-modality data link. Data link modalities were text display, synthesized speech, digitized speech, and synthesized speech/text combination. Flight conditions included VFR (unlimited ceiling and visibility) or marginal VFR flight conditions (clouds 2,800 ft above ground level, 3-mile visibility). RESULTS: Statistically significant differences were found in pilot performance, mental workload, and SA across the data link modalities. Textual data link resulted in increased time and workload as compared with the three speech-type data link conditions, which did not differ. SA measures indicated higher performance with textual and digitized speech data link conditions. CONCLUSION: Textual data link can be significantly enhanced for single-pilot GA operations by the addition of a speech component. APPLICATION: Potential applications include operational safety in future GA systems that incorporate data link for use by a single pilot and guidance in the development of flight performance objectives for these systems.     

Visual scan patterns reflect to human-computer interactions on processing different types of messages in the flight deck

The flight deck of commercial aircraft is sophisticated and searching for the necessary information at the right time is sometimes challenging. This research investigates pilot's visual parameters while interacted with two different designs of crew alerting system by eye tracking technology. There are 24 aviation professionals that participated in this experiment including commercial pilots, private pilots and avionic engineers. Compared with traditional design, the new integrated design applied proximity compatibility principles to assist pilots in searching necessary information to deal with urgent situations. The results demonstrated that the integrated design is superior to traditional design in providing accurate instructions as determined by visual behaviors. However, the integrated design increases pilot's situation awareness by redirecting attention from current task to the most critical task with the cost of a longer total fixation duration time. Pilot's visual parameters demonstrated significant differences while interacting with PFD mainly numeric, ND mostly by symbols and EICAS with presented text messages. Therefore, flight deck design has to adopt a holistic approach as pilot's visual attentions is shifting among all types of different displays to gain situation awareness rather than focus on only one display. The design of integrated EICAS can provide detailed instructions to deal with urgent situations which induced higher cognitive loads as pilot's pupil dilation is significant bigger than interacted with traditional design. By eye tracking technology, it is applicable to design human-centred flight decks to improve safety and human performance in aviation.     

The impact of alerting designs on air traffic controller’s eye movement patterns and situation awareness

Abstract

This research investigated controller’ situation awareness by comparing COOPANS’s acoustic alerts with newly designed semantic alerts. The results demonstrate that ATCOs’ visual scan patterns had significant differences between acoustic and semantic designs. ATCOs established different eye movement patterns on fixations number, fixation duration and saccade velocity. Effective decision support systems require human-centered design with effective stimuli to direct ATCO’s attention to critical events. It is necessary to provide ATCOs with specific alerting information to reflect the nature of the critical situation in order to minimise the side effects of startle and inattentional deafness. Consequently, the design of a semantic alert can significantly reduce ATCOs’ response time, therefore providing valuable extra time in a time-limited situation to formulate and execute resolution strategies in critical air safety events. The findings of this research indicate that the context-specified design of semantic alerts could improve ATCO’s situational awareness and significantly reduce response time in the event of Short Term Conflict Alert (STCA) activation which alerts to two aircraft having less than the required lateral or vertical separation.

Practitioner Summary: Eye movements are closely linked with visual attention and can be analysed to explore shifting attention whilst performing monitoring tasks. This research has found that context-specific designed semantic alerts facilitated improved ATCO cognitive processing by integrating visual and auditory resources. Semantic designs have been demonstrated to be superior to acoustic design by directing the operator’s attention more quickly to critical situations.Abbreviations: APW: area proximity warning; ASRS: aviation safety reporting system; ATC: air traffic control; ATCO: air traffic controller; ATM: air traffic management; COOPANS: cooperation between air navigation service providers; HCI: human-computer interaction; IAA: irish aviation authority; MSAW: minimum safe altitude warning; MTCD: medium-term conflict detection; SA: situation awareness; STCA: short term conflict alert; TP: trajectory prediction     

Cognitive Automation for Tactical Mission Management: Concept and Prototype Evaluation in Flight Simulator Trials

This paper describes an approach to cognitive and cooperative operator assistance in the field of tactical flight mission management. A framework for a generic functional concept is derived from general considerations of human performance and cognitive engineering. A system built according to these human-centred design principles will be able to keep up with the change of situation parameters, in order to provide situational adapted operator assistance. Such a cognitive assistant system represents an approach to ensure the highest degree possible of situation awareness of the flight deck crew as well as a satisfactory workload level. This generic approach to mission management and crew assistance for military aircraft has been realised in different application domains such as military transport and air-to-ground attack. The Crew Assistant Military Aircraft is a functional prototype for the air transport application. Even applications in the domain of uninhabited aerial vehicles (UAV) are in reach. This paper mainly covers one state-of-the-art research and development activity in the domain of combat aircraft: the TMM – Tactical Mission Management System is an experimental solution for the air-to-ground attack role. The TMM has been implemented as a functional prototype in the mission avionics experimental cockpit (MAXC), a development flight simulator at ESG and evaluated with German Air Force pilots as subjects in simulator trials. Therefore, the TMM has been compared with a reference cockpit avionics configuration in terms of task performance, workload, situation awareness and operator acceptance. After giving an overview of the system concepts this paper reports on the experimental design and results of the simulator trial campaign.     

Incorporating data link messaging into a multi-function display to support the Small Aircraft Transportation System (SATS) and the self-separation of general aviation aircraft

One objective of the Small Aircraft Transportation System (SATS) Project is to increase the capacity and utilization of small non-towered, non-radar equipped airports by transferring traffic management activities to an automated system and separation responsibilities to general aviation (GA) pilots. This paper describes the development of a research multi-function display (MFD) to support the interaction between pilots and an automated Airport Management Module (AMM). Preliminary results of simulation and flight tests indicate that adding the responsibility of monitoring other traffic for self-separation does not increase pilots' subjective workload levels. Pilots preferred using the enhanced MFD to execute flight procedures, reporting improved situation awareness (SA) over conventional instrument flight rules (IFR) procedures.     

Information complexity--mental workload and performance in combat aircraft

The purpose of the present study was to analyse the effects of information complexity on Pilot Mental WorkLoad (PMWL) and Pilot Performance (PP), and to analyse the structure of PMWL. Eighteen pilots performed 72 simulated low level-high speed emissions. The complexity of the Head Down Display (HDD) information varied as a function of the tactical situation. Flight data were recorded continuously. The pilots' eye movements were video taped and psychophysiological activation data, Heart Rate (HR), were obtained. The pilots rated PMWL according to the psychological content of three scales (Bedford Rating Scale, Subjective Workload Assessment Technique, NASA-Task Load indeX) and answered a questionnaire tapping aspects of performance, information load, motivation and mood. It was found that even a moderate complexity of information interfered with the flight task. Altitude and variation in altitude were increased and corrections of altitude errors were delayed, when complexity increased. Changes in information load reached its maximum influence on flight performance (r = 0.60, p < 0.001) after a time delay of 20 to 40 seconds. Performance of the flight task correlated positively (r = 0.59, p <0.001) with the performance of the information handling task (Tactical Situation Awareness, TSA). Durations and frequencies of eye fixations Head Up (HU) versus Head Down (HD) changed as a function of information load. A structural equation model implied that PMWL was affected by mission complexity and that PMWL affected objective and subjective aspects of flight performance and information handling. Heart rate (sortie means) correlated positively with PMWL (r = 0.34, p <0.05) and perceived complexity of mission (r = 0.37, p < 0.01). Heart rate (running means) covaried with variations in information complexity for those pilots who performed well. From spectral analyses of cardiac interval times it was found that the amplitude of the 0.10 Hz component tended to decrease during high as compared to low levels of information load.     

A comparative survey of the utility of cross-cockpit linkages and autoflight systems' backfeed to the control inceptors of commercial aircraft

'Fly-by-wire' (FBW) electronic flight control systems in modern commercial aircraft have removed the requirement for the primary control inceptors in the cockpit to have a cross-cockpit linkage, and also for them to be back-driven from the autoflight systems. This comparative survey of 157 commercial pilots with current type ratings on either an FBW aircraft or a conventional technology aircraft, however, suggests that the deletion of these linkages may have degraded the lines of communication in the cockpit, both between the pilots and between the pilot and the aircraft. It is argued that this may adversely affect a pilot's situation awareness.