Mission control of multiple unmanned aerial vehicles: a workload analysis

With unmanned aerial vehicles (UAVs), 36 licensed pilots flew both single-UAV and dual-UAV simulated military missions. Pilots were required to navigate each UAV through a series of mission legs in one of the following three conditions: a baseline condition, an auditory autoalert condition, and an autopilot condition. Pilots were responsible for (a) mission completion, (b) target search, and (c) systems monitoring. Results revealed that both the autoalert and the autopilot automation improved overall performance by reducing task interference and alleviating workload. The autoalert system benefited performance both in the automated task and mission completion task, whereas the autopilot system benefited performance in the automated task, the mission completion task, and the target search task. Practical implications for the study include the suggestion that reliable automation can help alleviate task interference and reduce workload, thereby allowing pilots to better handle concurrent tasks during single- and multiple-UAV flight control.     

基于负荷均衡的飞机驾驶舱动态功能分配

为了提高动态复杂环境下飞机驾驶舱人机系统的安全性,提出一种基于负荷均衡的动态功能分配方法。结合飞行任务和飞行员生理特征预测飞行员的工作负荷,将预测结果作为动态功能分配的触发条件,基于模糊推理调整驾驶舱自动化等级,实现飞行任务在飞行员和自动化系统之间的协调分配。基于Simulink建立飞行任务需求、飞行员生理特征、飞行员工作负荷预测、模糊推理、任务分析与再分配模块,通过仿真测试对提出的方法进行分析和验证,结果表明该方法能够及时有效地调整任务分配,避免飞行员工作负荷过高或过低。     

Designing for flexible interaction between humans and automation: delegation interfaces for supervisory control

OBJECTIVE: To develop a method enabling human-like, flexible supervisory control via delegation to automation. BACKGROUND: Real-time supervisory relationships with automation are rarely as flexible as human task delegation to other humans. Flexibility in human-adaptable automation can provide important benefits, including improved situation awareness, more accurate automation usage, more balanced mental workload, increased user acceptance, and improved overall performance. METHOD: We review problems with static and adaptive (as opposed to "adaptable") automation; contrast these approaches with human-human task delegation, which can mitigate many of the problems; and revise the concept of a "level of automation" as a pattern of task-based roles and authorizations. We argue that delegation requires a shared hierarchical task model between supervisor and subordinates, used to delegate tasks at various levels, and offer instruction on performing them. A prototype implementation called Playbook is described. RESULTS: On the basis of these analyses, we propose methods for supporting human-machine delegation interactions that parallel human-human delegation in important respects. We develop an architecture for machine-based delegation systems based on the metaphor of a sports team's "playbook." Finally, we describe a prototype implementation of this architecture, with an accompanying user interface and usage scenario, for mission planning for uninhabited air vehicles. CONCLUSION: Delegation offers a viable method for flexible, multilevel human-automation interaction to enhance system performance while maintaining user workload at a manageable level. APPLICATION: Most applications of adaptive automation (aviation, air traffic control, robotics, process control, etc.) are potential avenues for the adaptable, delegation approach we advocate. We present an extended example for uninhabited air vehicle mission planning.     

Intelligent warning systems for instrument landings

The requirements of maintaining supervisory control of a complex system may sometimes exceed the capability of the human operator for a variety of reasons ranging from temporary distraction from the main task to excessive mental workload. The ergonomic aspect of complex supervisory control can be improved by augmenting the interface with expert systems. This paper outlines the development of an intelligent warning system as one component of an augmented supervisory control system for complex aircraft. The system is designed to alert the pilot to potentially hazardous conditions during instrument landing approaches. The process of task analysis that precedes the implementation of the system is outlined, drawing on the experience of a former military pilot. The results and methods shown here can be generalized to other components of the pilot's task and, more generally, to other complex supervisory control tasks.     

Integration of task networks and cognitive user models using coloured Petri nets and its application to job design for safety and productivity

Changes of task demands due to unforeseen events and technological changes can cause variations in job design such as modifications to job procedures and task allocation. Failure to adapt to job design variations can lead to human errors that may have severe consequences for system safety. Existing techniques for task modelling cannot adequately model how task networks can be adapted to changing work conditions and task demands. Therefore, there is a need to integrate task networks with cognitive user models that indicate how operators process information, make decisions, or cope with suspended tasks and errors. The work described here presents a tool for integrating task and cognitive models using coloured Petri nets. The cognitive user model comprises two modules of attention management (selective and divided attention), a module of memory management of suspended tasks and a module of work organization. Performance Shaping Factors (e.g., workload, fatigue and mental-tracking load) are calculated at any point in time to take into account the context of work (e.g., competing activities, errors and suspended tasks). Different types of human error can be modelled for rule-based behaviours required in proceduralized work environments. Simulation analysis and formal analysis techniques can be applied to process control tasks to verify job procedures, workload management strategies and task allocation schemes in response to technological changes and unfamiliar events.     

Guaranteed task deadlines for fault-tolerant workloads with conditional branches

This work examines scheduling for a real-time multiprocessor (MAFT) in which both hard deadlines and fault-tolerance are necessary system components. A workload for this system consists of a set of concurrent dependent tasks, each with some execution frequency; tasks are also fully ordered by priority. Fault tolerance mechanisms include hardware-supported voting on computation results as well as on task starts, task completions, and branch conditions. The distributed agreement mechanism used on system-level decisions adds a variable threading delay to the run time of each copy of a task. These delays make current schedule verification techniques inapplicable. In the most general execution profile, each processor in the system runs a subset of the tasks, with different tasks possibly having different frequencies. In this work, however, we restrict attention to a special class of workloads, termed uni-schedule, in which each processor executes the entire task set, using the multiple processors to implement full redundancy. In addition, all tasks are assumed to have the same periodicity. Given these restrictions, we produce stable schedules consistent with the initial workload specifications. Algorithms are first given for uni-schedule workloads with no run-time branches, and then for uni-schedule workloads with branches.     

Multi-core real-time scheduling for generalized parallel task models

Multi-core processors offer a significant performance increase over single-core processors. They have the potential to enable computation-intensive real-time applications with stringent timing constraints that cannot be met on traditional single-core processors. However, most results in traditional multiprocessor real-time scheduling are limited to sequential programming models and ignore intra-task parallelism. In this paper, we address the problem of scheduling periodic parallel tasks with implicit deadlines on multi-core processors. We first consider a synchronous task model where each task consists of segments, each segment having an arbitrary number of parallel threads that synchronize at the end of the segment. We propose a new task decomposition method that decomposes each parallel task into a set of sequential tasks. We prove that our task decomposition achieves a resource augmentation bound of 4 and 5 when the decomposed tasks are scheduled using global EDF and partitioned deadline monotonic scheduling, respectively. Finally, we extend our analysis to a directed acyclic graph (DAG) task model where each node in the DAG has a unit execution requirement. We show how these tasks can be converted into synchronous tasks such that the same decomposition can be applied and the same augmentation bounds hold. Simulations based on synthetic workload demonstrate that the derived resource augmentation bounds are safe and sufficient.     

离散时间域人机系统控制与显示的最优协调性合成设计

本文以简化的驾驶员最优控制模型为基础，将最优协调性合成技术应用于人机控制系统，开发出离散时间域的数值迭代算法，提出了协调驾驶员、控制器和显示器的解析设计方案，实例表明，算法稳定收敛，方案能显著减轻操纵负荷，结果可靠。     

Selected graph design variables in four interpretation tasks: a microcomputer-based pilot study

A pilot study was undertaken to assess the efficacy of selected graph types and information coding schemes in producing quick and accurate graph interpretation. Point-plots, line graphs, bar graphs, and three-dimensional bar graphs were constructed and displayed using an IBM-PC microcomputer with colour monitor. The effectiveness of each of these graph types, as well as the coding scheme used within each (colour versus monochrome), was investigated using 32 subjects in four separate experiments involving either point-reading, point-comparison, trend-reading, or trend-comparison tasks. Dependent measures including task completion time, graph interpretation error, subjective mental workload rating, and graph preference rating were obtained. In three of the tasks, colour-coded graphs were associated with lower task completion time, lower rated mental workload, and higher rated preference than monochrome graphs. However, there were no differences in subjects' error scores between colour and monochrome coding for any of the tasks. For the point-reading task, the three-dimensional bar graphs were less effective than the other graph types, though there were no differences among graph types for the other three tasks. Implications for graph design given specific data interpretation tasks are discussed, based on the results of the four experiments and related literature.     

Secure Mobility and the Autonomous Driver

Autonomous mobility systems developed for unmanned ground vehicles may have additional benefits by enhancing system performance and reducing demands on operators for manned ground vehicles. This effort examines the potential impact of introducing autonomous mobility to control manned vehicles while operators performed secure mobility. Eleven Soldiers participated in an experimental task requiring concurrent control of a manned and an unmanned Stryker performing a road march, scanning of the local environment for targets, and planning of a reconnaissance route for a third simulated asset. The control of the manned vehicle was varied between autonomous and manual control and several speed and accuracy variables were examined for each task. Subjective measures of operator workload, stress, and motion sickness were also examined. The results support the potential benefits of incorporating autonomous mobility into manned platforms. In speed-matched conditions, autonomous mobility was associated with decreased manned vehicle mission time, faster operator reaction times to targets, greater instances of multitasking while under motion, and lower subjective operator workload measures than with manual driving. In conclusion, autonomous mobility technologies have the potential to free up resources from the vehicle operator and allow for better operator performance on tasks other than vehicle control.     

Scheduling image processing tasks in a multilayer system

Multilayer multiprocessor systems are generally employed in real-time applications such as robotics and computer vision. This paper introduces three heuristic algorithms for multiprocessor task scheduling in such systems. In our model, tasks with arbitrary processing times and arbitrary processor requirements are considered. The scheduling aims at minimising completion time of processes in a two-layer system. We employed an effective lower bound (LB) for the problem. Then, we analysed the average performance of the heuristic algorithms by computing the average percentage deviation of each heuristic solution from the LB on a set of randomly generated problems. We have also applied these algorithms for scheduling computer vision tasks running on prototype multilayer architecture. Our computational and empirical results showed that the proposed heuristic algorithms perform well.     

Cognitive Automation for Tactical Mission Management: Concept and Prototype Evaluation in Flight Simulator Trials

This paper describes an approach to cognitive and cooperative operator assistance in the field of tactical flight mission management. A framework for a generic functional concept is derived from general considerations of human performance and cognitive engineering. A system built according to these human-centred design principles will be able to keep up with the change of situation parameters, in order to provide situational adapted operator assistance. Such a cognitive assistant system represents an approach to ensure the highest degree possible of situation awareness of the flight deck crew as well as a satisfactory workload level. This generic approach to mission management and crew assistance for military aircraft has been realised in different application domains such as military transport and air-to-ground attack. The Crew Assistant Military Aircraft is a functional prototype for the air transport application. Even applications in the domain of uninhabited aerial vehicles (UAV) are in reach. This paper mainly covers one state-of-the-art research and development activity in the domain of combat aircraft: the TMM – Tactical Mission Management System is an experimental solution for the air-to-ground attack role. The TMM has been implemented as a functional prototype in the mission avionics experimental cockpit (MAXC), a development flight simulator at ESG and evaluated with German Air Force pilots as subjects in simulator trials. Therefore, the TMM has been compared with a reference cockpit avionics configuration in terms of task performance, workload, situation awareness and operator acceptance. After giving an overview of the system concepts this paper reports on the experimental design and results of the simulator trial campaign.     

Adaptive load distribution algorithms for heterogeneous distributed systems with multiple task classes

A load distribution (LD) algorithm achieves better system performance by smoothing out any workload imbalance that may exist in a distributed system. This is done by relocating application tasks from busy nodes to lightly loaded (or idle) nodes. Previous studies on LD algorithms allow only one single task to be transferred for each sender–receiver negotiation session. While this approach is effective for a homogeneous system, it is too conservative to be applied to a heterogeneous system where nodes may have drastically different processing speeds.In this paper, we propose a class of LD algorithms that allow a batch of tasks to be transferred during each negotiation session. The core of the algorithms is a protocol that ensures a sender–receiver pair to negotiate and arrive at a suitable batch size. The protocol takes into consideration the processing speeds of the sender and receiver, as well as their relative workload, thus ensuring the maximal benefit for each negotiation session. An additional advantage of the algorithms is that a task batch can be composed according to different performance objectives.     

Cervicobrachial muscle response to cognitive load in a dual-task scenario

People working in an office environment often have to deal with significant cognitive workload due to the coordination of multiple, simultaneous tasks. The objective of this research was to examine the impact of cognitive load in office-type tasks on physical-stress response, using a dual-task paradigm involving a primary cognitive task and secondary typing task. The central hypothesis of this research was that altering the demands of the cognitive task would lead to a difference in physical stress-level and performance. Cognitive load was manipulated by presenting participants with three different types of cognitive tasks described in Rasmussen's () taxonomy, including skill-, rule-, and knowledge-based tasks. Dependent variables examined in the study included: (1) electromyographic activity of the upper trapezius (pars descendens) and cervical erector spinae muscles, (2) performance in a secondary typing task, and (3) subjective measures of stress and cognitive workload. The results of this study revealed that the primary task causing the highest level of perceived workload also produced 61% higher muscle activity in the right trapezius, and 6 and 11% higher activity in the left and right cervical erector spinae, respectively, in comparison to muscle activity associated with the cognitive task causing the lowest perceived workload. With respect to performance, a 23% decrease was observed in typing productivity when the rule-based task was completed simultaneously vs. typing in the absence of any additional cognitive task (the baseline condition). This information may be used to better organize work activities in office environments to increase performance and reduce stress.     

Cervicobrachial muscle response to cognitive load in a dual-task scenario

People working in an office environment often have to deal with significant cognitive workload due to the coordination of multiple, simultaneous tasks. The objective of this research was to examine the impact of cognitive load in office-type tasks on physical-stress response, using a dual-task paradigm involving a primary cognitive task and secondary typing task. The central hypothesis of this research was that altering the demands of the cognitive task would lead to a difference in physical stress-level and performance. Cognitive load was manipulated by presenting participants with three different types of cognitive tasks described in taxonomy, including skill-, rule-, and knowledge-based tasks. Dependent variables examined in the study included: (1) electromyographic activity of the upper trapezius (pars descendens) and cervical erector spinae muscles, (2) performance in a secondary typing task, and (3) subjective measures of stress and cognitive workload. The results of this study revealed that the primary task causing the highest level of perceived workload also produced 61% higher muscle activity in the right trapezius, and 6 and 11% higher activity in the left and right cervical erector spinae, respectively, in comparison to muscle activity associated with the cognitive task causing the lowest perceived workload. With respect to performance, a 23% decrease was observed in typing productivity when the rule-based task was completed simultaneously vs. typing in the absence of any additional cognitive task (the baseline condition). This information may be used to better organize work activities in office environments to increase performance and reduce stress.     

基于软件总线的小卫星系统软件可重用结构设计

提出了一种小型探测卫星系统软件的可重用性结构设计方法。为实现可重用性,软件结构采用了模块化策略,各任务模块间相互通信采用了“软件总线”概念。软件总线为每个任务模块提供一个简单的标准化数据通信接口,因此对某一星载系统任务模块的修改或增加或替换时不影响其它任务模块,同时某些场合,卖命通过对地面上实时地改变软件总线上的调度表内容的方法,很容易改变卫星的工作状态。在星载系统软件软件开发周期内,各任务模块通     

基于聚类与时间耦合执行序列的任务分解方法

本文针对复杂任务分析中的高度耦合任务不易分解且需重构排序的问题,提出了一种基于聚类分析与改进时间-耦合执行序列的自适应任务分解方法。在矩阵最值遴选模型和任务序列转移策略相结合的基础上,设计了基于中间任务序列的任务矩阵分割算法;并进一步采用粒度自主循环调整机制,最终实现了复杂任务的自适应解耦分析。仿真验证结果表明,该方法能够有效实现复杂任务的解耦及序列重构,在作战任务分析领域具有很好的推广应用前景。     

Behavioural implications of alarm mistrust as a function of task workload

The research was conducted to investigate the effect of increasing primary task and alarm workload on alarm mistrust as reflected by alarm and primary task performances. A total of 126 undergraduate students performed a complex psychomotor task battery three times, with the number of concurrent tasks increasing each time. During their performance, the students were required to react to an alarm system (including visual and auditory components) of questionable reliability. Depending on the group to which participants were assigned, the alarm presentation rate constituted a low-, medium- or high-workload condition. Alarm response data (times, frequencies, accuracies) and primary task data (tracking error) were analyzed to assess performance differences as a function of primary and secondary task workload levels. Results generally supported the hypotheses: increasing primary task and alarm task workload degraded alarm response performance. Also, response frequencies supported earlier research suggesting that participants 'probability match' their response rates to alarm system reliability. The results are discussed with regard to the cry-wolf effect, attention theory and alarm system design.     

Behavioural implications of alarm mistrust as a function of task workload

The research was conducted to investigate the effect of increasing primary task and alarm workload on alarm mistrust as reflected by alarm and primary task performances. A total of 126 undergraduate students performed a complex psychomotor task battery three times, with the number of concurrent tasks increasing each time. During their performance, the students were required to react to an alarm system (including visual and auditory components) of questionable reliability. Depending on the group to which participants were assigned, the alarm presentation rate constituted a low-, medium- or highworkload condition. Alarm response data (times, frequencies, accuracies) and primary task data (tracking error) were analyzed to assess performance differences as a function of primary and secondary task workload levels. Results generally supported the hypotheses: increasing primary task and alarm task workload degraded alarm response performance. Also, response frequencies supported earlier research suggesting that participants ‘probability match’ their response rates to alarm system reliability. The results are discussed with regard to the cry-wolf effect, attention theory and alarm system design.     

Effect of time pressure and target uncertainty on human operator performance and workload for autonomous unmanned aerial system

Autonomous unmanned aircraft systems (UAS) are being utilized at an increasing rate for a number of military applications. The role of a human operator differs from that of a pilot in a manned aircraft, and this new role creates a need for a shift in interface and task design in order to take advantage of the full potential of these systems. This study examined the effects of time pressure and target uncertainty on autonomous unmanned aerial vehicle operator task performance and workload. A 2 × 2 within subjects experiment design was conducted using Multi-Modal Immersive Intelligent Interface for Remote Operation (MIIIRO) software. The primary task was image identification, and secondary tasks consisted of responding to events encountered in typical UAS operations. Time pressure was found to produce a significant difference in subjective workload ratings as well as secondary task performance scores, while target uncertainty was found to produce a significant difference in the primary task performance scores. Interaction effects were also found for primary tasks and two of the secondary tasks. This study has contributed to the knowledge of UAS operation, and the factors which may influence performance and workload within the UAS operator. Performance and workload effects were shown to be elicited by time pressure. Relevance to industry: The research findings from this study will help the UAS community in designing human computer interface and enable appropriate business decisions for staffing and training, to improve system performance and reduce the workload.