Hands-free administration of subjective workload scales: Acceptability in a surgical training environment

Introduction

Subjective workload measures are usually administered in a visual-manual format, either electronically or by paper and pencil. However, vocal responses to spoken queries may sometimes be preferable, for example when experimental manipulations require continuous manual responding or when participants have certain sensory/motor impairments. In the present study, we evaluated the acceptability of the hands-free administration of two subjective workload questionnaires - the NASA Task Load Index (NASA-TLX) and the Multiple Resources Questionnaire (MRQ) - in a surgical training environment where manual responding is often constrained.

Method

Sixty-four undergraduates performed fifteen 90-s trials of laparoscopic training tasks (five replications of 3 tasks - cannulation, ring transfer, and rope manipulation). Half of the participants provided workload ratings using a traditional paper-and-pencil version of the NASA-TLX and MRQ; the remainder used a vocal (hands-free) version of the questionnaires. A follow-up experiment extended the evaluation of the hands-free version to actual medical students in a Minimally Invasive Surgery (MIS) training facility.

Results

The NASA-TLX was scored in 2 ways - (1) the traditional procedure using participant-specific weights to combine its 6 subscales, and (2) a simplified procedure - the NASA Raw Task Load Index (NASA-RTLX) - using the unweighted mean of the subscale scores. Comparison of the scores obtained from the hands-free and written administration conditions yielded coefficients of equivalence of r = 0.85 (NASA-TLX) and r = 0.81 (NASA-RTLX). Equivalence estimates for the individual subscales ranged from r = 0.78 (“mental demand”) to r = 0.31 (“effort”). Both administration formats and scoring methods were equally sensitive to task and repetition effects. For the MRQ, the coefficient of equivalence for the hands-free and written versions was r = 0.96 when tested on undergraduates. However, the sensitivity of the hands-free MRQ to task demands (η_partial² = 0.138) was substantially less than that for the written version (η_partial² = 0.252). This potential shortcoming of the hands-free MRQ did not seem to generalize to medical students who showed robust task effects when using the hands-free MRQ (η_partial² = 0.396). A detailed analysis of the MRQ subscales also revealed differences that may be attributable to a “spillover” effect in which participants’ judgments about the demands of completing the questionnaires contaminated their judgments about the primary surgical training tasks.

Conclusion

Vocal versions of the NASA-TLX are acceptable alternatives to standard written formats when researchers wish to obtain global workload estimates. However, care should be used when interpreting the individual subscales if the object is to make comparisons between studies or conditions that use different administration modalities. For the MRQ, the vocal version was less sensitive to experimental manipulations than its written counterpart; however, when medical students rather than undergraduates used the vocal version, the instrument’s sensitivity increased well beyond that obtained with any other combination of administration modality and instrument in this study. Thus, the vocal version of the MRQ may be an acceptable workload assessment technique for selected populations, and it may even be a suitable substitute for the NASA-TLX.     

一种高效的模拟覆盖率分析方法研究

在覆盖率驱动的模拟验证方法中,模拟覆盖率分析时间直接影响模拟验证的效率．针对现有基于值变化导出(VCD)文件覆盖率分析方法中模拟重放效率低的问外,对模拟重放过程进行了改进,提出一种高效的基于VCD文件的模拟覆盖率分析方法．该方法模拟重放时只针对HDL描述中的控制语句进行求解．实现了模拟覆盖率分析系统原型和各种覆盖率测度的分析方法．实验结果表明该方法在获得与现有方法同等覆盖率分析精度的同时,模拟重放效率提高2倍多．     

Ami: promoting a quantitative approach to software management

In this paper we first review the state of the art in software measurement. We then explain how measurement should be used in a goal-oriented manner in project management and describe the ami (application of metrics in industry) approach to achieving this. Finally we consider the ami project as an example of successful technology transfer and look at the variety of tactics used for dissemination of the approach in response to the needs of today's growing software measurement community.     

粒子群算法优化的BP网络预测软件质量

预测软件质量的技术中,软件建模技术是软件质量评价体系中的关键技术,它可以发现软件中度量数据和软件质量要素之间的非线性关系。BP神经网络能够很好地模拟度量数据和质量要素之间的非线性关系,但是BP网络存在易于陷入局部极小和收敛速度慢的问题,所以提出了用粒子群算法优化BP神经网络,通过优化的BP网络建立软件质量模型,这样能很好地解决BP网络收敛速度慢和局部极小的问题。在实现该进化BP神经网络的基础上,利用28组数据进行实验,并通过与BP模型的结果的比较,验证了该模型。     

Thoughts on k-anonymization

k-Anonymity is a method for providing privacy protection by ensuring that data cannot be traced to an individual. In a k-anonymous dataset, any identifying information occurs in at least k tuples. To achieve optimal and practical k-anonymity, recently, many different kinds of algorithms with various assumptions and restrictions have been proposed with different metrics to measure quality. This paper evaluates a family of clustering-based algorithms that are more flexible and even attempts to improve precision by ignoring the restrictions of user-defined Domain Generalization Hierarchies. The evaluation of the new approaches with respect to cost metrics shows that metrics may behave differently with different algorithms and may not correlate with some applications’ accuracy on output data.     

产品线体系结构复杂性度量

产品线体系结构需要支持多种变化性以满足其内部成员特性，因而是重要又复杂的软件产品线子系统。本文通过分析产品线体系结构的vADL规约，充分考虑产品线体系结构变化性对其复杂性度量的影响，生成产品线体系结构信息流图PLA—IFG，基于PLA—IFG，实现自动化度量产品线体系结构复杂性，提出了支持变化性的产品线体系结构复杂性度量方法。     

Factors affecting user performance in haptic assembly

Current computer-aided assembly systems provide engineers with a variety of spatial snapping and alignment techniques for interactively defining the positions and attachments of components. With the advent of haptics and its integration into virtual assembly systems, users now have the potential advantage of tactile information. This paper reports research that aims to quantify how the provision of haptic feedback in an assembly system can affect user performance. To investigate human–computer interaction processes in assembly modeling, performance of a peg-in-hole manipulation was studied to determine the extent to which haptics and stereovision may impact on task completion time. The results support two important conclusions: first, it is apparent that small (i.e. visually insignificant) assembly features (e.g. chamfers) affect the overall task completion at times only when haptic feedback is provided; and second, that the difference is approximately similar to the values reported for equivalent real world peg-in-hole assembly tasks.     

Gaining Confidence in Software Inspection Using a Bayesian Belief Model

In this paper I describe how confidence in a software inspection can be obtained through calculating an estimate of its effectiveness. The method uses a Bayesian Belief Network to model the software inspection process and calculates the inference on how effective a particular inspection was. This technique was selected as it provides a means of initialising the model with inspectors' experience and has the ability to learn and optimise performance. This technique provides answers to some of the questions and limitations raised by current models used to predict inspection effectiveness. The application of the model to a major software project is discussed, covering the initial practitioner survey, model initialisation, model calibration and verification results obtained.     

数字表面模型(DSM)参数指示林窗特征的有效性研究

林窗的空间格局不仅对林下物种多样性有重要作用,而且也是量化不同林型结构特征的重要指标.近年来,灵活便捷的小型无人机航拍技术的快速发展为获取高分辨率的森林冠层三维结构信息提供了可低成本获取的途径.利用航拍影像提取林窗斑块来计算景观指数是描述林窗格局有效的传统方法,但提取细小林窗往往难度大,尤其是在需要处理大量航拍数据时会...     

Visual‐quality estimation using objective metrics

Abstract— In the past few years, a big effort in the scientific community has been devoted to the development of better image‐ and video‐quality metrics that correlate well with the human perception of quality. In this paper, an overview of the main ideas used in the design of objective quality metrics is given. More specifically, we briefly describe the different types of objective metrics and present a representative set of the different approaches taken by these algorithms. Finally, the challenges and recent developments in the area of image and video quality are discussed.