Calculating adjusted R(2) measures for Poisson regression models

In regression models not only the parameter estimates and significances of explanatory variables are of interest, but also the degree to which variation in the dependent variable can be explained by covariates. In recent publications, an R(2) measure based on deviance was recommended for Poisson regression models, one of the most frequently used modelling tools in epidemiological studies. However, when sample size is small relative to the number of covariates in the model, simple R(2) measures may be seriously inflated and may need to be adjusted according to the number of covariates in the model. We present a SAS-macro that calculates adjustments for the R(2) measures in Poisson regression models based on log-likelihood and on sums of squares. The proposed measures are applied to real data sets and their performance is discussed.     

Investigating paper vs. screen in real-life hospital workflows: Performance contradicts perceived superiority of paper in the user experience

IntroductionAll hospitals in the province of Styria (Austria) are well equipped with sophisticated Information Technology, which provides all-encompassing on-screen patient information. Previous research made on the theoretical properties, advantages and disadvantages, of reading from paper vs. reading from a screen has resulted in the assumption that reading from a screen is slower, less accurate and more tiring. However, recent flat screen technology, especially on the basis of LCD, is of such high quality that obviously this assumption should now be challenged. As the electronic storage and presentation of information has many advantages in addition to a faster transfer and processing of the information, the usage of electronic screens in clinics should outperform the traditional hardcopy in both execution and preference ratings.This study took part in a County hospital Styria, Austria, with 111 medical professionals, working in a real-life setting. They were each asked to read original and authentic diagnosis reports, a gynecological report and an internal medical document, on both screen and paper in a randomly assigned order. Reading comprehension was measured by the Chunked Reading Test, and speed and accuracy of reading performance was quantified. In order to get a full understanding of the clinicians' preferences, subjective ratings were also collected.ResultsWilcoxon Signed Rank Tests showed no significant differences on reading performance between paper vs. screen. However, medical professionals showed a significant (90%) preference for reading from paper. Despite the high quality and the benefits of electronic media, paper still has some qualities which cannot provided electronically do date.     

GARUSO: a gamification approach for involving stakeholders outside organizational reach in requirements engineering

Stakeholder participation is a key success factor of Requirements Engineering (RE). Typically, the techniques used for identifying and involving stakeholders in RE assume that stakeholders can be identified among the members of the organizations involved when a software system is ordered, developed or maintained—and that these stakeholders can be told or even mandated to contribute. However, these assumptions no longer hold for many of today’s software systems where significant stakeholders (in particular, end-users and people affected by a system) are outside organizational reach: They are neither known nor can they easily be identified in the involved organizations nor can they be told to participate in RE activities. We have developed the GARUSO approach to address this problem. It uses a strategy for identifying stakeholders outside organizational reach and a social media platform that applies gamification for motivating these stakeholders to participate in RE activities. In this article, we describe the GARUSO approach and report on its empirical evaluation. We found that the identification strategy attracted a crowd of stakeholders outside organizational reach to the GARUSO platform and motivated them to participate voluntarily in collaborative RE activities. From our findings, we derived a first set of design principles on how to involve stakeholders outside organizational reach in RE. Our work expands the body of knowledge on crowd RE regarding stakeholders outside organizational reach.

     

On keys' meanings and modes: the impact of different key solutions on children's efficiency using a mobile phone

The present study investigates the impact of different key solutions of mobile phones on users' effectiveness and efficiency using the devices. In the first experiment, 36 children (9 - 14 years) and in the second experiment 45 young adults (19 - 33 years) completed four common phone tasks twice consecutively on three simulated phones that had identical menus, but different key solutions. An approach was undertaken to quantify the complexity of keys in three models, incorporating different factors contributing to the keys' complexity (number of key options, number of modes and number of modes with a semantically dissimilar meaning), in order to predict users' performance decrements. As a further main factor, the degree of the users' locus of control (LOC) was measured and interactions with performance outcomes were studied. As dependent measures, the number of inefficient keystrokes, the number of tasks solved and the processing time were determined. Results showed a significant effect of control key solutions on users' efficiency and effectiveness for both children and young adults. Moreover, children's LOC values significantly interacted with performance: children with low LOC values showed the lowest performance and no learnability, especially when using keys with a high complexity. From the three factors contributing to the complexity of keys, keys exerting different functions with semantically inconsistent meanings had the worst effect on performance. It is concluded that in mobile user interface design keys with semantically inconsistent meanings should be generally avoided.     

CSCL for intellectually disabled pupils: Stimulating interaction by using a floor control mechanism

Computer-supported collaborative learning has an unexploited potential of becoming an effective learning method for pupils with intellectual disabilities. This paper aims at showing how some specific requirements of this target group may be met by structuring a learning situation with the help of floor control, which restricts the opportunities of a learning dyad to act simultaneously within the learning environment. It was expected that floor control could improve communication between pupils with intellectual disabilities by explicitly structuring and restricting activities in the learning environment and making it necessary for the pupils to communicate. To examine if floor control really supports the collaboration process in the hypothesized way, two different versions of a CSCL environment were implemented and compared. The results revealed improved task-related communication and a higher quality of interaction outcomes.     

Social Capital,Resilience and Accessibility in Urban Systems: a Study on Sweden

Spatial systems appear to exhibit often a complex pattern of socio-economic development, in terms of (un)employment, income, mobility, ethnic composition, and urbanisation rates. Their evolution is co-determined by such factors as: market proximity, labour and housing market developments, public amenities, use of and access to transport systems, socio-economic composition of the population, etc. In addition, a sine qua non for sustaining urban economic growth is the local or regional presence of individual and collective cognitive assets that favour knowledge acquisition and transfer, education, innovation, and creativity. In this context, social capital and spatial accessibility are critical factors. The present paper aims to provide an operational framework for mapping out and understanding the mechanisms which drive spatial systems from the perspective of the resilience of urban areas, in the light of their social capital in combination with accessibility. Particular attention is therefore given to the essential role of social capital and transport accessibility in shaping both the economic development of cities and the spatial pattern in the evolution of cities, in terms of, inter alia, education, age, ethnic composition, (un)employment, and socio-economic poverty. For our quantitative analysis of the Swedish urban system, a quantile regression model is introduced and applied in order to study which urban-economic factors in Sweden determine the different levels of social capital, which are seen here as the fundamental component of the resilience capacity of urban areas.     

Integrodifferential approach to solution of eddy currents in linear structures with motion

A nonstandard integrodifferential approach to computation of eddy currents in linear structures with motion is presented. Described is a general continuous 3D model of the problem, together with the possibilities of forming corresponding numerical schemes. The methodology is illustrated by two examples.     

Hands-free administration of subjective workload scales: Acceptability in a surgical training environment

Introduction

Subjective workload measures are usually administered in a visual-manual format, either electronically or by paper and pencil. However, vocal responses to spoken queries may sometimes be preferable, for example when experimental manipulations require continuous manual responding or when participants have certain sensory/motor impairments. In the present study, we evaluated the acceptability of the hands-free administration of two subjective workload questionnaires - the NASA Task Load Index (NASA-TLX) and the Multiple Resources Questionnaire (MRQ) - in a surgical training environment where manual responding is often constrained.

Method

Sixty-four undergraduates performed fifteen 90-s trials of laparoscopic training tasks (five replications of 3 tasks - cannulation, ring transfer, and rope manipulation). Half of the participants provided workload ratings using a traditional paper-and-pencil version of the NASA-TLX and MRQ; the remainder used a vocal (hands-free) version of the questionnaires. A follow-up experiment extended the evaluation of the hands-free version to actual medical students in a Minimally Invasive Surgery (MIS) training facility.

Results

The NASA-TLX was scored in 2 ways - (1) the traditional procedure using participant-specific weights to combine its 6 subscales, and (2) a simplified procedure - the NASA Raw Task Load Index (NASA-RTLX) - using the unweighted mean of the subscale scores. Comparison of the scores obtained from the hands-free and written administration conditions yielded coefficients of equivalence of r = 0.85 (NASA-TLX) and r = 0.81 (NASA-RTLX). Equivalence estimates for the individual subscales ranged from r = 0.78 (“mental demand”) to r = 0.31 (“effort”). Both administration formats and scoring methods were equally sensitive to task and repetition effects. For the MRQ, the coefficient of equivalence for the hands-free and written versions was r = 0.96 when tested on undergraduates. However, the sensitivity of the hands-free MRQ to task demands (η_partial² = 0.138) was substantially less than that for the written version (η_partial² = 0.252). This potential shortcoming of the hands-free MRQ did not seem to generalize to medical students who showed robust task effects when using the hands-free MRQ (η_partial² = 0.396). A detailed analysis of the MRQ subscales also revealed differences that may be attributable to a “spillover” effect in which participants’ judgments about the demands of completing the questionnaires contaminated their judgments about the primary surgical training tasks.

Conclusion

Vocal versions of the NASA-TLX are acceptable alternatives to standard written formats when researchers wish to obtain global workload estimates. However, care should be used when interpreting the individual subscales if the object is to make comparisons between studies or conditions that use different administration modalities. For the MRQ, the vocal version was less sensitive to experimental manipulations than its written counterpart; however, when medical students rather than undergraduates used the vocal version, the instrument’s sensitivity increased well beyond that obtained with any other combination of administration modality and instrument in this study. Thus, the vocal version of the MRQ may be an acceptable workload assessment technique for selected populations, and it may even be a suitable substitute for the NASA-TLX.     

Model-sensitive sequential optimal designs

The increasing number of experimenters using computer-generated experimental designs creates an increasing need to have design procedures that are less sensitive to model misspecification. To address this problem, the notion of empirical models that have both important and potential terms is used. A two-stage design strategy for planning experiments in the face of model uncertainty is proposed. The advantage of this procedure resides in the rearrangement of active potential terms at the end of the first stage using marginal posterior probabilities of different candidate models. The two-stage procedure has better estimation efficiency than its one-stage alternatives available from the literature.