What is the shelf life of a test? The effect of time on the psychometrics of a cognitive ability test battery.

The psychometric stability of the Armed Services Vocational Aptitude Battery was studied with data collected at 5 points over a 16-year period using item response theory (IRT) methods. Although 25 of the 200 items changed significantly over the years across 3 different gender-ethnic groups (i.e., White men, White women, and Black men), the overall characteristics of the tests were not severely affected by item-level changes. Items from tests that were more semantically laden were found to be more susceptible to the effects of time compared with those that focused on skills and principles. The findings are discussed in the context of the effects of time on the effectiveness of psychological measures. A call is made to test developers and test users to pay attention to the shelf life of their tests. The use of IRT methods for studying the effects of time on psychometrics is also discussed. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Personality and leader effectiveness: A moderated mediation model of leadership self-efficacy, job demands, and job autonomy.

The trait theory of leadership is advanced by a joint investigation of the mediating role of (a) leadership self-efficacy (LSE = leader's perceived capabilities to perform leader roles) in linking neuroticism, extraversion, and conscientiousness with leader effectiveness and (b) the moderating role of job demands and job autonomy in influencing the mediation. Using K. J. Preacher, D. D. Rucker, and A. F. Hayes' (2007) moderated mediation framework, the authors tested the model (over a 2-year period) with matched data from 394 military leaders and their supervisors. Results showed that LSE mediated the relationships for neuroticism, extraversion, and conscientiousness with leader effectiveness. Moderated mediation analyses further revealed that LSE mediated the relationships for (a) all 3 personality variables for only those leaders with low job demands; (b) neuroticism and conscientiousness for only those leaders with high job autonomy; and (c) extraversion, regardless of a leader's level of job autonomy. Results underscore the importance of accounting for leaders' situational contexts when examining the relationships between personality, LSE, and effectiveness. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Rating leniency and halo in multisource feedback ratings: Testing cultural assumptions of power distance and individualism-collectivism.

This study extends multisource feedback research by assessing the effects of rater source and raters' cultural value orientations on rating bias (leniency and halo). Using a motivational perspective of performance appraisal, the authors posit that subordinate raters followed by peers will exhibit more rating bias than superiors. More important, given that multisource feedback systems were premised on low power distance and individualistic cultural assumptions, the authors expect raters' power distance and individualism-collectivism orientations to moderate the effects of rater source on rating bias. Hierarchical linear modeling on data collected from 1,447 superiors, peers, and subordinates who provided developmental feedback to 172 military officers show that (a) subordinates exhibit the most rating leniency, followed by peers and superiors; (b) subordinates demonstrate more halo than superiors and peers, whereas superiors and peers do not differ; (c) the effects of power distance on leniency and halo are strongest for subordinates than for peers and superiors; (d) the effects of collectivism on leniency were stronger for subordinates and peers than for superiors; effects on halo were stronger for subordinates than superiors, but these effects did not differ for subordinates and peers. The present findings highlight the role of raters' cultural values in multisource feedback ratings. (PsycINFO Database Record (c) 2011 APA, all rights reserved)     

Effects of the testing situation on item responding: Cause for concern.

The effects of faking on personality test scores have been studied previously by comparing (a) experimental groups instructed to fake or answer honestly, (b) subgroups created from a single sample of applicants or nonapplicants by using impression management scores, and (c) job applicants and nonapplicants. In this investigation, the latter 2 methods were used to study the effects of faking on the functioning of the items and scales of the Sixteen Personality Factor Questionnaire. A variety of item response theory methods were used to detect differential item/test functioning, interpreted as evidence of faking. The presence of differential item/test functioning across testing situations suggests that faking adversely affects the construct validity of personality scales and that it is problematic to study faking by comparing groups defined by impression management scores. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Toward a theory of individual differences and leadership: Understanding the motivation to lead.

A broad, integrative theoretical framework for understanding the relationship between individual differences and various leader behaviors is presented; it proposes a new individual-differences construct called the motivation to lead (MTL). A large-scale study using 3 samples in different occupational and cultural contexts shows 3 factors underlying MTL, namely, affective-identity, noncalculative, and social-normative MTL. A parsimonious model of antecedents to MTL is developed through hierarchical regression modeling and is cross-validated using confirmatory latent variable modeling. MTL is shown to provide incremental validity over other predictors such as general cognitive ability, values, personality, and attitudes in the prediction of 2 behavioral measures of leadership potential. Findings are discussed with reference to the theoretical framework proposed for understanding individual differences in leader behavior. (PsycINFO Database Record (c) 2010 APA, all rights reserved)