Assessing Personality With a Structured Employment Interview: Construct-Related Validity and Susceptibility to Response Inflation.

The authors evaluated the extent to which a personality-based structured interview was susceptible to response inflation. Interview questions were developed to measure facets of agreeableness, conscientiousness, and emotional stability. Interviewers administered mock interviews to participants instructed to respond honestly or like a job applicant. Interviewees completed scales of the same 3 facets from the NEO Personality Inventory, under the same honest and applicant-like instructions. Interviewers also evaluated interviewee personality with the NEO. Multitrait-multimethod analysis and confirmatory factor analysis provided some evidence for the construct-related validity of the personality interviews. As for response inflation, analyses revealed that the scores from the applicant-like condition were significantly more elevated (relative to honest condition scores) for self-report personality ratings than for interviewer personality ratings. In addition, instructions to respond like an applicant appeared to have a detrimental effect on the structure of the self-report and interview ratings, but not interviewer NEO ratings. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Intelligence and Maturity: Meta-Analytic Evidence for the Incremental and Discriminant Validity of Loevinger's Measure of Ego Development.

This review examined whether Loevinger's measure of personality (ego) development is equivalent to the measurement of intelligence. The authors conducted a meta-analysis of 52 correlations between ego level scores and intelligence test scores (retrieved from 42 studies involving 5,648 participants). The weighted average correlation between ego level and intelligence ranged from .20 to .34, depending on the intellectual ability assessed (e.g., verbal intelligence). Adjusting for measurement unreliability increased these values only minimally. The authors also reviewed 16 studies that examined the association between ego level and various criterion variables (e.g., aggressive behavior) after statistically controlling for the effects of intelligence. Ninety-four percent of the tests revealed significant relations between ego level and criterion variables after controlling for intelligence, indicating that ego development and intelligence are not interchangeable constructs. These findings do not support recent speculations concerning the limited value of stage models of maturity, social development, and moral reasoning. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Factor Structure of the Psychopathic Personality Inventory: Validity and Implications for Clinical Assessment.

Psychopathy is a personality disorder characterized by impulsive antisocial deviance in the context of emotional and interpersonal detachment. A factor analysis of the subscales of the Psychopathic Personality Inventory (PPI) yielded evidence for 2 factors. One factor showed relations with external criteria mirroring those of the emotional-interpersonal facet of psychopathy, including high dominance, low anxiety, and venruresomeness. The other factor showed relations paralleling those of the social deviance facet of psychopathy, including positive correlations with antisocial behavior and substance abuse, negative correlations with socioeconomic status and verbal ability, and personality characteristics including high negative emotionally and low behavioral constraint. Findings support using the PPI to assess these facets of psychopathy in community samples and to explore their behavioral correlates and genetic-neurobiological underpinnings. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Construct validity of the Psychopathic Personality Inventory two-factor model with offenders.

Much of the research on psychopathy has treated it as a unitary construct operationalized by total scores on one (or more) measures. More recent studies on the Psychopathic Personality Inventory (PPI) suggest the existence of two distinct facets of psychopathy with unique external correlates. Here, the authors report reanalyses of two offender data sets that included scores on the PPI along with various theoretically relevant criterion variables. Consistent with hypotheses, the two PPI factors showed convergent and discriminant relations with criterion measures, many of which would otherwise have been obscured when relying on PPI total scores. These results highlight the importance of examining facets of psychopathy as well as total scores. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Validation of a Multidimensional Measure of Goal Orientation.

Goal orientation is emerging as a useful construct for understanding how people develop, attain or demonstrate competence in learning and performance. Although it is generally accepted that goal orientation comprises three factors-learning, performance approach, and performance avoidance orientations--many researchers continue to use a general, two-factor measure to assess its influence on learning and performance. To enhance the predictive validity of goal orientation, we conducted a series of studies with over 900 participants to establish the reliability, validity, and factor structure of a new tri-dimensional measure of goal orientation that is adaptable to different situations. As well, we addressed questions about the distinctiveness of goal orientation from self-efficacy. Results indicated that goal orientation should be partitioned into three distinct factors that are different from self-efficacy. Finally, we offer a psychometrically sound alternative to existing general measures of goal orientation that captures all three dimensions and can be easily adapted to different situations. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

The Validity of the Five-Factor Model Prototypes for Personality Disorders in Two Clinical Samples.

The authors examined the validity of D. R. Lynam and T. A. Widiger's (2001) prototypes for personality disorders (PDs) derived from the facets of the 5-factor model (FFM) of personality in 2 clinical samples. In the 1st sample (N = 94), there was good agreement between the prototypes generated by experts and the profiles reported by patients. These FFM PD similarity scores also demonstrated good convergent and discriminant validity with results from a semistructured interview and a self-report measure of Axis II pathology. In the 2nd sample (N = 132), the FFM PD similarity scores demonstrated excellent longitudinal stability and good predictive validity with regard to consensus ratings of PD features. The implications of these findings are discussed. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

On Construct Validity: Issues of Method and Measurement.

Fifty years ago, L. J. Cronbach and P. E. Meehl (1955) advocated for the concept of construct validity, noting that psychologists study hypothetical, inferred entities and that validating measures of such entities involves basic theory testing. Three important developments in clinical assessment following that seminal article are noteworthy. First, clinical research has benefited from greater theoretical integration and subsequent differentiation among related constructs. Second, implementation of ongoing, critical evaluation of all aspects of the construct validity process, including theory development, hypothesis specification, research design, and empirical evaluation, has improved clinical assessment. Third, improvement in evaluating fit between hypotheses and observations has been sought. Improved means of evaluating multitrait, multimethod designs, and ways to increase their clinical representativeness, are one encouraging development. Ongoing efforts to improve the construct validity process reflect the legacy of L. J. Cronbach and P. E. Meehl. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

On the Complexity of Quantifying Construct Validity: Reply.

To validate a measure of a construct is to validate a theory: The process includes theory specification, theory elaboration, choice of methods, choice of research design, reliance on necessary auxiliary theories, and empirical observation. Evaluating the success of the process is likely to be enhanced through quantification. To date, scientists have quantified the final step of empirical observation, but earlier steps in the validation process appear more difficult to measure. In this issue, D. Westen and R. Rosenthal (2005; see record 2005-16347-003) emphasize that threats to validity are often methodological ones that precede empirical observation. Yet, their earlier attempt to quantify construct validity focused only on the final, empirical observation step of the process. For that reason, it can produce positive results despite real theoretical and methodological threats to validity. Nonetheless, the laudable attempt by these distinguished authors to quantify construct validity reminds us of the complexity of the construct validation process. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

The Construct and Criterion Validity of Emotional Intelligence and Its Potential Utility for Management Studies.

In this study, the authors reviewed the definition of emotional intelligence (EI) and argued that El is conceptually distinct from personality. In Study 1, the authors showed that EI was related to yet distinct from personality dimensions and that it had incremental predictive power on life satisfaction. The authors examined the construct validity of self-reports and others' ratings of EI using two samples in Study 2. In a student sample, parents' ratings explained additional variance in the students' life satisfaction and feelings of powerlessness after controlling for the Big Five personality dimensions. In the work sample, peer ratings were found to be significant predictors of job performance ratings provided by supervisors after controlling for the Big Five personality dimensions. Other implications for future research on EI are discussed. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Circumplex structure and personality disorder correlates of the Interpersonal Problems Model (IIP-C): Construct validity and clinical implications.

This study assessed the construct validity of the circumplex model of the Inventory of Interpersonal Problems (IIP-C) in Norwegian clinical and nonclinical samples. Structure was examined by evaluating the fit of the circumplex model to data obtained by the IIP-C. Observer-rated personality disorder criteria (DSM-IV, Axis II) were used as external correlates. The reliability of the IIP-C scales was acceptable and in the same range as in the original version. A multisample analysis strategy did not support an invariant circumplex model across the 2 groups. However, the estimated structures reflected mostly the same circular pattern of a quasi-circumplex model in the 2 groups. Departures from the ideal model were of negligible practical significance. The validity results examining personality disorder correlates of the IIP-C generally conformed to predictions, providing direct evidence for agreement between self-report and expert judgments of interpersonal problems. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Construct validity and the predictability of behavior.

Recurring assessment problems in personality research related to the cross-situational consistency and predictability of behavior are evaluated in light of modern construct-oriented measurement theory. A recent study of the domain of conscientiousness behaviors (Mischel & Peake, 1982) is used to illustrate the consequences of not applying well-established strategies for the development and validation of psychological measures. It is argued that a careful specification of the behavioral exemplars of a trait domain and their interrelations is an essential precondition for the construct validity of a measure and for evidence of behavioral consistency. A reanalysis of the observational data of Mischel and Peake revealed conceptually and empirically identifiable facets of the domain of conscientiousness and, when behaviors were properly aggregated, substantial evidence of their construct validity and cross-situational generality. This finding is contrary to interpretations of Mischel and Peake and occurred despite several definitional and measurement problems identified in their study. Conditions contributing to the prediction of behavior across situations are outlined. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Confirmatory factor analysis of the M5-50: An implementation of the International Personality Item Pool item set.

Goldberg’s International Personality Item Pool (IPIP; Goldberg, 1999) provides researchers with public-domain, free-access personality measurement scales that are proxies of well-established published scales. One of the more commonly used IPIP sets employs 50 items to measure the 5 broad domains of the 5-factor model, with 10 items per factor. The M5-50 (McCord, 2002) is a specific ordering and presentation of this 50-item set. Using data from a sample of 760 faculty, staff, and students at a midsized university, the authors assessed the reliability and construct validity of the M5-50. Cronbach’s alphas on the 5 scales ranged from acceptable to excellent. Confirmatory factor analysis indicated reasonably good model fit. Researchers who wish to measure personality would be well advised to consider using the M5-50. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Construct Validity of the PASS Theory and CAS: Correlations With Achievement.

The relationship among Planning, Attention, Simultaneous, and Successive (PASS) processing scores of the Cognitive Assessment System (CAS) and the Woodcock-Johnson Revised Tests of Achievement (WJ-R) were examined with a sample of 1,559 students aged 5-17 years. Participants were part of the CAS standardization sample and closely represented the U.S. population on a number of important demographic variables. Pearson product-moment correlation between CAS Full Scale and the WJ-R Skills cluster was .71 for the Standard and .70 for the Basic CAS Battery scores, providing evidence for the construct validity of the CAS. The CAS correlated with achievement as well if not better than tests of general intelligence. The amount of variance in the WJ-R scores the CAS accounted for increased with age between 5- to 13-year-olds. The 4 PASS scale scores cumulatively accounted for slightly more of the WJ-R variance than the CAS Full Scale score. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Indigenous Measures of Personality Assessment in Asian Countries: A Review.

This article reviews attempts to develop multidimensional personality measures in Asia and their applications in clinical assessment. Indigenous personality assessment measures in India, Korea, Japan, the Philippines, and Taiwan are examined. These early attempts have not yielded a comprehensive personality measure that integrates a theoretical framework and an empirical program of validation. The Chinese Personality Assessment Inventory (CPAI) is cited as an example to illustrate the process of developing an indigenous measure that meets the testing standards of established assessment instruments. On the basis of the research findings from the CPAI, the authors discuss the relevance of indigenous measures in clinical assessment in native cultures as well as in informing mainstream personality assessment. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Escapable Conclusions: Toomela (2003) and the Universality of Trait Structure.

A. Toomela (2003) concluded that personality structure may be shaped by a cultural mechanism, word meaning structure, and that the apparent universality of the Five-Factor Model (FFM) was the result of inadequate sampling of concrete thinkers. A reanalysis using targeted rotation showed that the intended structure was generally replicated; small deviations in the most concrete thinkers were probably due to measurement error. The reanalysis authors found no evidence of structural differences in a second sample of adults classified as concrete or abstract thinkers. The FFM structure has been replicated in many samples containing individuals with cognitive or educational limitations; observer ratings may be preferred if these limitations are severe. To date, there is no compelling evidence that culture affects personality structure. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

The Development of a Multidimensional Measure of Job Market Cognitions: The Employment Opportunity Index (EOI).

The purpose of this research was to develop a multidimensional measure of job market perceptions based on a meta-analysis by R. P. Steel and R. W. Griffeth (1989). Item sets were developed to operationally define the dimensions and were tested among 3 samples. Results of a series of exploratory and confirmatory factor analyses in 3 samples indicated that the 5 scales have satisfactory psychometric properties, construct, and criterion-related validity. The 5 dimensions accounted for significant and relatively large amounts of turnover variance, even after a number of standard turnover predictors had been taken into account. The results suggest the presence of job search microprocesses in the employee turnover process. These microprocesses are described and integrated into current thinking about the turnover process. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

On the Usefulness of Measures of Normal Personality for Clinical Assessment: Evidence of the Incremental Validity of the Revised NEO Personality Inventory.

As a means of examining the incremental validity of a normal personality measure in the prediction of selected Axis I and II diagnoses, 1,342 inpatient substance abusers completed the Revised NEO Personality Inventory (NEO-PI-R) and the Minnesota Multiphasic Personality Inventory-2 (MMPI-2) and were assessed with structured clinical interviews to determine diagnostic status. Results demonstrated that scores from the NEO-PI-R (a) were substantially related to the majority of diagnoses, accounting for between 8% and 26% of the variance in the diagnostic criteria; (b) explained an additional 3% to 8% of the variability beyond 28 selected MMPI-2 scale scores; (c) increased diagnostic classification an additional 7% to 23% beyond MMPI-2 scale scores; and (d) were significantly more useful when examined at the facet trait level than at the domain trait level. Implications for incorporating measures of normal personality into clinical assessment batteries are discussed. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Inferential structure of the NEO Five-Factor Inventory: Construct validity of the Big Four personality clusters.

Four studies investigated the dimensionality of the NEO Five-Factor Inventory (NEO-FFI; P. T. Costa & R. R. McCrae, 1992). In Study 1, four inferential dimensions and four clusters represented the NEO-FFI when 114 undergraduates freely sorted items into categories. Construct validity for four item-clusters derived from the inferential space was obtained in Study 2 based on self-report with 304 undergraduates. Study 3 validated these inferential clusters using self and peer reports for 420 undergraduates. Study 4 validated the cluster scales for predicting quality of life and significant social and cultural behaviours for 110 undergraduates. Implications for implicit personality theory, the number of dimensions issue in personality, and test construction are discussed. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Incremental Validity of the Frame-of-Reference Effect in Personality Scale Scores: A Replication and Extension.

Context-specific personality items provide respondents with a common frame of reference unlike more traditional, noncontextual personality items. The common frame of reference standardizes item interpretation and has been shown to reduce measurement error while increasing validity in comparison to noncontextual items (M. J. Schmit, A. M. Ryan. S. L. Stierwalt. & S. L. Powell, 1995). Although the frame-of-reference effect on personality scales scores has been well investigated (e.g., M. J. Schmit et al., 1995), the ability of this innovation to obtain incremental validity above and beyond the well-established, noncontextual personality scale scores has yet to be examined. The current study replicates and extends work by M. J. Schmit et al. (1995) to determine the incremental validity of the frame-of-reference effect. The results indicate that context-specific personality items do indeed obtain incremental validity above and beyond both noncontextual items and cognitive ability, and in spite of socially desirable responding induced by applicant instructions. The implications of these findings for personnel selection are discussed. (PsycINFO Database Record (c) 2010 APA, all rights reserved)