Consensual validation of personality traits: Evidence from self-reports and ratings.

Self-reports from 281 21–89 yr olds were correlated with their spouses' ratings of them on a set of 18 traits in the domains of neuroticism, extraversion, and openness to experience. Correlations ranged from .30 to .58 for the individual scales and from .51 to .60 for the 3 global domain scores. A multitrait, multimethod analysis, including the Eysenck Personality Inventory as a 2nd self-report instrument, showed evidence of convergent and divergent validity in both men and women. The use of a personality inventory format for ratings and the choice of spouse as rater contributed to the relatively high agreement, and agreement was probably moderated by the observability of the trait as well as S's gender. (29 ref) (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Evidence for genetic influences on personality from self-reports and informant ratings.

Self-report data on Extraversion (E) and Neuroticism (N), together with ratings by the co-twin, were obtained from a sample of 826 adult female twin pairs ascertained through a population-based twin register. Data were analyzed using a model that allowed for the contributions to personality ratings of the rater's personality (rater bias) as well as of the personality of the person being rated. For E, but not for N, significant rater bias was found, with extraverted respondents tending to underestimate, and introverted respondents tending to overestimate, the E of their co-twins. Good agreement between self-reports and ratings by the respondent's co-twin was found for both E and N. Substantial genetic influences were found for both personality traits, confirming findings from genetic studies of personality that have relied only on self-reports of respondents. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Assessing conflict communication in couples: Comparing the validity of self-report, partner-report, and observer ratings.

This study of married couples investigated the short-term predictive validity of the partner-report and self-report scales of the Conflict Communication Inventory and compared the validity of these scales with the validity of observer ratings. A sample of 83 married couples completed two problem-solving conversations. Self-report, partner-report, and observer ratings from Conversation 1 were used to predict behavior in Conversation 2, as rated by a separate panel of observers. The short-term predictive validity of partner-report ratings was extremely high and indistinguishable from the validity of observer ratings. Self-report ratings also demonstrated good validity, albeit slightly lower than other methods. Both partner-report and self-report scores explained a substantial amount of variance in concurrent observer ratings of communication after controlling for relationship satisfaction. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Evidence of the construct validity of developmental ratings of managerial performance.

The construct validity of developmental ratings of managerial performance was assessed by using 2 data sets, each based on a different 360° rating instrument. Specifically, the authors investigated the nature of the constructs measured by developmental ratings, the structural relationships among those constructs, and the generalizability of results across 4 rater perspectives (boss, peer, subordinate, and self). A structure with 4 lower order factors (Technical Skills, Administrative Skills, Human Skills, and Citizenship Behaviors) and 2 higher order factors (Task Performance and Contextual Performance) was tested against competing models. Results consistently supported the lower order constructs, but the higher order structure was problematic, indicating that the structure of ratings is not yet well understood. Multisample analyses indicated few practically significant differences in factor structures across perspectives. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Self-concept and the stability of personality: Cross-sectional comparisons of self-reports and ratings.

Examined the hypothesis that in normal individuals the self-concept is crystallized in early adulthood. If so, then self-report assessments would show great stability despite radical changes in personality or characteristic behavior. The use of spouse ratings is proposed as an alternative method that should be capable of demonstrating personality changes. Data on 139 male and 142 female 21–89 yr olds were collected. Correlations between age and spouse ratings of 18 personality traits showed only small associations, which may be attributable to sampling bias or cohort differences. When the difference between ratings and self-reports was examined, MANOVA showed no age effect for men or women. The agreement between self-reports and ratings at different ages was not lower among older Ss. Personality thus appears to be stable in groups and individuals whether or not the self-conccept is crystallized early in life. It is argued that the self-concepts of most adults are reasonably accurate representations of their pesonalities at all ages. (32 ref) (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

On the construct validity of self-reports: What do the data say?

Comments on the discussions of construct validity in personality measurement by J. Kagan (see record 1989-01454-001) and by R. Hogan and R. A. Nicholson (see record 1989-00097-001). The author argues the value of Kagan's warning against relying solely on self-reports in personality measurement but suggests that arguing a lack of validity in self-reports may be premature. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

On the validity of validity scales: The importance of defensive responding in the prediction of institutional misconduct.

This study examined the effects of defensive responding on the prediction of institutional misconduct among male inmates (N = 349) who completed the Personality Assessment Inventory (L. C. Morey, 1991). Hierarchical logistic regression analyses demonstrated significant main effects for the Antisocial Features (ANT) scale as well as main effects for the Positive Impression Management (PIM) scale in some instances. Significant ANT × PIM interactions also were evident, particularly when examining recommended cut scores on these scales. These results demonstrate the predictive validity of ANT with prisoners and reinforce the importance of context when considering whether validity scales are in fact valid. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Student ratings: The validity of use.

In this article, the author discusses the other articles in this Current Issues section (see records 85-00210, 00217, 00208, 00211) and concludes that all of the authors agree that student ratings are valid but that contextual variables such as grading leniency can affect the level of ratings. The authors disagree about the wisdom of applying statistical corrections for such contextual influences. This article argues that the problem lies neither in the ratings nor in the correction but rather in the lack of sophistication of personnel committees who use the ratings. Thus, more attention should be directed toward methods of ensuring more valid use. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Assessing the validity of nicotine abstinence effects by self- and observer ratings under "blinded" conditions.

The authors examined the validity of nicotine abstinence effects by using both self- and observer ratings. Participants were 61 cigarette smokers undergoing 48 hr of smoking abstinence and 61 collateral observers. Ratings of abstinence effects were derived from both self- and observer reports. A 3-part analytic strategy was used. First, the authors conducted an analysis of variance to determine which negative mood states both observers and abstaining cigarette smokers report as abstinence effects. During abstinence, both groups reported significant increases in anxiety, anger, impatience, restlessness, and confusion, and a significant decrease in vigor. Both groups reported nonsignificant changes in fatigue and drowsiness. The authors compared the magnitude of self- and observer-reported abstinence effects and found no differences between these 2 sets of scores. The results of a multitrait multimethod analysis indicated modest convergent and poor discriminant validity for individual abstinence effects. Results converge with previous findings to support the validity of a general nicotine abstinence syndrome but highlight the need for refinement in the assessment of individual component symptoms. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Magnitude and moderators of bias in observer ratings: A meta-analysis.

Bias in observer ratings compromises generalizability of measurement, typically resulting in attenuation of observed associations between variables. This quantitative review of 79 generalizability studies including raters as a facet examines bias in observer ratings in published psychological research and identifies properties of rating systems likely to place them at risk for problems with rater bias. For the rating systems studied, an average of 37% of score variance was attributable to 2 types of rater bias: (a) raters' differential interpretations of the rating scale and (b) their differential evaluations of the same targets. Ratings of explicit attributes (e.g., frequency counts) contained negligible bias variance, whereas ratings of attributes requiring rater inference contained substantial bias variance. Rater training ameliorated but did not solve the problem of bias in inferential rating scales. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Dimensionality of observer ratings on the California Adult Q-set.

The dimensionality of personality ratings on the California Adult Q-set (CAQ) is examined in a sample of 940 Ss. Solutions of between 5 and 15 factors are examined; interrater agreement is assessed for items, factors, and items partialing factors. Results suggest that the 5 personality factors are important yet not exhaustive in accounting for common factor variance in the CAQ. Furthermore, interjudge agreement extends beyond the 5 dimensions. Likely explanations for these results are considered, and implications are addressed. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Validity of observer ratings of the big five personality factors.

Examined the validity of observer (supervisor, coworker, and customer) ratings and self-ratings of personality measures. Results based on a sample of 105 sales representatives supported the 2 hypotheses tested. First, supervisor, coworker, and customer ratings of the 2 job-relevant personality dimensions—conscientiousness and extraversion—were valid predictors of performance ratings, and the magnitude of the validities was at least as large as for self-ratings. Second, supervisor, coworker, and customer ratings accounted for significant variance in the criterion measure beyond self-ratings alone for the relevant dimensions. Overall, the results suggest that validities of personality measures based on self-assessments alone may underestimate the true validity of personality constructs. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Relevance of rater-ratee acquaintance in the validity and reliability of ratings.

69 unacquainted undergraduates worked in 3-man groups under relevant (mathematical tasks) and irrelevant (socializing) acquaintance conditions. The Ss rated one another on scales that defined several cognitive skills. They were also rated on these same scales by Os, dependent on visual information, and unacquainted with Ss or the nature of the tasks being performed. As hypothesized, Ss under the relevant acquaintance condition achieved consistently good validity for all 3 cognitive areas with the best validity for ratings of math ability. Validity under the irrelevant acquaintance condition was nil on all scales. Os achieved significant validity (at lower levels than Ss) for ratings under the relevant acquaintance condition. Levels of inter- and intrarater reliability were not associated with levels of validity under the various rating conditions. (16 ref.) (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Personality in adulthood: A six-year longitudinal study of self-reports and spouse ratings on the NEO Personality Inventory.

Previous longitudinal studies of personality in adulthood have been limited in the range of traits examined, have chiefly made use of self-reports, and have frequently included only men. In this study, self-reports (N?=?983) and spouse ratings (N?=?167) were gathered on the NEO Personality Inventory (Costa & McCrae, 1985b), which measures all five of the major dimensions of normal personality. Cross-sectional and longitudinal analyses on data from men and women aged 21 to 96 years showed evidence of small declines in Activity, Positive Emotions, and openness to Actions that might be attributed to maturation, but none of these effects was replicated in sequential analyses. The 20 other scales examined showed no consistent pattern of maturational effects. In contrast, retest stability was quite high for all five dimensions in self-reports and for the three dimensions measured at both times in spouse ratings. Comparable levels of stability were seen for men and women and for younger and older subjects. The data support the position that personality is stable after age 30. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Discrepancy between self- and observer ratings of performance in social phobics.

28 Ss meeting Diagnostic and Statistical Manual of Mental Disorders-III-Revised (DSM-III-R) criteria for social phobia and without comorbid affective disorder and 33 nonclinical controls were asked to present a brief, impromptu speech to a small audience. Speakers themselves, as well as members of the audience, rated each speaker on a public speaking questionnaire that included both specific items (e.g., voice shook) and global items (e.g., appeared confident). For global items, no significant difference was indicated between the 2 groups on observers' ratings of public speaking performance. However, social phobics rated their own performance worse than did nonclinical controls, and there was a significantly greater discrepancy between self and other ratings for social phobics than controls. Fear of negative evaluation was the only significant predictor of the self–other discrepancy on global items. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Increasing the validity of self-reports of behavior in a smoking in children investigation.

As part of a large longitudinal study designed to evaluate certain social psychological strategies to deter smoking in children, a search for a means of increasing the validity of self-reports of smoking led to the development of a 3-step procedure. In 2 separate experiments, experimental groups of 86 13-yr-old children were first shown how specimens of their saliva could be analyzed for nicotine content by a mass spectrometer. The children were requested to produce saliva specimens. Finally, self-reports of smoking behavior were obtained. In the control groups of 84 Ss, only self-reports of smoking behavior were obtained. Results suggest that this procedure significantly increased the validity of self-reports of smoking behavior. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Do desirability ratings moderate the validity of probability ratings on the Smoking Consequences Questionnaire.

Smokers' responses to the Smoking Consequences Questionnaire--Adult (A. L. Copeland, T. H. Brandon, and E. P. Quinn, 1995) were used to determine whether smoking outcome expectancies are moderated by subjective evaluations (desirability ratings) in their effect on smoking-related variables. Hierarchical regression in a reanalysis of data from A. L. Copeland et al indicated that the product of probability and desirability ratings accounted for a significant amount of variance in smoking rate, nicotine dependence, saliva cotinine, and posttreatment smoking status above that accounted for by probability and desirability ratings alone. Results indicate that desirability ratings serve as moderators to probability ratings in explaining current smoking, nicotine dependence, and continued smoking. Effects were modest in magnitude but suggest that it may be important to address subjective evaluations of outcomes in smoking cessation and relapse prevention efforts. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Invalidity of validity scales: The case of the MMPI.

Tested the hypothesis that Ss fake personality tests by enacting a specific social role, rather than by responding in terms of personality constructs, and that such role faking cannot be detected by validity scales. In Exp I, 22 male undergraduates were able to reproduce without detection the MMPI profile of an Air Force officer but not that of a creative artist. The latter was attributed to the Ss' inaccurate conception of the artist role. However, when 10 of 21 Ss in Exp II were given an accurate conception of the artist role, they succeeded in reproducing the MMPI artist profile without detection as well. Results favor the hypothesis, provided that the Ss possess an accurate conception of the role to be simulated. (17 ref) (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Validity of observer ratings of the five-factor model of personality traits: A meta-analysis.

Conclusions reached in previous research about the magnitude and nature of personality–performance linkages have been based almost exclusively on self-report measures of personality. The purpose of this study is to address this void in the literature by conducting a meta-analysis of the relationship between observer ratings of the five-factor model (FFM) personality traits and overall job performance. Our results show that the operational validities of FFM traits based on observer ratings are higher than those based on self-report ratings. In addition, the results show that when based on observer ratings, all FFM traits are significant predictors of overall performance. Further, observer ratings of FFM traits show meaningful incremental validity over self-reports of corresponding FFM traits in predicting overall performance, but the reverse is not true. We conclude that the validity of FFM traits in predicting overall performance is higher than previously believed, and our results underscore the importance of disentangling the validity of personality traits from the method of measurement of the traits. (PsycINFO Database Record (c) 2011 APA, all rights reserved)