On differential validity and bias.

Responds to J. E. Hunter and F. L. Schmidt's criticism (see record 1979-22562-001) that the present authors underestimated Type I bias and overestimated Type II bias in their analysis of studies of ethnic differences in employment test validity (see record 1978-02212-001). It is suggested that it is premature to dismiss the issue of differential validity. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

On the validity of the Vroom-Yetton model.

Reports an empirical evaluation of the validity of the Vroom-Yetton contingency model of leadership behavior (V. H. Vroom and P. W. Yetton, 1973). Naive to the model, 96 managers from a variety of organizations described 181 actual problem-solving or decision-making situations and their behavior in these situations. The model was then employed to predict ratings of the technical quality, subordinate acceptance, and the overall effectiveness of the final solutions chosen or decisions made. Substantial support for the model and its various components was obtained. Its concurrent validity was greater than that of a noncontingent model proposed by other theorists. The validity of the Vroom-Yetton model is due, in large measure, to relationships between agreement with the model and subordinate acceptance of or commitment to decisions. Relationships with decision quality were smaller. Reasons for this difference and possible deficiencies of the model are discussed. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

On the construct validity of open-field measures.

This article is a supplement to the summary by R. N. Walsh and R. A. Cummins (1976) of the current status of open-field measures of emotionality. The relevant factor-analytic and multifactor-experimental evidence is summarized. It is concluded that 3 lower order invariant factors underlie the 5 most extensively investigated open-field measures. Latency to move, locomotor activity, and penetration to the center are primarily indices of motor discharge. Open-field defecation is primarily an index of autonomic balance, and open-field urination is primarily an index of territorial marking. It is also concluded that the higher order factor of emotional stability is common to the 3 lower order factors. (49 ref) (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

On shutting one's eyes to face validity.

The present author reasserts the primacy of convergent and discriminant validity in construct validation. In response to the observations of J. G. Nicholls et al (see record 1983-04770-001) concerning the dangers of personality questionnaires, the present author defends a certain amount of item similarity across measures in terms of the broad process of construct validation. As an illustration, it is argued that the Affective Communication Test presents no danger to theory construction. (13 ref) (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

On the external validity of two psychotherapy analogues.

Investigated the similarity between 2 live psychotherapy analogs and real psychotherapeutic interviews. 23 therapists participated in 2 different types of analog situations and in initial intake sessions with real clients. In both of the analogs, a recruited S presented a real personal problem to the therapists in helping interactions. Audiotapes of the real and analog interviews were rated on 10 dependent variables, which were different dimensions of therapist and client behaviors. Different results were obtained for each analog. The major findings concern mean differences between the analog and real interviews and the linear relationships between the real and analog interviews. Additional findings, including significant interactions between the type of interview and the experience level of the therapist, are also discussed. Results indicate that the generalizability of the analogs is contingent on the dependent variables in question, the type of relationship to be predicted, and the experience level of the therapists. (23 ref) (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

On the validity of Spranger-based measures of value similarity.

Questions the validity of measures of actual and perceived value-similarity based on E. Spranger's (1928) typology and, therefore, about the validity of findings and conclusions based on such measures (C. T. Hill and D. E. Stull, see PA, Vol 67:7766; T. M. Newcomb, PA, Vol 67:3548). It is concluded that the phenomenally meaning value categories that persons use in coming to decisions about liking and attraction do not seem to be captured by the 6 undifferentiated values Spranger formulated for another purpose. (5 ref) (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

On the validity of validity scales: The importance of defensive responding in the prediction of institutional misconduct.

This study examined the effects of defensive responding on the prediction of institutional misconduct among male inmates (N = 349) who completed the Personality Assessment Inventory (L. C. Morey, 1991). Hierarchical logistic regression analyses demonstrated significant main effects for the Antisocial Features (ANT) scale as well as main effects for the Positive Impression Management (PIM) scale in some instances. Significant ANT × PIM interactions also were evident, particularly when examining recommended cut scores on these scales. These results demonstrate the predictive validity of ANT with prisoners and reinforce the importance of context when considering whether validity scales are in fact valid. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Professional psychology and the doctrines of sin and grace: Christian leaders' perspectives.

What is a professional psychologist to do when a client brings up the concept of sin? To some, sin may seem like a stifling religious relic that has no place in contemporary psychology. But viewing sin from within the Christian faith, and in tandem with the doctrine of grace, can help psychologists understand why sin is such an important concept for many of their Christian clients. Psychologists' misunderstanding of sin and grace may contribute to relatively low rates of referral from Christian leaders to clinical psychologists, and may sometimes hinder therapeutic progress. Two methods of data collection, involving a total of 171 respondents, were used to discern what Christian leaders wish psychologists understood regarding the doctrine of sin. Respondents emphasized the nature and consequences of sin, grace, and the importance of psychologists understanding sin and grace. Implications for professional psychologists are offered. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

On the validity of psychoanalytic constructs in the 20th century.

Responds to comments by F. Dumont (see record 1994-42094-001) about J. J. Magnavita's (see record 1993-42219-001) discussion of Freud's purported discovery of unconscious processes. Dumont underestimates the extent to which Freud both synthesized and advanced the knowledge of unconscious processes to create a metapsychological system that forms the foundation of many current psychotherapy models. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

On the nature of self-monitoring: Matters of assessment, matters of validity.

Notes that an extensive network of empirical relations has been identified in research on the psychological construct of self-monitoring. Nevertheless, in recent years some concerns have been expressed about the instrument used for the assessment of self-monitoring propensities, the Self-Monitoring Scale (SMS) developed by the 1st author (see record 1975-03047-001). Both the extent to which the SMS taps an interpretable and meaningful causal variable and the extent to which the self-monitoring construct provides an appropriate theoretical understanding of this causal variable have been questioned. An examination of reanalyses of studies of self-monitoring, analyses of the internal structure of the SMS, and further relevant data suggests that the measure does tap a meaningful and interpretable causal variable with pervasive influences on social behavior, a variable reflected as a general self-monitoring factor. The evaluation and furthering of the interpretation of this latent causal variable are discussed, criteria for evaluating alternative measures of self-monitoring are offered, and a new 18-item SMS is presented. (88 ref) (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Differential validity revived.

Analyzed 31 investigations of test validity in samples of Black and White workers to test null hypotheses that differences in validity between the 2 ethnic groups do not occur more often than chance expectation. The analyses differed from others recently addressing the same issue by dealing both with single-group validity and differential validity, by including additional data, and by making certain methodological changes. Because of low power and other deficiencies, the accumulated studies cannot furnish an unequivocal test of the issue. On the whole, however, their implications do not disconfirm the null hypothesis regarding chance differences in single-group validity, whereas they do appear to reject it with respect to differential validity. Nevertheless, tests do not consistently work better in one ethnic population than the other, even though they may function differently in one than the other. Ethnic differences in test validity are not a "pseudoproblem." (23 ref) (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

The validity of importance.

Studied the usefulness of weighting by importance when combining measures of satisfaction with job aspects into a measure of overall satisfaction. Results with 380 clerical workers question the validity of the information that is used for importance weighting. It is concluded that the model of cognitive behavior that relates the importance of job aspects to the evaluation of overall job attitude should be revised. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Homogeneity of test validity.

In the present investigation we examined the extent to which the validity of three cognitive ability tests varied across test score range with respect to predicting job performance. This study was a partial replication and extension of R. Lee and P. P. Foley (see record 1987-09206-001). The 24,219 participants in the current study were obtained from the General Aptitude Test Battery (GATB) data base. Measures included in the analyses were general cognitive ability, numerical ability, and verbal ability. Results did not confirm Lee and Foley's findings. Specifically, the validity of the tests used in this study did not appreciably vary at different points along the test score range. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

On "Construct validity of measures of college teaching effectiveness."

In their recent study Howard, Conway, and Maxwell (1985) proffered evidence of the validity of student evaluations of teaching effectiveness, particularly the convergence of student and former-student ratings. The authors claimed that these two measures are "especially effective evaluation methods" (Howard et al., 1985, p. 187). In this article, I raise questions on conceptual and methodological grounds about the quality of the Howard et al. validation evidence. The main points of concern are whether (a) the Howard et al. evidence can support the hypothesis that their student evaluation measure is tapping a construct other than teaching effectiveness and (b) the convergent validation offered in their article more closely resembles reliability analysis. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Single-group validity, differential validity, and differential prediction.

The controversial topics of single-group and differential validity have been the subject of several recent articles. In line with the critiques of the original articles, it is argued that differential validity is too narrow a focus. Differential prediction and considerations of bias in selection procedures are more critical issues and require more than a comparison of correlation coefficients. (16 ref) (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

The validity of validity: An analysis of validation study designs.

Draws a distinction between validity (logic of inferences) and validation (the process of research using a specific design) to evaluate 11 criterion-related validation designs that differ in the timing of measurement of test behavior and job performance and in the selection procedure (random, existing tests, and experimental tests). Comparisons are based on T. D. Cook and D. T. Campbell's (1949) 4 interrelated criteria: statistical conclusion, internal, construct, and external validity. The analysis marks the selection procedure as a major design property that influences the validity of validation studies. Important differences between concurrent and predictive validation are identified for several aspects of validity. The fact that no specific design is considered most appropriate for all purposes suggests the use of validation research programs, based on a series of studies with different designs, to enhance the validity of validation research. (30 ref) (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

On the nature of self-monitoring: Problems with assessment, problems with validity.

We investigated the evidence for a general factor of self-monitoring in six samples (N?=?3,615). The results indicate the presence of two, relatively orthogonal, major factors (General Factors A and B). General Factor A, which presumably accounts for most of the empirical validity of the scale, correlated strongly with measures of the traditional personality dimension of social surgency such as exhibitionism, social potency, and extraversion. General Factor B is a weakened version of an earlier identified Other-Directedness factor, and it correlated positively with shyness and negatively with self-esteem. Additional analyses examined the 18-item revision of the Self-Monitoring Scale in terms of the extent to which it strengthens General Factor A, its relationship to the original version, its factor structure, and correlations with other personality measures. We discuss three flaws in the construct of self-monitoring: its assumption of the bipolarity of social and personal orientations, its assumption of uniformity among those who score high on the Self-Monitoring Scale, and its lack of clarity concerning the role of intentionality in self-presentational processes. We suggest that it is time to move beyond the construct presented by Snyder (1987) toward a more comprehensive investigation of self-presentation and social behavior. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Hypothesis validity of clinical research.

Hypothesis validity refers to the extent to which research results reflect theoretically derived predictions about the relations between or among constructs. The role of hypotheses in theory testing is discussed. Four threats to hypothesis validity are presented: (a) inconsequential research hypotheses, (b) ambiguous research hypotheses, (c) noncongruence of research hypotheses and statistical hypotheses, and (d) diffuse statistical hypotheses and tests. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Meta-analysis of assessment center validity.

Meta-analysis (Hunter, Schmidt, & Jackson, 1982) of 50 assessment center studies containing 107 validity coefficients revealed a corrected mean and variance of .37 and .017, respectively. Validities were sorted into five categories of criteria and four categories of assessment purpose. Higher validities were found in studies in which potential ratings were the criterion, and lower validities were found in promotion studies. Sufficient variance remained after correcting for artifacts to justify searching for moderators. Validities were higher when the percentage of female assessees was high, when several evaluation devices were used, when assessors were psychologists rather than managers, when peer evaluation was used, and when the study was methodologically sound. Age of assessees, whether feedback was given, days of assessor training, days of observation, percentages of minority assessees, and criterion contamination did not moderate assessment center validities. The findings suggest that assessment centers show both validity generalization and situational specificity. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Discriminant validity of well-being measures.

The convergent and discriminant validities of well-being concepts were examined using multitrait-multimethod matrix analyses (D. T. Campbell & D. W. Fiske, 1959) on 3 sets of data. In Study 1, participants completed measures of life satisfaction, positive affect, negative affect, self-esteem, and optimism on 2 occasions 4 weeks apart and also obtained 3 informant ratings. In Study 2, participants completed each of the 5 measures on 2 occasions 2 years apart and collected informant reports at Time 2. In Study 3, participants completed 2 different scales for each of the 5 constructs. Analyses showed that (a) life satisfaction is discriminable from positive and negative affect, (b) positive affect is discriminable from negative affect, (c) life satisfaction is discriminable from optimism and self-esteem, and (d) optimism is separable from trait measures of negative affect. (PsycINFO Database Record (c) 2010 APA, all rights reserved)