An empirical comparison of the results of five validity generalization procedures.

With data originally obtained by the 3rd author and colleagues (see record 1980-31533-001), comparative results are presented for the noninteractive, interactive, independent multiplicative and Taylor Series Approximations 1 and 2 validity generalization procedures when there is nonzero sampling error. Findings indicate that the 5 validity generalization procedures yielded similar estimates of the fully corrected mean and variance of true validity coefficients. It is concluded that the 5 validity generalization procedures will lead to the same general conclusions regarding the effectiveness of a predictor measure. (16 ref) (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

An empirical study of a proposed test of nonparametric analysis of covariance.

Puri and Sen (1969b) introduced a nonparametric test statistic that, because of its relationship to the general linear model, subsumes many commonly performed hypothesis tests. Following the work of Puri and Sen, Harwell and Serlin (1985) proposed a test of the nonparametric analysis of covariance (ANCOVA) hypothesis. In order to use this statistic, ranks (or some other transformation) are substituted for the original scores. Standard statistical packages can then be used to perform the analysis, and the results of the test are referred to the appropriate reference distribution. The similarity of the rank transformation of Conover and Iman (1981) to this procedure is noted, and the results of a Monte Carlo study investigating the distributional properties (i.e., Type I error rate and power) of the proposed test and other nonparametric analyses of covariance models are presented. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Faking and the validity of conscientiousness: A Monte Carlo investigation.

The article reports the findings from a Monte Carlo investigation examining the impact of faking on the criterion-related validity of Conscientiousness for predicting supervisory ratings of job performance. Based on a review of faking literature, 6 parameters were manipulated in order to model 4,500 distinct faking conditions (5 [magnitude] × 5 [proportion] × 4 [variability] × 3 [faking-Conscientiousness relationship] × 3 [faking-performance relationship] × 5 [selection ratio]). Overall, the results indicated that validity change is significantly affected by all 6 faking parameters, with the relationship between faking and performance, the proportion of fakers in the sample, and the magnitude of faking having the strongest effect on validity change. Additionally, the association between several of the parameters and changes in criterion-related validity was conditional on the faking-performance relationship. The results are discussed in terms of their practical and theoretical implications for using personality testing for employee selection. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Predictive validity of an implicit association test for assessing anxiety.

The Implicit Association Test (TAT) was adapted to measure anxiety by assessing associations of self (vs. other) with anxiety-related (vs. calmness-related) words. Study 1 showed that the TAT-Anxiety exhibited good internal consistency and adequate stability. Study 2 revealed that the IAT-Anxiety was unaffected by a faking instruction. Study 3 examined the predictive validity of implicit and explicit measures and showed that the TAT-Anxiety was related to changes in experimenter-rated anxiety and performance decrements after failure. Study 4 found that several behavioral indicators of anxiety during a stressful speech were predicted by the TAT. Taken together, these studies show that the TAT-Anxiety is a reliable measure that is able to predict criterion variables above questionnaire measures of anxiety and social desirability. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Sampling variance in the correlation coefficient under indirect range restriction: Implications for validity generalization.

The authors conducted Monte Carlo simulations to investigate whether indirect range restriction (IRR) on 2 variables X and Y increases the sampling error variability in the correlation coefficient between them. The manipulated parameters were (a) IRR on X and Y (i.e., direct restriction on a third variable Z), (b) population correlations ρxy, ρxz, and ρyz and (c) sample size. IRR increased the sampling error variance in rxy to values as high as 8.50% larger than the analytically derived expected values. Thus, in the presence of IRR, validity generalization users need to make theory-based decisions to ascertain whether the effects of IRR are artifactual or caused by situational-specific moderating effects. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

History and accuracy of validity generalization equations: A response to the Callender and Osburn reply.

In a continuation of the discussion between the present authors (Schmidt et al; see record 1983-07150-001) and J. C. Callender and H. G. Osburn (see record 1983-07128-001), it is contended that neither Callender and Osburn (see record 1981-27033-001) nor F. L. Schmidt and J. E. Hunter (see record 1978-11418-001) have invented a model that accounts for the impact of artifacts on validity coefficients; this accomplishment is attributed to Spearman and to Fisher. An example is presented showing that in realistic situations, the present authors' noninteractive equation is more accurate than the Callender and Osburn equation. The 4-artifact equations are shown to be superior in either validity generalization values characterizing the findings of the field and those used in a specific application. (8 ref) (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Confidence intervals for the cross-validated multiple correlation in predictive regression models.

Presents improved procedures to approximate confidence intervals for ρ–2 and ρc–2 in both fixed and random predictor models. These approximations require neither point estimates nor variance estimates and are analytically shown to be precise enough for most practical prediction purposes. An application of confidence intervals in regression model development is also given. (16 ref) (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

A note on the sampling variance of the mean uncorrected correlation in meta-analysis and validity generalization.

Compares the accuracy of several formulas for the standard error of the mean uncorrected correlation in meta-analytic and validity generalization studies. The effect of computing the mean correlation by weighting the correlation in each study by its sample size is also studied. On the basis of formal analysis and simulation studies, it is concluded that the common formula for the sampling variance of the mean correlation, Vr ?=?Vr/K where K is the number of studies in the meta-analysis, gives reasonably accurate results. This formula gives accurate results even when sample sizes and ρs are unequal and regardless of whether or not the statistical artifacts vary from study to study. It is also shown that using sample-size weighting may result in underestimation of the standard error of the mean uncorrected correlation when there are outlier sample sizes. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

An empirical test of the female castration complex.

Investigated the psychoanalytic hypothesis that intensity of the female castration complex (FCC) is greater in women with a masculine social role than in those with a feminine social role. Ss were normal, college-educated women, ages 30-55, divided into 2 groups: 26 career women, unmarried, and in masculine occupations; and 25 homemakers, married, with 2 or more children, and not employed outside the home. The career women scored significantly higher on an overall measure of the FCC based on the Rorschach, supporting the hypothesis. They also scored significantly higher on 3 of the 8 individual components of the FCC (penis envy, high activity, and high need for achievement). Some theoretical implications are discussed. (22 ref.) (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Meta-analysis of correlation coefficients: A Monte Carlo comparison of fixed- and random-effects methods.

The efficacy of the Hedges and colleagues, Rosenthal-Rubin, and Hunter-Schmidt methods for combining correlation coefficients was tested for cases in which population effect sizes were both fixed and variable. After a brief tutorial on these meta-analytic methods, the author presents 2 Monte Carlo simulations that compare these methods for cases in which the number of studies in the meta-analysis and the average sample size of studies were varied. In the fixed case the methods produced comparable estimates of the average effect size; however, the Hunter-Schmidt method failed to control the Type I error rate for the associated significance tests. In the variable case, for both the Hedges and colleagues and Hunter-Schmidt methods, Type I error rates were not controlled for meta-analyses including 15 or fewer studies and the probability of detecting small effects was less than .3. Some practical recommendations are made about the use of meta-analysis. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

On the robustness, bias, and stability of statistics from meta-analysis of correlation coefficients: Some initial Monte Carlo findings.

Each of several Monte Carlo simulations generated 100 sets of observed study correlations based on normal, heteroscedastic, or slightly nonlinear bivariate distributions, with one population correlation coefficient and true variance of 0. A version of J. E. Hunter and F. L. Schmidt's (1990b) meta-analysis was applied to each study set. Within simulations, ρ? was accurate on average. σ?2ρ was biased; one would correctly conclude more than half the time that no moderator effects existed. However, cases of variation in ρ? and especially in σ?2ρ indicated that results from individual meta-analyses could deviate substantially from what was found on average. Findings for these no-moderator cases offer applied psychologists some guidelines and cautions when drawing conclusions about true population correlations and true moderator effects (e.g., situational specificity, validity generalization) from meta-analytic results. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Worry, emotionality, and task-generated interference in test anxiety: An empirical test of attentional theory.

Investigated sources of interference in highly test anxious Ss performing under evaluative stress. 185 college students were administered the Test Anxiety Scale. Those from the upper (34 Ss) and lower (34 Ss) 30% of the distribution solved difficult anagrams under 2 evaluative conditions: high stress (evaluative) and low stress (nonevaluative). Major findings are that the high-anxiety/high-stress group (a) reported more anxiety during testing; (b) rated themselves, their abilities, and the task more negatively; (c) solved fewer anagrams; (d) estimated spending less time on task; (e) experienced more interference from anxiety; and (f) reported greater distraction of attention to heightened autonomic arousal (emotionality), worrisome thoughts (worry), and task-produced competing responses (task-generated interference) than did either the high-anxiety/low-stress or low-anxiety/high-stress group. Findings are interpreted in terms of attentional theories of anxiety. (26 ref) (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Patterns of stability in adult attachment: An empirical test of two models of continuity and change.

One of the core assumptions of attachment theory is that attachment representations are stable over time. Unfortunately, the data on attachment stability have been ambiguous, and as a result, alternative theoretical perspectives have evolved to explain them. The objective of the present research was to evaluate alternative models of stability by studying adults in 2 intensive longitudinal investigations. Specifically, we assessed attachment representations in 1 sample (N = 203) daily over a 30-day period and in the other sample (N = 388) weekly over a year. Analyses show that the patterns of stability that exist in adult attachment are most consistent with a prototype model—a model assuming that there is a stable factor underlying temporary variations in attachment. Moreover, although the Big Five personality traits exhibited a pattern of stability that was similar to that of attachment, they did not account for the stability observed in attachment. (PsycINFO Database Record (c) 2011 APA, all rights reserved)     

Conditioned inhibition produced by extinction-mediated recovery from the relative stimulus validity effect: A test of acquisition and performance models of empirical retrospective revaluation.

Empirical retrospective revaluation is a phenomenon of Pavlovian conditioning and human causal judgment in which posttraining changes in the conditioned response (Pavlovian task) or causal rating (causal judgment task) of a cue occurs in the absence of further training with that cue. Two experiments tested the contrasting predictions made by 2 families of models concerning retrospective revaluation effects. In a conditioned lick-suppression task, rats were given relative stimulus validity training, consisting of reinforcing a compound of conditioned stimuli (CSs) A and X and nonreinforcement of a compound of CSs B and X, which resulted in low conditioned responding to CS X. Massive posttraining extinction of CS A not only enhanced excitatory responding to CS X, but caused CS B to pass both summation (Experiment 1) and retardation (Experiment 2) tests for conditioned inhibition. The inhibitory status of CS B is predicted by the performance-focused extended comparator hypothesis (J. C. Denniston, H. I. Savastano, & R. R. Miller, 2001), but not by acquisition-focused models of empirical retrospective revaluation (e.g., A. Dickinson & J. Burke, 1996; L. J. Van Hamme & E. A. Wasserman, 1994). (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Reliability and validity of scales for assessing behavior in epilepsy.

Behavior Rating Scales for Epilepsy (BRSE), developed to assess 8 characteristics that have been attributed to patients with epilepsy, were rated from a semistructured interview with 79 outpatients (aged 19–69 yrs) with epilepsy and from an independent interview with a friend or relative of each patient. Patients and observers also completed the Bear and Fedio Inventory (BFI) for assessing behavior change in epilepsy. Interrater reliability estimates exceeded .75 for 5 BRSE scales. Convergent and discriminant validity were demonstrated for all but 2 BRSE scales when comparing patient with observer-based rating. BRSE results showed correspondence with BFI-Observer scores for most scales but not with BFI-Patient scales. BFI-Observer scores also showed little association with BFI-Patient scores. The BRSE shows promise as a time-efficient, psychometrically sound assessment instrument for further research on behavioral aspects of epilepsy. (PsycINFO Database Record (c) 2010 APA, all rights reserved)