"Asymptotically distribution-free (ADF) interval estimation of coefficient alpha": Correction.

Reports an error in "Asymptotically distribution-free (ADF) interval estimation of coefficient alpha" by Alberto Maydeu-Olivares, Donna L. Coffman and Wolfgang M. Hartmann (Psychological Methods, 2007[Jun], Vol 12[2], 157-176). The sentence describing Equation 1 is incorrect. The corrected sentence is presented in the erratum. (The following abstract of the original article appeared in record 2007-07830-003.) The point estimate of sample coefficient alpha may provide a misleading impression of the reliability of the test score. Because sample coefficient alpha is consistently biased downward, it is more likely to yield a misleading impression of poor reliability. The magnitude of the bias is greatest precisely when the variability of sample alpha is greatest (small population reliability and small sample size). Taking into account the variability of sample alpha with an interval estimator may lead to retaining reliable tests that would be otherwise rejected. Here, the authors performed simulation studies to investigate the behavior of asymptotically distribution-free (ADF) versus normal-theory interval estimators of coefficient alpha under varied conditions. Normal-theory intervals were found to be less accurate when item skewness >1 or excess kurtosis >1. For sample sizes over 100 observations, ADF intervals are preferable, regardless of item skewness and kurtosis. A formula for computing ADF confidence intervals for coefficient alpha for tests of any size is provided, along with its implementation as an SAS macro. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Meta-analysis of coefficient alpha.

The meta-analysis of coefficient alpha across many studies is becoming more common in psychology by a methodology labeled reliability generalization. Existing reliability generalization studies have not used the sampling distribution of coefficient alpha for precision weighting and other common meta-analytic procedures. A framework is provided for a statistically grounded meta-analysis of coefficient alpha using its sampling distribution. Two empirical examples are offered to illustrate these methods, and limitations of reliability generalization are described. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

A note on using stratified alpha to estimate the composite reliability of a test composed of interrelated nonhomogeneous items.

The relationship between stratified alpha (alphas) and the reliability of a test composed of interrelated nonhomogeneous items is examined. It is mathematically demonstrated that when there is congeneric equivalence within the strata or subtests, the difference between the coefficients is a function of the variances of the loadings within the strata. When the items within each stratum are essentially tau equivalent, these variances are 0, and alphas and true reliability are equal, provided errors of measurement are uncorrelated. If errors of measurement are positively correlated and there is essential tau equivalence within strata, stratified alpha will overestimate reliability. These findings indicate that recent studies involving stratified alpha (A. Kamata, A. Turhan, & E. Darandari, 2003; H. G. Osburn, 2000) need to be interpreted with some degree of caution. Nevertheless, the hypothetical population data presented in this article suggest that under certain circumstances, stratified alpha can be considerably greater than alpha and closer to the true reliability. Because the former is easily computed, it is recommended that with stratified tests, practicing researchers should routinely calculate both alpha and stratified alpha coefficients. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Correlates of Within-Person (Across-Occasion) Variability in Reaction Time.

A total of 420 adults between 18 and 91 years of age carried palm pilot (Palm M100; PalmOne, Milpitas, CA) devices and performed several reaction time trials when prompted at random times during the day. On the average, within-person variability in median reaction time from one occasion to the next was nearly the same magnitude as the between-persons variability in across-occasion mean reaction time. Analyses controlling the variation in one variable when examining relations involving the other variable suggested that an individual's mean reaction time is a more powerful predictor of relations with age and with the level of various cognitive abilities than his or her across-occasion SD. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Categorization of Above and Below Spatial Relations by Tufted Capuchin Monkeys (Cebus apella).

Using a matching-to-sample procedure, the researchers investigated tufted capuchins' (Cebus apella) ability to form categorical representations of above and below spatial relations. In Experiment 1, 5 capuchins correctly matched bar-dot stimuli on the basis of the relative above and below location of their constituent elements. The monkeys showed a positive transfer of performance both when the bar-dot distance in the two comparison stimuli differed from that of the sample and when the actual location of the matching stimulus and the nonmatching stimulus on the apparatus was modified. In Experiment 2, the researchers systematically changed the shapes of the located object (the dot) or the reference object (the horizontal bar). These manipulations did not affect the monkeys' performance. Overall, the data suggest that capuchins can form abstract, conceptual-like representations for above and below spatial relations. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

A taxometric analysis of the Psychopathy Checklist: Screening Version (PCL:SV): Further evidence of dimensionality.

A taxometric analysis of the Psychopathy Checklist: Screening Version (PCL:SV; S. D. Hart, D. N. Cox, & R. D. Hare, 1995) was performed on a group of 2,250 male and female forensic/psychiatric patients and jail/prison inmates. The 4 PCL:SV facet scores (Interpersonal, Affective, Impulsive Lifestyle, Antisocial Behavior) served as indicators in this study, and the data were analyzed with 3 principal taxometric procedures-mean above minus below a cut, maximum eigenvalue, and latent mode factor analysis. The results show evidence of dimensional structure on the PCL:SV in the full sample as well as in all 8 subsamples (men, women, Whites, Blacks, hospital patients, jail/prison inmates, file review with an interview, file review without an interview). These findings corroborate recent taxometric research on the Psychopathy Checklist-Revised (R. D. Hare, 1991, 2003) in which results have been largely dimensional in nature. It is concluded that scores on the PCL:SV differ quantitatively as points on a dimension (high vs. low psychopathy) rather than partitioning into qualitatively distinct categories of behavior (psychopath vs. nonpsychopath). (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Escapable Conclusions: Toomela (2003) and the Universality of Trait Structure.

A. Toomela (2003) concluded that personality structure may be shaped by a cultural mechanism, word meaning structure, and that the apparent universality of the Five-Factor Model (FFM) was the result of inadequate sampling of concrete thinkers. A reanalysis using targeted rotation showed that the intended structure was generally replicated; small deviations in the most concrete thinkers were probably due to measurement error. The reanalysis authors found no evidence of structural differences in a second sample of adults classified as concrete or abstract thinkers. The FFM structure has been replicated in many samples containing individuals with cognitive or educational limitations; observer ratings may be preferred if these limitations are severe. To date, there is no compelling evidence that culture affects personality structure. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Linking of serially ordered lists by macaque monkeys (Macaca mulatta): List position influences.

Five monkeys (Macaca mulatta) were trained on 2 sets of 3 5-item serially ordered lists. Then, each set was either linked or not in a counterbalanced, within-subject design. Linking entailed training on the 2 pairs that ordered the 3 5-item fists into a single overall 15-item series. Choices on novel pairings after linking conditions attempted to define the unique contributions of knowledge of within-list ordinal position and between-lists link training. With linkage, the series was immediately treated as a 15-item ordered list. Without linkage, choices reflected list positions from initial learning, but continued testing with directional reward yielded gradual ordering into a 15-itern list. Apparently, monkeys remembered and used initial list-position information, but linkage allowed inference of an integrated serial relationship among items. Results supported primate list memory as an organizational process. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Ordinal Representation of Numeric Quantities by Brown Capuchin Monkeys (Cebus apella).

Using techniques established by E. M. Brannon and H. S. Terrace (2000) with rhesus macaques (Macaca mulatta), the authors tested the ability of brown capuchins (Cebus apella) to order arrays of items ranging in quantity from 1 to 9. Three monkeys were trained on a touch screen to select the quantities 1-4 in ascending order. The monkeys exhibited successful transfer of this ability to novel representations of the quantities 1-4 and to pairs of the novel quantities 5-9. Patterns of responding with respect to numeric distance and magnitude were similar to those seen in human subjects, suggesting the use of similar psychological processes. The capuchins demonstrated an ordinal representation of quantity equivalent to that shown in Old World monkeys. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Monkeys (Macaca mulatta and Cebus apella) track, enumerate, and compare multiple sets of moving items.

Despite many demonstrations of numerical competence in nonhuman animals, little is known about how well animals enumerate moving stimuli. In this series of experiments, rhesus monkeys (Macaca mulatta) and capuchin monkeys (Cebus apella) performed computerized tasks in which they had to enumerate sets of stimuli. In Experiment 1, rhesus monkeys compared two sets of moving stimuli. Experiment 2 required comparisons of a moving set and a static set. Experiment 3 included human participants and capuchin monkeys to assess all 3 species' performance and to determine whether responding was to the numerical properties of the stimulus sets rather than to some other stimulus property such as cumulative area. Experiment 4 required both monkey species to enumerate subsets of each moving array. In all experiments, monkeys performed above chance levels, and their responses were controlled by the number of items in the arrays as opposed to nonnumerical stimulus dimensions. Rhesus monkeys performed comparably to adult humans when directly compared although capuchin performance was lower. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

The storm and stress (or calm) of early adolescent self-concepts: Within- and between-subjects variability.

This study uses intraindividual variability and change methods to test theoretical accounts of self-concept and its change across time and context and to test the developmental implications of this variability. The 5-year longitudinal study of 541 youths in a rural Pennsylvania community from 3rd through 7th grade included twice-yearly assessments of self-concept (academic and social), corresponding external evaluations of competence (e.g., teacher-rated academic skills, peer-nominated “likeability”), and multiple measures of youths' overall adjustment. Multiphase growth models replicate previous research, suggesting significant decline in academic self-concept during middle school but modest growth in social self-concept from 3rd through 7th grade. Next, a new contribution is made to the literature by quantifying the amount of within-subject variability (i.e., “lability”) around these linear self-concept trajectories as a between-subjects characteristic. Self-concept lability was found to associate with a general profile of poorer competence and adjustment and to predict poorer academic and social competence at the end of 7th grade above and beyond level of self-concept. Finally, there was substantial evidence that wave-to-wave changes in youths' self-concepts correspond to teacher and peer evaluations of youths' competence, that attention to peer feedback may be particularly strong during middle school, and that these relations may be moderated by between-subjects indicators of youths' general adjustment. Overall, findings highlight the utility of methods sensitive to within-subject variation for clarifying the dynamics of youths' self-system development. (PsycINFO Database Record (c) 2011 APA, all rights reserved)     

The ontogeny of interstimulus interval (ISI) discrimination of the conditioned eyeblink response in rats.

Discrimination of the eyeblink conditioned response (CR) between conditioned stimuli (CSs) of different durations and modalities was examined across development in rats. Interstimulus interval (ISI) discrimination was evident at Postnatal Days 23-34 in Experiment 1, and earlier CR peak latencies and enhanced CR amplitudes were seen to the long CS in the ISI discrimination group relative to a control group receiving the short CS without reinforcement. Experiment 2 showed that early CR peak latencies and enhanced CR amplitudes to the long CS in the ISI discrimination group were due to associative pairing of the short CS and unconditioned stimulus. Experiment 3 demonstrated ISI discrimination in adults that was improved relative to younger subjects, but with no enhancement of CR amplitude to the long CS in the ISI discrimination group. Cerebellar cortical maturation may influence the ontogeny of CR timing. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Using analysis of covariance (ANCOVA) with fallible covariates.

Analysis of covariance (ANCOVA) is used widely in psychological research implementing nonexperimental designs. However, when covariates are fallible (i.e., measured with error), which is the norm, researchers must choose from among 3 inadequate courses of action: (a) know that the assumption that covariates are perfectly reliable is violated but use ANCOVA anyway (and, most likely, report misleading results); (b) attempt to employ 1 of several measurement error models with the understanding that no research has examined their relative performance and with the added practical difficulty that several of these models are not available in commonly used statistical software; or (c) not use ANCOVA at all. First, we discuss analytic evidence to explain why using ANCOVA with fallible covariates produces bias and a systematic inflation of Type I error rates that may lead to the incorrect conclusion that treatment effects exist. Second, to provide a solution for this problem, we conduct 2 Monte Carlo studies to compare 4 existing approaches for adjusting treatment effects in the presence of covariate measurement error: errors-in-variables (EIV; Warren, White, & Fuller, 1974), Lord's (1960) method, Raaijmakers and Pieters's (1987) method (R&P), and structural equation modeling methods proposed by S?rbom (1978) and Hayduk (1996). Results show that EIV models are superior in terms of parameter accuracy, statistical power, and keeping Type I error close to the nominal value. Finally, we offer a program written in R that performs all needed computations for implementing EIV models so that ANCOVA can be used to obtain accurate results even when covariates are measured with error. (PsycINFO Database Record (c) 2011 APA, all rights reserved)     

The process of Retirement Planning Scale (PRePS): Development and validation.

Although a substantial proportion of the western population is approaching retirement age, little is known about how they are preparing for the future. Much attention has been paid to the consumption of educational material and retirement wealth in the present literature, but the process of retirement planning has been ignored. S. L. Friedman and E. K. Scholnick's (1997) theoretical model provided the basis for a comprehensive measure of retirement planning. According to their process theory, individuals develop an understanding of the problem, set goals, make a decision to start preparing, and finally undertake the behaviors needed to fulfill their goals. Fifty-two items were developed to assess each stage of the planning process for financial, health, lifestyle, and psychosocial retirement planning. These were tested on a population sample of 1,449 New Zealanders aged 49–60. Confirmatory factor analysis, bivariate correlations, and hierarchical regression provided support for the valid use of the measure. Necessary antecedents, such as the tendency to look to the future, and locus of control were significantly related to the Process of Retirement Planning Scale (PRePS). The PRePS also outperformed retirement planning measures used in the Health and Retirement Study (F. T. Juster & R. Suzman, 1995) after controlling for socioeconomic and psychological variables. This measure will enable social policy makers to determine which stages of retirement planning require support and intervention. The PRePS will also help to determine which domains of retirement planning predict well-being in later life and the factors which differentiate those who are planning from those who are not. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Review of Handbook of measurement and evaluation in rehabilitation (second edition).

Reviews the book, Handbook of measurement and evaluation in rehabilitation (second edition) by Brian Bolton (1987). This book is an excellent introduction to assessment issues and techniques for rehabilitation professionals. An impressive roster of experts in the fields of psychometrics and rehabilitation contributed to this second edition. There are three main sections to the book: a brief introduction to principles of measurement (scores and norms, reliability and validity), discussions of five major types of instruments used with rehabilitation populations (such as intelligence testing and personality testing), and an extended review of assessment applications, ranging from process areas such as career development to specific populations such as mentally retarded individuals. A main strength of the book is its consideration of measurement issues in broad terms; a number of chapters could be lifted and used almost unchanged in other fields in which intelligence testing or career development is relevant. Also, the volume is well referenced and does not shrink from dealing straightforwardly with complex issues. There are also some significant omissions in the volume. Perhaps the most serious of these is the scant attention given to the rise of the computer in rehabilitation assessment. On balance, the handbook seems an evident front-runner for use in training rehabilitation professionals about the basics of assessment. Bolton's book provides a sturdy foundation for learning about assessment, filled as it is with important concepts and a sense of the field's history. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Does decision quality (always) increase with the size of information samples? Some vicissitudes in applying the law of large numbers.

Adaptive decision making requires that contingencies between decision options and their relative assets be assessed accurately and quickly. The present research addresses the challenging notion that contingencies may be more visible from small than from large samples of observations. An algorithmic account for such a seemingly paradoxical effect is offered within a satisficing-choice framework. Accordingly, a choice is only made when the sample contingency describing the relative evaluation of the 2 options exceeds a critical threshold. Small samples, because of the high dispersion of their sampling distribution, facilitate above-threshold contingencies. Across a broad range of parameters, the resulting small-sample advantage in terms of hits is stronger than their disadvantage in false alarms. Computer simulations and experiments support the model predictions. The relative advantage of small samples is most apparent when information loss is low, when the threshold is high relative to the ecological contingency, and when the sampling process is self-truncated. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

An inferential confidence interval method of establishing statistical equivalence that corrects Tryon's (2001) reduction factor.

Evidence of group matching frequently takes the form of a nonsignificant test of statistical difference. Theoretical hypotheses of no difference are also tested in this way. These practices are flawed in that null hypothesis statistical testing provides evidence against the null hypothesis and failing to reject H? is not evidence supportive of it. Tests of statistical equivalence are needed. This article corrects the inferential confidence interval (ICI) reduction factor introduced by W. W. Tryon (2001) and uses it to extend his discussion of statistical equivalence. This method is shown to be algebraically equivalent with D. J. Schuirmann's (1987) use of 2 one-sided t tests, a highly regarded and accepted method of testing for statistical equivalence. The ICI method provides an intuitive graphic method for inferring statistical difference as well as equivalence. Trivial difference occurs when a test of difference and a test of equivalence are both passed. Statistical indeterminacy results when both tests are failed. Hybrid confidence intervals are introduced that impose ICI limits on standard confidence intervals. These intervals are recommended as replacements for error bars because they facilitate inferences. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

How to (and how not to) assess the integrity of managers.

This article concerns how to evaluate the integrity of managers, with an emphasis on identifying those with low integrity. After defining our terms, we review leadership research showing that subordinate perceptions of their manager's integrity determine how much they trust their manager which, in turn, influences their attitudes and performance. Next we evaluate a common method for assessing the integrity of managers. This method defines integrity as a leadership competency and measures it using coworker ratings of observed ethical behavior. We found that these behavioral ratings suggested only a negligible proportion of managers may have integrity issues and did not distinguish high- from low-performing managers. We then propose an alternative method based on subordinate expectations about the likelihood that their boss would behave unethically. This method suggested that a much larger proportion of managers may have integrity issues and did distinguish high- from low-performing managers. Based on these findings, we offer recommendations for assessing integrity in practice and urge the leadership field to seriously consider the prevalence and impact of managerial misconduct. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

The Physical Health Questionnaire (PHQ): Construct Validation of a Self-Report Scale of Somatic Symptoms.

The authors report the results of 3 studies that were conducted to evaluate the psychometric properties of the Physical Health Questionnaire (PHQ), a brief self-report scale of somatic symptoms. In Study 1, exploratory factor analysis results revealed 4 empirically distinct dimensions of somatic symptoms: gastrointestinal problems, headaches, sleep disturbances, and respiratory illness. In Study 2, this structure was replicated using confirmatory factor analysis, and correlations of the PHQ dimensions with measures of negative affect, psychological health, and job performance provided further validity evidence. In Study 3, a minor revision to the wording of several items helped to address the limitations of one of the PHQ subscales. Together, these results provide evidence of the construct validity of the PHQ. (PsycINFO Database Record (c) 2010 APA, all rights reserved)