Latent structure and factorial invariance of a neuropsychological test battery for the study of preclinical Alzheimer's disease.

Objective: To examine the latent structure of a test battery currently being used in a longitudinal study of asymptomatic middle-aged adults with a parental history of Alzheimer's disease (AD) and test the invariance of the factor solution across subgroups defined by selected demographic variables and known genetic risk factors for AD. Method: An exploratory factor analysis (EFA) and a sequence of confirmatory factor analyses (CFA) were conducted on 24 neuropsychological measures selected to provide a comprehensive estimate of cognitive abilities most likely to be affected in preclinical AD. Once the underlying latent model was defined and the structural validity established through model comparisons, a multigroup confirmatory factor analysis model was used to test for factorial invariance across groups. Results: The EFA solution revealed a factor structure consisting of five constructs: verbal ability, visuospatial ability, speed & executive function, working memory, and verbal learning & memory. The CFA models provided support for the hypothesized 5-factor structure. Results indicated factorial invariance of the model across all groups examined. Conclusions: Collectively, the results suggested a relatively strong psychometric basis for using the factor structure in clinical samples that match the characteristics of this cohort. This confirmed an invariant factor structure should prove useful in research aimed to detect the earliest cognitive signature of preclinical AD in similar middle aged cohorts. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Construct validity of the multidimensional structure of bullying and victimization: An application of exploratory structural equation modeling.

Existing research posits multiple dimensions of bullying and victimization but has not identified well-differentiated facets of these constructs that meet standards of good measurement: goodness of fit, measurement invariance, lack of differential item functioning, and well-differentiated factors that are not so highly correlated as to detract from their discriminant validity and substantive usefulness in school settings. Here we demonstrate exploratory structural equation modeling, an integration of confirmatory factor analysis and exploratory factor analysis. On the basis of responses to the 6-factor Adolescent Peer Relations Instrument (verbal, social, physical facets of bullying and victimization), we tested invariance of factor loadings, factor variances–covariances, item uniquenesses, item intercepts (a lack of differential item functioning), and latent means across gender, year in school, and time. Using a combination of relations with student characteristics and a multitrait–multimethod analysis, we showed that the 6 bully/victim factors have discriminant validity over time and in relation to gender, year in school, and relevant psychosocial correlates (e.g., depression, 11 components of academic and nonacademic self-concept, locus of control, attitudes toward bullies and victims). However, bullies and victims are similar in many ways, and longitudinal panel models of the positive correlations between bully and victim factors suggest reciprocal effects such that each is a cause and an effect of the other. (PsycINFO Database Record (c) 2011 APA, all rights reserved)     

Confirmatory factor analysis and item response theory: Two approaches for exploring measurement invariance.

Investigated the utility of confirmatory factor analysis (CFA) and item response theory (IRT) models for testing the comparability of psychological measurements. Both procedures were used to investigate whether mood ratings collected in Minnesota and China were comparable. Several issues were addressed. The 1st issue was that of establishing a common measurement scale across groups, which involves full or partial measurement invariance of trait indicators. It is shown that using CFA or IRT models, test items that function differentially as trait indicators across groups need not interfere with comparing examinees on the same trait dimension. Second, the issue of model fit was addressed. It is proposed that person-fit statistics be used to judge the practical fit of IRT models. Finally, topics for future research are suggested. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Verbal ability and executive functioning development in preschoolers at head start.

Research suggests that executive functioning skills may enhance the school readiness of children from disadvantaged homes. Questions remain, however, concerning both the structure and the stability of executive functioning among preschoolers. In addition, there is a lack of research addressing potential predictors of longitudinal change in executive functioning during early childhood. This study examined the structure of executive functioning from fall to spring of the preschool year using a multimethod battery of measures. Confirmatory factor analyses revealed a unidimensional model fit the data well at both time points, and tests of measurement invariance across time points indicated that children's mean latent executive functioning scores significantly improved over time. Verbal ability was a significant predictor of longitudinal change in executive functioning. Theoretical implications and directions for future research are discussed. (PsycINFO Database Record (c) 2011 APA, all rights reserved)     

Are performance appraisal ratings from different rating sources comparable?

The purpose of this study was to test whether a multisource performance appraisal instrument exhibited measurement invariance across different groups of raters. Multiple-groups confirmatory factor analysis as well as item response theory (IRT) techniques were used to test for invariance of the rating instrument across self, peer, supervisor, and subordinate raters. The results of the confirmatory factor analysis indicated that the rating instrument was invariant across these rater groups. The IRT analysis yielded some evidence of differential item and test functioning, but it was limited to the effects of just 3 items and was trivial in magnitude. Taken together, the results suggest that the rating instrument could be regarded as invariant across the rater groups, thus supporting the practice of directly comparing their ratings. Implications for research and practice are discussed, as well as for understanding the meaning of between-source rating discrepancies. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Measurement invariance of the Gifted Rating Scales—School Form across five cultural groups.

This study examined measurement invariance of the Gifted Rating Scales—School Form (GRS–S) across the United States, Puerto Rico, China, South Korea, and Turkey, using multigroup confirmatory factor analysis. A total of 1,817 students were rated by 287 teachers using either translated versions of GRS–S or the original English GRS–S. Results indicate a similar factor structure for the GRS–S across the five locations; six factors with each of the 72 items equivalently loaded to the same latent variable across groups. The metric invariance test and the factor variance and covariance invariance tests reveal that the patterns of factor loadings and the factor variances and covariances are invariant across the five groups. Moreover, the scalar invariance test indicates that item means are equivalent across the groups. These results suggest that the GRS–S has intercultural utility and can be similarly interpreted. Implications and limitations of the present research for gifted identification are discussed. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Psychometric approaches for developing commensurate measures across independent studies: Traditional and new models.

[Correction Notice: An erratum for this article was reported in Vol 14(4) of Psychological Methods (see record 2009-22665-007). In this article, the authors wrote, "To our knowledge, the multisample framework is the only available option within these [latent variable] programs that allows for the moderation of all types of parameters, and this approach requires a single categorical moderator variable to define the samples.” Bengt Muthén has clarified for the authors that some programs, including Mplus and Mx, can allow for continuous moderation through the implementation of nonlinear constraints involving observed variables, further enlarging the class of MNLFA models that can be fit with these programs.] When conducting an integrative analysis of data obtained from multiple independent studies, a fundamental problem is to establish commensurate measures for the constructs of interest. Fortunately, procedures for evaluating and establishing measurement equivalence across samples are well developed for the linear factor model and commonly used item response theory models. A newly proposed moderated nonlinear factor analysis model generalizes these models and procedures, allowing for items of different scale types (continuous or discrete) and differential item functioning across levels of categorical and/or continuous variables. The potential of this new model to resolve the problem of measurement in integrative data analysis is shown via an empirical example examining changes in alcohol involvement from ages 10 to 22 years across 2 longitudinal studies. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Cross-language measurement equivalence of parenting measures for use with Mexican American populations.

Increasing diversity among families in the United States often necessitates the translation of common measures into various languages. However, even when great care is taken during translations, empirical evaluations of measurement equivalence are necessary. The current study demonstrates the analytic techniques researchers should use to evaluate the measurement equivalence of translated measures. To this end we investigated the cross-language measurement equivalence of several common parenting measures in a sample of 749 Mexican American families. The item invariance results indicated similarity of factor structures across language groups for each of the parenting measures for both mothers and children. Construct validity tests indicated similar slope relations between each of the 4 parenting measures and the outcomes across the 2 language groups for both mothers and children. Equivalence in intercepts, however, was only achieved for some outcomes. These findings indicate that the use of these measures in both within-group and between-group analyses based on correlation/covariance structure is defensible, but researchers are cautioned against interpretations of mean level differences across these language groups. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Is aggression the same for boys and girls? Assessing measurement invariance with confirmatory factor analysis and item response theory.

Gender differences in aggression have typically been based on studies utilizing a mean difference method. From a measurement perspective, this method is inherently problematic unless an aggression measure possesses comparable validity across gender. Stated differently, establishing measurement invariance on the measure of aggression is prerequisite to making any inferences about gender differences. This paper investigated whether aggression functions in the same way across gender using teacher-rated aggression scales from the Behavior Assessment System for Children (BASC). The samples for this study consisted of the BASC standardization samples, including 1,223 children (628 boys, 595 girls) and 788 adolescents (379 boys, 409 girls). The measurement invariance of the BASC aggression scales was examined with both confirmatory factor analysis (CFA) and item response theory (IRT). CFA results showed that there was not enough evidence to support the measurement invariance of the scales across gender at a scale level; IRT results found that only a few items were significantly different across gender. The two methods have similarities and differences in studying measurement invariance, so they can be complementary to each other. The implications of the findings for research and practice in school psychology are discussed. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

The Role of Nonlinear Factor-to-Indicator Relationships in Tests of Measurement Equivalence.

Measurement invariance is a necessary condition for the evaluation of factor mean differences over groups or time. This article considers the potential problems that can arise for tests of measurement invariance when the true factor-to-indicator relationship is nonlinear (quadratic) and invariant but the linear factor model is nevertheless applied. The factor loadings and indicator intercepts of the linear model will diverge across groups as the factor mean difference increases. Power analyses show that even apparently small quadratic effects can result in rejection of measurement invariance at moderate sample sizes when the factor mean difference is medium to large. Recommendations include the identification of nonlinear relationships using diagnostic plots and consideration of newly developed methods for fitting nonlinear factor models. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Age-related invariance of abilities measured with the Wechsler Adult Intelligence Scale-III.

Examination of measurement invariance tests the assumption that the model underlying a set of test scores is directly comparable across groups. The observation of measurement invariance provides fundamental evidence for the inference that scores on a test afford equivalent measurement of the same psychological traits among diverse groups. Groups may be derived from different psychosocial backgrounds or different clinical presentations. In the Wechsler Adult Intelligence Scale-III (WAIS-III)/Wechsler Memory Scale-III (WMS-III) Technical Manual (Psychological Corporation, 2002), there appears to be a breakdown in factor structure among the standardization cases in older adults. In this study, the authors evaluated the invariance of the measurement model of the WAIS-III across 5 age bands. All components of the measurement model were examined. Overall, the evidence pointed to invariance across age of a modified 4-factor model that included cross-loadings for the Similarities and Arithmetic subtests. These results support the utility of the WAIS-III as a measure of stable intelligence traits across a wide age range. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

"Psychometric approaches for developing commensurate measures across independent studies: Traditional and new models": Clarification to Bauer and Hussong (2009).

Reports a clarification to "Psychometric approaches for developing commensurate measures across independent studies: Traditional and new models" by Daniel J. Bauer and Andrea M. Hussong (Psychological Methods, 2009[Jun], Vol 14[2], 101-125). In this article, the authors wrote, "To our knowledge, the multisample framework is the only available option within these [latent variable] programs that allows for the moderation of all types of parameters, and this approach requires a single categorical moderator variable to define the samples.” Bengt Muthén has clarified for the authors that some programs, including Mplus and Mx, can allow for continuous moderation through the implementation of nonlinear constraints involving observed variables, further enlarging the class of MNLFA models that can be fit with these programs. (The following abstract of the original article appeared in record 2009-08072-001.) When conducting an integrative analysis of data obtained from multiple independent studies, a fundamental problem is to establish commensurate measures for the constructs of interest. Fortunately, procedures for evaluating and establishing measurement equivalence across samples are well developed for the linear factor model and commonly used item response theory models. A newly proposed moderated nonlinear factor analysis model generalizes these models and procedures, allowing for items of different scale types (continuous or discrete) and differential item functioning across levels of categorical and/or continuous variables. The potential of this new model to resolve the problem of measurement in integrative data analysis is shown via an empirical example examining changes in alcohol involvement from ages 10 to 22 years across 2 longitudinal studies. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Confirmatory factor structure of the Kaufman Assessment Battery for Children--Second Edition: Consistency with Cattell-Horn-Carroll theory.

The Kaufman Assessment Battery for Children-Second Edition (KABC-II) is a departure from the original KABC in that it allows for interpretation via two theoretical models of intelligence. This study had two purposes: to determine whether the KABC-II measures the same constructs across ages and to investigate whether those constructs are consistent with Cattell-Horn-Carroll (CHC) theory. Multiple-sample analyses were used to test for equality of the variance-covariance matrices across the 3- to 18-year-old sample. Higher-order confirmatory factor analyses were used to compare the KABC-II model with rival CHC models for children ages 6 to 18. Results show that the KABC-II measures the same constructs across all ages. The KABC-II factor structure for school-age children is aligned closely with five broad abilities from CHC theory, although some inconsistencies were found. Models without time bonuses fit better than those with time bonuses. The results provide support for the construct validity of the KABC-II. Additional research is needed to more completely understand the measurement of fluid reasoning and the role of time bonuses on some tasks. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

What is being assessed and why it matters: The impact of transient error on trait research.

Temporal instability can reflect either true psychological change or transient measurement error, and it is important that trait psychologists be able to distinguish one from the other. The authors report results from large retest studies of Big Five, trait affectivity, and personality disorder measures across time frames (2 months and 2 weeks) over which these constructs should show little or no true change. On average, nearly 25% of the variance in the measures was a product of transient error rather than true change; however, the proportion of error varied widely—but consistently—across measures. In addition, a reexamination of long-term longitudinal data demonstrated that ignoring transient error can lead to inaccurate conclusions. Most notably, a substantial portion of the observed instability in the Big Five and trait affectivity is due to transient error; thus, these traits are even more stable than commonly thought. The present data further suggest that previous reports of differential stability between the Big Five and trait affectivity are due, in part, to differential levels of transient error in measures of these constructs. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Longitudinal invariance of adult psychometric ability factor structures across 7 years.

The hypothesis that psychometric ability tests retain equivalent factor structures across a 7-year interval was examined in a sample of 984 persons (disaggregated into 6 cohort groups: M ages at first test?=?32, 46, 53, 60, 67, and 76), assessed in 1984 and 1991 as part of the Seattle Longitudinal Study. A best fitting measurement model was estimated for 20 psychometric tests marking the 6 primary abilities of Inductive Reasoning, Spatial Orientation, Perceptual Speed, Numeric Facility, Verbal Ability, and Verbal Recall. Gender was partialed out at the variable level by including a gender factor. Weak factorial invariance over time was demonstrated for all cohorts. Configural invariance could be demonstrated across all cohort groups. However, weak factorial invariance across groups could be accepted for all but the youngest and oldest groups. Latent means were modeled for the accepted solutions across time and cohort groups. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Pooling data from multiple longitudinal studies: The role of item response theory in integrative data analysis.

There are a number of significant challenges researchers encounter when studying development over an extended period of time, including subject attrition, the changing of measurement structures across groups and developmental periods, and the need to invest substantial time and money. Integrative data analysis is an emerging set of methodologies that allows researchers to overcome many of the challenges of single-sample designs through the pooling of data drawn from multiple existing developmental studies. This approach is characterized by a host of advantages, but this also introduces several new complexities that must be addressed prior to broad adoption by developmental researchers. In this article, the authors focus on methods for fitting measurement models and creating scale scores using data drawn from multiple longitudinal studies. The authors present findings from the analysis of repeated measures of internalizing symptomatology that were pooled from three existing developmental studies. The authors describe and demonstrate each step in the analysis and conclude with a discussion of potential limitations and directions for future research. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

On the nature and direction of relationships between constructs and measures.

Theory development typically focuses on relationships among theoretical constructs, placing little emphasis on relationships between constructs and measures. In most cases, constructs are treated as causes of their measures. However, this causal flow is sometimes reversed, such that measures are viewed as causes of constructs. Procedures have been developed to identify and estimate models that specify constructs as causes or effects of measures. However, these procedures provide little guidance for determining a priori whether constructs should be specified as causes or effects of their measures. Moreover, these procedures address few of the possible causal structures by which constructs and measures may be related. This article develops principles for specifying the direction and structure of relationships between constructs and measures. These principles are illustrated using examples from psychological, sociological, and organizational research. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Effects of cognitive training on primary mental ability structure.

We report results of the first empirical test, as far as we know, of the assumption of structural invariance of latent constructs from pretest to posttest in cognitive training research on the elderly. In all, 401 participants in the Seattle Longitudinal Study, over 62 years old, received a 5-hr test battery at pre- and posttest that included 16 ability tests, marking the five primary abilities of Spatial Orientation, Inductive Reasoning, Numerical Ability, Verbal Ability, and Perceptual Speed. A total of 229 of our subjects received 5 hrs of individual training on either Spatial Orientation or Inductive Reasoning. Restricted factor analysis with the {lisrel} algorithm tested the hypothesis of measurement equivalence across test occasions, separately for the control subjects and for each of the training groups. When ability-specific cognitive training intervenes, no structural change is observed for abilities not subject to intervention. However, slight shifts occurred in the optimal regression weights for the different markers for the training target abilities. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

The influence of phonological processing and inattentive behavior on reading acquisition.

This article reports the findings from a longitudinal study investigating the influence of phonological processing and inattentive behavior on reading acquisition. Data from individually administered measures of phonological processing and reading, as well as teacher ratings of children's behavior, were collected from a cohort of 132 children at 12-month intervals, from kindergarten to 2nd grade. Results from multiple linear regression analyses employing latent constructs of phonological abilities and inattentive behavior provided support for the hypothesized model, with kindergarten measures of inattentiveness and phonological abilities predicting subsequent reading performance. An analysis of reciprocal relationships among these constructs revealed evidence that inattentiveness also interfered with the acquisition of phonological analysis skills. Implications for reading instruction and reading interventions are discussed. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Coherence and cross-situational generality in personality: A new analysis of old problems.

An analysis of personality constructs indicates that the research supporting these beliefs has failed to provide an adequate test of either coherence or cross-situational generality. Specifically, it is proposed that when personality constructs are measured by sampling the occurrence of multiple referents of the construct in multiple situations, both coherence and cross-situational generality can be demonstrated. To test this, 56 3–5 yr olds' dominance and dependency behaviors were observed in multiple situations. Results indicate that (a) multiple-referent sampling increased the coherence of both constructs, (b) dominance exhibited greater coherence than dependency, and (c) predictive accuracy across situations was enhanced by multiple-situation sampling for dominance but not for dependency. Data support the usefulness of appropriately measured personality constructs in predicting behavior. (44 ref) (PsycINFO Database Record (c) 2010 APA, all rights reserved)