Is It Prudent to Administer All Items for Each Child Behavior Checklist Cross-Informant Syndrome? Evaluating the Psychometric Properties of the Youth Self-Report Dimensions With Confirmatory Factor Analysis and Item Response Theory.

Through surveying of children in 10 nations with parent, teacher, and Youth Self-Report (YSR) forms of the Child Behavior Checklist (CBCL), cross-informant syndromes (CISs) were derived and cross-validated by sample-dependent methodology. Generalizing CBCL syndromes and norms to nations excluded from its normative sample is problematic. This study used confirmatory factor analyses (CFAs) to test factor model fit for CISs on the YSR responses of 625 Jamaican children ages 11 to 18 years. Item response theory (IRT), a sample independent methodology, was used to estimate the psychometric properties of individual items on each dimension. CFAs indicated poor to moderate model-to-data fit. Across all syndromes, IRT analyses revealed that more than 3/4 of the cross-informant items yielded little information. Eliminating such items could be cost effective in terms of administration time yet improve the measure's discrimination across syndrome severity levels. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Cluster-branching methodology for adaptive testing and the development of the Adaptive Category Test.

Adaptive testing involves the adjustment of a set of test items, in accordance with an individual's characteristics, to minimize items that do not yield useful information. The best known methodology used to develop adaptive tests, item response theory (IRT), cannot be used with most psychological instruments. The authors propose using cluster analysis to develop a branching logic that would allow the adaptive administration of such instruments. The proposed methodology is described in detail and is used to develop an adaptive version of the Halstead Category Test (W. Halstead & P. Settlage, 1943) from archival data. Real-data simulations show the Adaptive Category Test to yield scores that are not significantly different from the scores actually obtained on the original version of the test. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Constructing personality scales under the assumptions of an ideal point response process: Toward increasing the flexibility of personality measures.

The main aim of this article is to explicate why a transition to ideal point methods of scale construction is needed to advance the field of personality assessment. The study empirically demonstrated the substantive benefits of ideal point methodology as compared with the dominance framework underlying traditional methods of scale construction. Specifically, using a large, heterogeneous pool of order items, the authors constructed scales using traditional classical test theory, dominance item response theory (IRT), and ideal point IRT methods. The merits of each method were examined in terms of item pool utilization, model-data fit, measurement precision, and construct and criterion-related validity. Results show that adoption of the ideal point approach provided a more flexible platform for creating future personality measures, and this transition did not adversely affect the validity of personality test scores. (PsycINFO Database Record (c) 2011 APA, all rights reserved)     

Development of psychometrically matched English and Spanish language neuropsychological tests for older persons.

Item response theory (IRT) methods were used to develop a neuropsychological test battery with matched English and Spanish language forms. Candidate items for 12 scales measuring core neuropsychological abilities were generated and administered to 200 community-dwelling elderly participants tested in Spanish and 208 tested in English. IRT methods were used to eliminate linguistically biased items and refine scales to assess broad ability ranges. Reasonably good psychometric matching of scales was achieved within and across English and Spanish language forms. All scales were sensitive to cognitive impairment as measured by the Mini-Mental State Examination (MMSE), with highly similar relationships between scale scores and MMSE across English and Spanish groups. The outcome supports the use of IRT methods in cross-cultural and multilingual test development and indicates that this strategy has potential for future neuropsychological test development. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Combining activities of daily living with instrumental activities of daily living to measure functional disability

Measures of functional disability typically contain items that reflect limitations in performing activities of daily living (ADLs) or instrumental activities of daily living (IADLs). Combining IADL and ADL items together in the same scale would provide enhanced range and sensitivity of measurement. This article presents psychometric justification for a combined ADL/IADL scale. Data come from 2,977 disabled respondents in the 1989 National Long-Term Care Survey. Respondents indicated whether they received human help on 7 ADL items; they also indicated whether they were unable to perform each of 9 IADL items due to health reasons. Factor analyses using tetrachoric correlations demonstrated that 15 of the 16 items reflected one major dimension. Item response theory (IRT) methods were used to calibrate the items; a one-parameter IRT model fit the data. Item calibrations showed that ADL and IADL items were not hierarchically related. Analyses showed that a simple sum of item responses could be used to derive a measure of functional disability. Implications of using a 15-item ADL/IADL scale for eligibility determination and for comparing groups are discussed.     

More Information From Fewer Questions: The Factor Structure and Item Properties of the Original and Brief Fear of Negative Evaluation Scale.

Statistical methods designed for categorical data were used to perform confirmatory factor analyses and item response theory (IRT) analyses of the Fear of Negative Evaluation scale (FNE; D. Watson & R. Friend, 1969) and the Brief FNE (BFNE; M. R. Leary, 1983). Results suggested that a 2-factor model fit the data better for both the FNE and the BFNE, although the evidence was less strong for the FNE. The IRT analyses indicated that although both measures had items with good discrimination, the FNE items discriminated only at lower levels of the underlying construct, whereas the BFNE items discriminated across a wider range. Convergent validity analyses indicated that the straightforwardly-worded items on each scale had significantly stronger relationships with theoretically related measures than did the reverse-worded items. On the basis of all analyses, usage of the straightforwardly-worded BFNE factor is recommended for the assessment of fear of negative evaluation. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Context and serial-order effects in personality measurement: Limits on the generality of measuring changes the measure.

It has recently been argued that the process of measuring personality constructs changes the consistency of responses to items. E. S. Knowles (see record 1989-00043-001) showed that items appearing later in a questionnaire are more related to total score than items appearing earlier. J. C. Hamilton and T. R. Shuminsky (see record 1991-08792-001) offered empirical support for the hypothesis that level of self-awareness is responsible for this serial-order effect. The present study investigated the generality of the proposition that measuring personality constructs using a self-report questionnaire changes the construct measured. With techniques of item response theory (IRT), it was found that the findings of previous investigations may be explained by more specific item-context effects due to both the item's content and serial position. These findings are discussed within a framework that uses IRT to test hypotheses about item-context effects and personality measurement. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Identification of unique cultural response patterns by means of item response theory.

An item response theory (IRT) analysis was used to identify unique cultural response patterns by comparing single-culture groups with a multicultural composite. A survey designed to measure attitudes toward mental health was administered in their native languages to American, German, and French working, retired, and student teachers. Item characteristic curves (ICCs) for each national group were compared with ICCs generated by composite reference containing all 3 cultural groups, thus providing an omnicultural reference point. Items that exhibited differential item functioning, that is, items with dissimilar ICCs for the composite reference and focal groups, were indicative of unique cultural response patterns to the attitude survey items. The advantages and disadvantages of this method in an IRT are discussed. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

The dimensionality of phonological awareness: An application of item response theory.

A battery of 7 tasks composed of 105 items thought to measure phonological awareness skills was administered to 945 children in kindergarten through 2nd grade. Results from confirmatory factor analysis at the task level and modified parallel analysis at the item level indicated that performance on these tasks was well represented by a single latent dimension. A 2-parameter logistic item response (IRT) model was also fit to the performance on the 105 items. Information obtained from the IRT model demonstrated that the tasks varied in the information they provided about a child's phonological awareness skills. These results showed that phonological awareness, as measured by these tasks, appears to be well represented as a unidimensional construct, but the tasks best suited to measure phonological awareness vary across development. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

A parametric model for local dependence among test items.

A framework is presented to model instances of local dependence between items within the context of unidimensional item response theory (IRT). A distinction is made between item main effects and item interactions. Four types of models for interdependent items are considered, on the basis of the distinction between order dependency and combination dependency on the one hand, and dimension-dependent versus constant interaction on the other hand. For each of the 4 model types, variants of the 1-parameter logistic model can be formulated as well as variants of the 2-parameter logistic model. A number of existing IRT models for polytomous items that are variants of the partial credit model may be reconsidered in these terms. Two examples are given to demonstrate the approach. (PsycINFO Database Record (c) 2011 APA, all rights reserved)     

Psychopathy and ethnicity: Structural, item, and test generalizability of the Psychopathy Checklist—Revised (PCL-R) in Caucasian and African American participants.

The Psychopathy Checklist--Revised (PCL-R) is an important measure in both applied and research settings. Evidence for its validity is mostly derived from male Caucasian participants. PCL-R ratings of 359 Caucasian and 356 African American participants were compared using confirmatory factor analysis (CFA) and item response theory (IRT) analyses. Previous research has indicated that 13 items of the PCL-R can be described by a 3-factor hierarchical model. This model was replicated in this sample. No cross-group difference in factor structure could be found using CFA; the structure of psychopathy is the same in both groups. IRT methods indicated significant but small differences in the performance of 5 of the 20 PCL-R items. No significant differential test functioning was found, indicating that the item differences canceled each other out. It is concluded that the PCL-R can be used, in an unbiased way, with African American participants. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Detecting differential item functioning with confirmatory factor analysis and item response theory: Toward a unified strategy.

In this article, the authors developed a common strategy for identifying differential item functioning (DIF) items that can be implemented in both the mean and covariance structures method (MACS) and item response theory (IRT). They proposed examining the loadings (discrimination) and the intercept (location) parameters simultaneously using the likelihood ratio test with a free-baseline model and Bonferroni corrected critical p values. They compared the relative efficacy of this approach with alternative implementations for various types and amounts of DIF, sample sizes, numbers of response categories, and amounts of impact (latent mean differences). Results indicated that the proposed strategy was considerably more effective than an alternative approach involving a constrained-baseline model. Both MACS and IRT performed similarly well in the majority of experimental conditions. As expected, MACS performed slightly worse in dichotomous conditions but better than IRT in polytomous cases where sample sizes were small. Also, contrary to popular belief, MACS performed well in conditions where DIF was simulated on item thresholds (item means), and its accuracy was not affected by impact. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Summed-score linking using item response theory: Application to depression measurement.

An item response theory (IRT) approach to test linking based on summed scores is presented and demonstrated by calibrating a modified 23-item version of the Center for Epidemiologic Studies Depression Scale (CES-D) to the standard 20-item CES-D. Data are from the Depression Patient Outcomes Research Team, 11, which used a modified CES-D to measure risk for depression. Responses (N?=?1,120) to items on both the original and modified versions were calibrated simultaneously using F. Samejima's (1969, 1997) graded IRT model. The 2 scales were linked on the basis of derived summed-score-to-IRT-score translation tables. The established cut score of 16 on the standard CES-D corresponded most closely to a summed score of 20 on the modified version. The IRT summed-score approach to test linking is a straightforward, valid, and practical method that can be applied in a variety of situations. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Differential item functioning: Implications for test translations.

Statistical methods based on item response theory (IRT) were used to bidirectionally evaluate the measurement equivalence of translated American and German intelligence tests. Items that displayed differential item functioning (DIF) were identified, and content analysis was used to determine probable sources, of DIF, either cultural or linguistic. The benefits of using an IRT analysis in examining the fidelity of translated tests are described. In addition, the influence of cultural differences on test translations and the use of DIF items to elucidate cultural differences are discussed. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Nondestructive Testing of GFRP Bridge Decks Using Ground Penetrating Radar and Infrared Thermography

As glass fiber-reinforced polymer (GFRP) bridge decks are becoming a feasible alternative to the traditional concrete bridge decks, an innovative methodology to evaluate the in situ conditions are vital to GFRP bridge decks’ full implementation. Ground penetrating radar (GPR) typically performs well in detecting subsurface condition of a structural component with moisture pockets trapped within the material. On the other hand, infrared thermography (IRT) is traditionally known for its ability to detect air pockets within the material. In order to evaluate both nondestructive testing methods’ effectiveness for subsurface condition assessment of GFRP bridge deck, debonds of various sizes were embedded into a GFRP bridge deck module. A 1.5 GHz ground-coupled GPR system and a radiometric infrared camera were used to scan the deck module for condition assessment. Test results showed that both GPR and IRT retained their respective effectiveness in detecting subsurface anomalies. GPR was found to be capable of detecting water-filled defects as small as 5×5?cm2 in plan size, and as thin as 0.15 cm. Furthermore, tests on additional specimens showed that the GPR system offers some promise in detecting bottom flange defects as far down as 10 cm deep. IRT, on the other hand, showed that it is capable of finding both water-filled and air-filled defects within the top layers of the deck with solar heating as main source of heat flux. While test results showed IRT is more sensitive to air-filled defects, water-filled defects can still be detected with a large enough heating mechanism. The experiments showed that a more detailed and accurate assessment can be achieved by combining both GPR and IRT.     

Are performance appraisal ratings from different rating sources comparable?

The purpose of this study was to test whether a multisource performance appraisal instrument exhibited measurement invariance across different groups of raters. Multiple-groups confirmatory factor analysis as well as item response theory (IRT) techniques were used to test for invariance of the rating instrument across self, peer, supervisor, and subordinate raters. The results of the confirmatory factor analysis indicated that the rating instrument was invariant across these rater groups. The IRT analysis yielded some evidence of differential item and test functioning, but it was limited to the effects of just 3 items and was trivial in magnitude. Taken together, the results suggest that the rating instrument could be regarded as invariant across the rater groups, thus supporting the practice of directly comparing their ratings. Implications for research and practice are discussed, as well as for understanding the meaning of between-source rating discrepancies. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

An item response theory analysis of the Hare Psychopathy Checklist--Revised.

Hare's Psychopathy Checklist--Revised (PCL--R; R. D. Hare, 1991) is the measure of choice for measuring psychopathic personality disorder. An item response theory (IRT) approach was adopted to analyze both test and item functioning. Data from 2,067 North American participants were analyzed. The analysis confirmed that the test was appropriate for both the diagnosis of psychopathic personality disorder and for making measures of trait strength. Two correlated but distinct factors underpin scores on the PCL--R: Factor 1, Selfish, Callous, and Remorseless Use of Others; and Factor 2, Chronically Unstable and Antisocial Lifestyle. Items related to Factor 1 are generally more discriminating and provide more information about the trait than items relating to Factor 2. Future uses of IRT procedures in the analysis of PCL--R data are discussed. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Differential item functioning in a Spanish translation of the PTSD Checklist: Detection and evaluation of impact.

This study demonstrated the application of an innovative item response theory (IRT) based approach to evaluating measurement equivalence, comparing a newly developed Spanish version of the Posttraumatic Stress Disorder Checklist-Civilian Version (PCL-C) with the established English version. Basic principles and practical issues faced in the application of IRT methods for instrument evaluation are discussed. Data were derived from a study of the mental health consequences of community violence in both Spanish speakers (n = 102) and English speakers (n = 284). Results of differential item functioning (DIF) analyses revealed that the 2 versions were not fully equivalent on an item-by-item basis in that 6 of the 17 items displayed uniform DIF. No bias was observed, however, at the level of the composite PCL-C scale score, indicating that the 2 language versions can be combined for scale-level analyses. (PsycINFO Database Record (c) 2010 APA, all rights reserved)