An item response theory analysis of DSM-IV personality disorder criteria across younger and older age groups.

Many of the Diagnostic and Statistical Manual of Mental Disorders, 4th edition (DSM-IV; American Psychiatric Association, 1994) personality disorder (PD) diagnostic criteria focus on a younger social and occupational context. The absence of age-appropriate criteria for older adults forces researchers and clinicians to draw conclusions based on existing criteria, which are likely inadequate. To explore which DSM-IV PD criteria contain age group measurement bias, the authors report 2 analyses of data on nearly 37,000 participants, ages 18-98 years, taken from a public data set that includes 7 of the 10 PDs (antisocial, avoidant, dependent, histrionic, obsessive-compulsive, paranoid, and schizoid). The 1st analysis revealed that older age groups tend to endorse fewer PD criteria than younger age groups. The 2nd analysis revealed that 29% of the criteria contain measurement bias. Although the latent variable structure for each PD was quite similar across younger and older age groups, some individual criteria were differentially endorsed by younger and older adults with equivalent PD pathology. The presence of measurement bias for these criteria raises questions concerning the assessment of PDs in older adults and the interpretation of existing data. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Item response theory analysis of diagnostic criteria for alcohol and cannabis use disorders in adolescents: Implications for DSM-V.

Item response theory (IRT) has advantages over classical test theory in evaluating diagnostic criteria. In this study, the authors used IRT to characterize the psychometric properties of Diagnostic and Statistical Manual of Mental Disorders, 4th edition (DSM-IV; American Psychiatric Association, 1994) alcohol and cannabis use disorder symptoms among 472 clinical adolescents. For both substances, DSM-IV symptoms fit a model specifying a unidimensional latent trait of problem severity. Threshold (severity) parameters did not distinguish abuse and dependence symptoms. Abuse symptoms of legal problems and hazardous use, and dependence symptoms of tolerance, unsuccessful attempts to quit, and physical-psychological problems, showed relatively poor discrimination of problem severity. There were gender differences in thresholds for hazardous use, legal problems, and physical-psychological problems. The results illustrate limitations of DSM-IV criteria for alcohol and cannabis use disorders when applied to adolescents. The development process for the fifth edition (DSM-V) should be informed by statistical models such as those used in this study. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Constructing personality scales under the assumptions of an ideal point response process: Toward increasing the flexibility of personality measures.

The main aim of this article is to explicate why a transition to ideal point methods of scale construction is needed to advance the field of personality assessment. The study empirically demonstrated the substantive benefits of ideal point methodology as compared with the dominance framework underlying traditional methods of scale construction. Specifically, using a large, heterogeneous pool of order items, the authors constructed scales using traditional classical test theory, dominance item response theory (IRT), and ideal point IRT methods. The merits of each method were examined in terms of item pool utilization, model-data fit, measurement precision, and construct and criterion-related validity. Results show that adoption of the ideal point approach provided a more flexible platform for creating future personality measures, and this transition did not adversely affect the validity of personality test scores. (PsycINFO Database Record (c) 2011 APA, all rights reserved)     

基于项目反映理论的试卷质量分析

测验信息量是项目反应理论中的一个重要概念，是预测和评价一个测验的误差大小的重要方法．针对在测试中应用较广的逻辑斯特模型和正态曲线模型，本文指出了相应的测验信息函数的表达式，并将其应用于试卷质量的分析中，为试卷的量化分析和选择提供了参考。     

The effect of ignoring item interactions on the estimated discrimination parameters in item response theory.

Most item response theory models assume conditional independence, and it is known that interactions between items affect the estimated item discrimination. In this article, this effect is further investigated from a theoretical perspective and by means of simulation studies. To this end, a parametric model for item interactions is introduced. Next, it is shown that ignoring a positive interaction results in an overestimation of the discrimination parameter in the two-parameter logistic model (2PLM), whereas ignoring a negative interaction leads to an underestimation of the parameter. Furthermore, it is demonstrated that in some cases the item characteristic curves of the 2PLM and of an item involved in an interaction are quite similar, indicating that the 2PLM can provide a good fit to data with interactions. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Differential impairment as an indicator of sex bias in DSM-IV criteria for four personality disorders.

The aim of the present study was to investigate the possibility of sex bias in the diagnostic criteria for borderline, schizotypal, avoidant, and obsessive-compulsive personality disorders. A clinical sample of 668 individuals was evaluated for personality disorder criteria using a semistructured interview, and areas of functional impairment were assessed with both self-report and semistructured interview. The authors used a regression model of bias to identify bias as differences in slopes or intercepts between men and women in the relationship between each diagnostic criterion and level of impairment. The results suggest that most of the diagnostic criteria examined do not seem to display sex bias. However, those criteria that displayed evidence of bias came largely from the borderline diagnosis. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Measurement equivalence: A comparison of methods based on confirmatory factor analysis and item response theory.

Current interest in the assessment of measurement equivalence emphasizes 2 major methods of analysis. The authors offer a comparison of a linear method (confirmatory factor analysis) and a nonlinear method (differential item and test functioning using item response theory) with an emphasis on their methodological similarities and differences. The 2 approaches test for the equality of true scores (or expected raw scores) across 2 populations when the latent (or factor) score is held constant. Both approaches can provide information about when measurrment nonequivalence exists and the extent to which it is a problem. An empirical example is used to illustrate the 2 approaches. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Challenges associated with a polythetic diagnostic system: Criteria combinations in the personality disorders.

Converging research on the diagnostic criteria for personality disorders (PDs) reveals that most criteria have different psychometric properties. This finding is inconsistent with the PD diagnostic system according to the Diagnostic and Statistical Manual of Mental Disorders (4th ed.; American Psychiatric Association, 1994), which weights each criterion equally. The purpose of the current study was to examine the potential effects of using equal weights for differentially functioning criteria. Data from over 2,100 outpatients were used to analyze and score response patterns to the diagnostic criteria for 9 PDs within an item response theory framework. Results indicated that combinations that included the same number of endorsed criteria yielded differing estimates of PD traits, depending on which criteria were met. Moreover, trait estimates from subthreshold criteria combinations often overlapped with diagnostic (at-threshold or higher) combinations, indicating that there were subthreshold combinations of criteria that indicated as much or more PD than did some combinations at the diagnostic threshold. These results suggest that counting the number of criteria an individual meets provides only a coarse estimation of his or her PD trait level. Implications for the assessment of polythetically defined mental disorders and for the PD proposal for the 5th edition of the Diagnostic and Statistical Manual of Mental Disorders are discussed. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Detecting differential item functioning with confirmatory factor analysis and item response theory: Toward a unified strategy.

In this article, the authors developed a common strategy for identifying differential item functioning (DIF) items that can be implemented in both the mean and covariance structures method (MACS) and item response theory (IRT). They proposed examining the loadings (discrimination) and the intercept (location) parameters simultaneously using the likelihood ratio test with a free-baseline model and Bonferroni corrected critical p values. They compared the relative efficacy of this approach with alternative implementations for various types and amounts of DIF, sample sizes, numbers of response categories, and amounts of impact (latent mean differences). Results indicated that the proposed strategy was considerably more effective than an alternative approach involving a constrained-baseline model. Both MACS and IRT performed similarly well in the majority of experimental conditions. As expected, MACS performed slightly worse in dichotomous conditions but better than IRT in polytomous cases where sample sizes were small. Also, contrary to popular belief, MACS performed well in conditions where DIF was simulated on item thresholds (item means), and its accuracy was not affected by impact. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

An item response theory integration of normal and abnormal personality scales.

[Correction Notice: An erratum for this article was reported in Vol 1(3) of Personality Disorders: Theory, Research, and Treatment (see record 2010-17135-005). In the acknowledgments, Douglas Samuel was incorrectly listed as the author of the DAPP-BQ instrument. John Livesley is the correct author of the DAPP-BQ instrument.] The Diagnostic and Statistical Manual of Mental Disorders (DSM–IV–TR) currently conceptualizes personality disorders (PDs) as categorical syndromes that are distinct from normal personality. However, an alternative dimensional viewpoint is that PDs are maladaptive expressions of general personality traits. The dimensional perspective postulates that personality pathology exists at a more extreme level of the latent trait than does general personality. This hypothesis was examined using item response theory analyses comparing scales from two personality pathology instruments—the Dimensional Assessment of Personality Pathology-Basic Questionnaire (DAPP-BQ; Livesley & Jackson, in press) and the Schedule for Nonadaptive and Adaptive Personality (SNAP; Clark, 1993; Clark, Simms, Wu, & Casillas, in press)—with scales from an instrument designed to assess normal range personality, the NEO Personality Inventory–Revised (NEO PI-R; Costa & McCrae, 1992). The results indicate that respective scales from these instruments assess shared latent constructs, with the NEO PI-R providing more information at the lower (normal) range and the DAPP-BQ and SNAP providing more information at the higher (abnormal) range. Nevertheless, the results also demonstrated substantial overlap in coverage. Implications of the findings are discussed with respect to the study and development of items that would provide specific discriminations along underlying trait continua. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

A nonlinear mixed model framework for item response theory.

Mixed models take the dependency between observations based on the same cluster into account by introducing 1 or more random effects. Common item response theory (IRT) models introduce latent person variables to model the dependence between responses of the same participant. Assuming a distribution for the latent variables, these IRT models are formally equivalent with nonlinear mixed models. It is shown how a variety of IRT models can be formulated as particular instances of nonlinear mixed models. The unifying framework offers the advantage that relations between different IRT models become explicit and that it is rather straightforward to see how existing IRT models can be adapted and extended. The approach is illustrated with a self-report study on anger. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Examining assumptions about item responding in personality assessment: Should ideal point methods be considered for scale development and scoring?

The present study investigated whether the assumptions of an ideal point response process, similar in spirit to Thurstone's work in the context of attitude measurement, can provide viable alternatives to the traditionally used dominance assumptions for personality item calibration and scoring. Item response theory methods were used to compare the fit of 2 ideal point and 2 dominance models with data from the 5th edition of the Sixteen Personality Factor Questionnaire (S. Conn & M. L. Rieke, 1994). The authors' results indicate that ideal point models can provide as good or better fit to personality items than do dominance models because they can fit monotonically increasing item response functions but do not require this property. Several implications of these findings for personality measurement and personnel selection are described. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Efficiently assessing negative cognition in depression: An item response theory analysis of the Dysfunctional Attitude Scale.

Despite a central role for dysfunctional attitudes in cognitive theories of depression and the widespread use of the Dysfunctional Attitude Scale, form A (DAS-A; A. Weissman, 1979), the psychometric development of the DAS-A has been relatively limited. The authors used nonparametric item response theory methods to examine the DAS-A items and develop a briefer version of the scale. Using DAS-A data obtained from depressed participants enrolled in 2 large depression treatment studies (N = 367), the authors developed a 9-item DAS form (DAS-SF?). In addition, because 2 versions of the DAS are needed for certain study designs, they also developed a 2nd short version (DAS-SF?). These short forms were highly correlated with the original 40-item DAS-A (rs ranged from .91 to .93), exhibited change similar to that of the DAS-A over the course of treatment, were moderately correlated with related self-report assessments, predicted concurrent depression severity, and predicted change in depression from before to after treatment. Taken together, the authors believe the DAS-SF? and DAS-SF? provide an efficient and accurate assessment of dysfunctional attitudes among depressed individuals. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

A multisample item response theory analysis of the Beck Depression Inventory-1A.

The widespread employment of the Beck Depression Inventory-1A ({bdi}-1{a}) has spawned a number of practices: (1) The employment of an unweighted total score as a measure of depression; (2) Its use in populations other than that in which it was normed; and (3) The employment of {bdi}-1{a} total scores in hypothesis tests about population differences in mean depression. A sequential procedure based on item response theory was employed to assess the validity of these practices for the case of 4 populations: clinical depressives (n?=?210), mixed nondepressed psychiatric patients (n?=?98), and students from 2 different universities (n?=?624). The findings suggest that the 1st practice was not justified for any of these populations, that the {bdi}-1{a} was employable only with clinical depressives and with 1 of the university populations, and that mean comparisons were not allowable. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Pooling data from multiple longitudinal studies: The role of item response theory in integrative data analysis.

There are a number of significant challenges researchers encounter when studying development over an extended period of time, including subject attrition, the changing of measurement structures across groups and developmental periods, and the need to invest substantial time and money. Integrative data analysis is an emerging set of methodologies that allows researchers to overcome many of the challenges of single-sample designs through the pooling of data drawn from multiple existing developmental studies. This approach is characterized by a host of advantages, but this also introduces several new complexities that must be addressed prior to broad adoption by developmental researchers. In this article, the authors focus on methods for fitting measurement models and creating scale scores using data drawn from multiple longitudinal studies. The authors present findings from the analysis of repeated measures of internalizing symptomatology that were pooled from three existing developmental studies. The authors describe and demonstrate each step in the analysis and conclude with a discussion of potential limitations and directions for future research. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Generalized full-information item bifactor analysis.

Full-information item bifactor analysis is an important statistical method in psychological and educational measurement. Current methods are limited to single-group analysis and inflexible in the types of item response models supported. We propose a flexible multiple-group item bifactor analysis framework that supports a variety of multidimensional item response theory models for an arbitrary mixing of dichotomous, ordinal, and nominal items. The extended item bifactor model also enables the estimation of latent variable means and variances when data from more than 1 group are present. Generalized user-defined parameter restrictions are permitted within or across groups. We derive an efficient full-information maximum marginal likelihood estimator. Our estimation method achieves substantial computational savings by extending Gibbons and Hedeker's (1992) bifactor dimension reduction method so that the optimization of the marginal log-likelihood requires only 2-dimensional integration regardless of the dimensionality of the latent variables. We use simulation studies to demonstrate the flexibility and accuracy of the proposed methods. We apply the model to study cross-country differences, including differential item functioning, using data from a large international education survey on mathematics literacy. (PsycINFO Database Record (c) 2011 APA, all rights reserved)     

Development of an abbreviated Social Phobia and Anxiety Inventory (SPAI) using item response theory: The SPAI-23.

An abbreviated version of the Social Phobia and Anxiety Inventory (SPAI) was developed using methods based in nonparametric item response theory. Participants included a nonclinical sample of 1,482 undergraduates (52% female, mean age = 19.4 years) as well as a clinical sample of 105 individuals (56% female, mean age = 36.4 years) diagnosed with either generalized (73%) or specific social phobia (27%). Twenty-three of the 45 SPAI items demonstrated good discrimination along the social anxiety continuum. In addition, option characteristic curves (OCCs) indicated that the SPAI's 7-point scale may generate errors in ranking individuals. Thus, options were collapsed to improve item performance. No gender differences emerged between any of the items' OCCs, suggesting that items function similarly among men and women. The abbreviated version also correlated highly with the original 45-item SPAI and exhibited similar patterns of correlations with measures of social anxiety. The SPAI-23 has considerable practical benefits, including a screening of both social and agoraphobic anxiety as well as decreased assessment and scoring time. (PsycINFO Database Record (c) 2011 APA, all rights reserved)     

Clinician bias in the diagnosis of posttraumatic stress disorder and borderline personality disorder.

[Correction Notice: An erratum for this article was reported in Vol 2(2) of Psychological Trauma: Theory, Research, Practice, and Policy (see record 2010-12181-005). In this article, the copyright attribution is incorrect. The article is in the public domain.] A sample of volunteers from a group of randomly selected psychologists in New York State (N = 119) provided a primary diagnosis and rule-out diagnoses for a case vignette that included balanced criteria for borderline personality disorder (BPD) and posttraumatic stress disorder (PTSD) in a mail survey. Vignettes portrayed a male or a female client, and history of childhood sexual abuse was presented either first or last. Results indicated that cognitive–behavioral therapy (CBT) clinicians were more likely to diagnose PTSD than BPD or other disorders, and psychodynamic clinicians were more likely to diagnose BPD or other disorders than PTSD. An anchoring effect (i.e., evidence that one regards initial information as an anchor that may or may not be adjusted upon exposure to subsequent information) of abuse history presentation was found. Findings did not support a patient or clinician gender bias. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

The psyche in psychophysics: A sensory-decision theory analysis of the effect of instructions on flicker sensitivity and response bias.

Instruction-induced changes in flicker thresholds, measured by traditional psychophysical procedures, may reflect changes in sensory sensitivity or in response bias. In 16 psychiatric patients, a facilitating set, in contrast to an inhibiting set, increased the proportion of flicker responses to both a physically intermittent light ("hits," p