Measuring transactive memory systems in the field: Scale development and validation.

This study describes the development and validity testing of a field measure of transactive memory systems. Transactive memory systems are especially important for teams designed to leverage members' expertise, but field research has lagged because there are no adequate measures of the construct. The author developed and tested a 15-item scale in a laboratory sample of 124 teams, a field sample of 64 Master of Business Administration consulting teams, and a field sample of 27 teams from technology companies. Results from the present study demonstrate that the scale is internally consistent, related to alternative measures and hypothesized causes and effects, and unrelated to theoretically distinct constructs, providing evidence of convergent, criterion-related, and discriminant validity. Suggestions for improving the scale, future validity testing, and possible boundary conditions are discussed. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

A Convergent-Divergent Approach to Context Processing, General Intellectual Functioning, and the Genetic Liability to Schizophrenia.

Convergent and divergent validity are critically important in developing psychological measures that reveal interpretable deficits in disordered populations. This article reports on 2 studies that evaluated the validity of context processing measures. In Experiment 1, a confirmatory factor analysis of data from 481 healthy adults established the convergent validity of 2 context processing measures and showed that context processing accounted for significant amounts of variance in standard IQ and working memory measures. In Experiment 2, 20 schizophrenia patients, 16 of their healthy siblings, and 28 controls were evaluated using a novel, short context processing measure, the dot pattern expectancy (DPX) task. The DPX was sensitive to specific deficits in schizophrenia patients and their healthy siblings. These findings support the construct validity of context processing measures, suggest context processing is a component of intellectual functioning, and demonstrate that brief context processing measures remain sensitive to psychopathological deficits. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Development and validation of a brief self-report measure of trauma exposure: The Trauma History Screen.

Although information about individuals' exposure to highly stressful events such as traumatic stressors is often very useful for clinicians and researchers, available measures are too long and complex for use in many settings. The Trauma History Screen (THS) was developed to provide a very brief and easy-to-complete self-report measure of exposure to high magnitude stressor (HMS) events and of events associated with significant and persisting posttraumatic distress (PPD). The measure assesses the frequency of HMS and PPD events, and it provides detailed information about PPD events. Test–retest reliability was studied in four samples, and temporal stability was good to excellent for items and trauma types and excellent for overall HMS and PPD scores. Comprehensibility of items was supported by expert ratings of how well items appeared to be understood by participants with relatively low reading levels. In five samples, construct validity was supported by findings of strong convergent validity with a longer measure of trauma exposure and by correlations of HMS and PPD scores with posttraumatic stress disorder (PTSD) symptoms. The psychometric properties of the THS appear to be comparable or better than longer and more complex measures of trauma exposure. (PsycINFO Database Record (c) 2011 APA, all rights reserved)     

A comparison of the DRQ with ratings of emotion.

"In order to appraise the validity of the DRQ as a measure of tension, the authors compared DRQ scores of 39 psychiatric interviews with global ratings of the same interviews on anxiety, hostility, and dependence. There were small positive correlations between the global ratings and the DRQ, these correlations tending to be higher for the women than for the men. If the global ratings can be accepted as adequate measures of tension, the DRQ does not measure individual differences in tension very well." (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

A new frame for frame-of-reference training: Enhancing the construct validity of assessment centers.

The authors undertook a comprehensive examination of the construct validity of an assessment center in this study by (1) gathering many different types of evidence to evaluate the strength of the inference between predictor measures and constructs (e.g., reliability, accuracy, convergent and discriminant relationships), (2) introducing a theoretically relevant intervention (frame-of-reference [FOR] training) aimed at improving construct validity, and (3) examining the effect of this intervention on criterion-related validity (something heretofore unexamined in the assessment center literature). Results from 58 assessees and 122 assessors suggested that FOR training was effective at improving the reliability, accuracy, convergent and discriminant validity, and criterion-related validity of assessment center ratings. Findings are discussed in terms of implications and future directions for both FOR training and assessment center practice. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Construct validity of an attention rating scale for traumatic brain injury.

Attention deficits are nearly ubiquitous after traumatic brain injury (TBI). In the subacute phase of moderate to severe TBI, these deficits may be difficult to measure with the precision needed to predict outcomes, assess degree of recovery, and monitor treatment response. This article reports the findings of four studies, three observational and one a randomized, controlled treatment trial of methylphenidate (MP), designed to provide construct validation of the Moss Attention Rating Scale (MARS), an observational measure of attention dysfunction following TBI. One hundred seven participants with moderate to severe TBI were enrolled during treatment on an inpatient rehabilitation unit. MARS scores were provided independently by four rehabilitation disciplines (Physical, Occupational and Speech Therapies and Nursing). Results indicated that the MARS: (1) is more strongly related to concurrent measures of cognitive versus physical disability, supporting its validity as a measure of cognition, (2) is more strongly related to concurrent psychometric measures of attention versus measures thought to rely less on attention, supporting its validity as a measure of attention; and (3) predicts 1-year outcomes of TBI better than psychometric measures of attention. However, the MARS (4) was not differentially affected by MP versus placebo treatment. Results support the construct validity and utility of the MARS, with further research needed to clarify its role in treatment outcome assessment. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

When nonsense sounds happy or helpless: The Implicit Positive and Negative Affect Test (IPANAT).

This article introduces an instrument for the indirect assessment of positive and negative affect, the Implicit Positive and Negative Affect Test (IPANAT). This test draws on participant ratings of the extent to which artificial words subjectively convey various emotions. Factor analyses of these ratings yielded two independent factors that can be interpreted as implicit positive and negative affect. The corresponding scales show adequate internal consistency, test–retest reliability, stability (Study 1), and construct validity (Study 2). Studies 3 and 4 demonstrate that the IPANAT also measures state variance. Finally, Study 5 provides criterion-based validity by demonstrating that correlations between implicit affect and explicit affect are higher under conditions of spontaneous responding than under conditions of reflective responding to explicit affect scales. The present findings suggest that the IPANAT is a reliable and valid measure with a straightforward application procedure. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Appreciating similarities and valuing differences: The Miville-Guzman Universality-Diversity Scale.

Universal-diverse orientation was defined as an attitude of awareness and acceptance of both the similarities and differences that exist among people. A 45-item scale developed to measure the construct was administered to 4 separate samples (ns?=? 93, 111, 153, and 135). Internal consistency and retest reliability for the Miville-Guzman Universality-Diversity Scale (M-GUDS) ranged from .89 to .95. The M-GUDS significantly correlated in theoretically predicted ways with measures of racial identity, empathy, healthy narcissism, feminism, androgyny, homophobia, and dogmatism (the last 2 correlations were negative). The M-GUDS displayed discriminant validity by failing to correlated with Scholastic Achievement Test Verbal Scores, although mixed results were obtained with social desirability. In summary, the data suggest considerable reliability and initial construct validity for the M-GUDS. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Examining the validity of self-report assessments of family functioning: A question of the level of analysis.

Family assessment instruments attempt to measure family functioning at a particular level of the family system: individual, dyad, or family as a whole. This article introduces the concept of level validity, that is, whether an assessment measures family functioning at the level that it was intended to measure. The authors argue that whenever higher-order factors (e.g., dyadic subsystems) are the target of a measure, these factors should explain variance that is independent of their lower-order constituents (e.g., individual-level characteristics). Previously published data targeting dyadic subsystems within the family were reanalyzed using a model that controls for lower-order effects. Dyad-level factors rarely emerged independent of individual-level factors and, when they did, they did not replicate across samples. The results suggest that level validity should be tested and reported along with other aspects of construct validity before accepting such measures as valid assessments of family functioning. (PsycINFO Database Record (c) 2011 APA, all rights reserved)     

Measurement of emotion dysregulation in adolescents.

The construct of emotion dysregulation increasingly has been used to explain diverse psychopathologies across the lifespan. The Difficulties in Emotion Regulation Scale (DERS; K. L. Gratz & L. Roemer, 2004) represents the most comprehensive measure of the construct to date and exhibits good reliability and validity in adults; however, the measure has yet to be tested in adolescents. The present study examined the psychometric properties of the DERS in a community sample of 428 adolescents (ages 13–17 years). Exploratory factor analysis supported a 6-factor structure consistent with the 6 DERS subscales. Internal consistencies for the subscales were good to excellent (alphas ranged from .76 to .89). In support of the measure’s construct validity, the DERS exhibited robust correlations with psychological problems reflecting emotion dysregulation, specifically depression, anxiety, suicidal ideation, eating disorders, alcohol use, and drug use. Intercorrelations among the DERS subscales ranged from negligible to high (range: r = .04 to r = .68), and potential problems with discriminant validity were noted. In general, results support the reliability and validity of the DERS as a measure of emotion dysregulation in adolescents. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Developing a measure of sluggish cognitive tempo for children: Content validity, factor structure, and reliability.

Sluggish cognitive tempo (SCT) is a construct that some researchers believe may be extremely useful in understanding the inattentive subtype of attention-deficit/hyperactivity disorder, and may even help define a completely new disorder. However, the construct of SCT is as yet inadequately operationally or theoretically defined. The authors took the first steps toward developing an empirically supported measure of SCT in children. In Study 1, potential items to measure SCT were identified from a literature review, content validity of the items was evaluated by a group of experts, and a preliminary set of SCT items were selected. In Study 2, ratings completed by parents and teachers of 335 children (ages 4–13) were used to further develop and evaluate the SCT items by computing factor analyses, item-level analyses, reliability analyses, and preliminary validity analyses. The final SCT scale (14 items) produced a total scale score and 3 subscale scores: Slow, Sleepy, and Daydreamer. These scales were constructed with good content validity and were found to have strong reliability. Future directions include replication, extension into a clinical population, and further examination of validity. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Assessing the social validity of behavioral interventions: A review of treatment acceptability measures.

Increased attention to the construct of social validity in school psychology research and practice has resulted in a focus on treatment acceptability, the extent to which interventions are considered appropriate, effective, and fair. Questionnaires represent the typical measurement approach to treatment acceptability. This article reviews treatment acceptability measures and practices that have been developed and used to assess the social validity of behavioral interventions. A comparative framework was developed and applied to provide a systematic critique of 9 treatment acceptability measures along such dimensions as content and purpose of the instrument, psychometric properties, scoring procedures and interpretation, and use of the measure in research in practice. No one instrument was selected to be the most comprehensive and it is argued that treatment acceptability assessment practices need to move beyond the traditional questionnaire format. Alternatives to rating scales are presented and directions for future research regarding the measurement of treatment acceptability are discussed. (PsycINFO Database Record (c) 2011 APA, all rights reserved)     

Examining the construct validity of the Eating Disorder Inventory.

The construct validity of the Eating Disorder Inventory (EDI) was examined in 3 samples. An archival clinic sample (n=318) of women completed the EDI, a structured interview, and the Millon Clinical Multiaxial Inventory--II (MCMI-II). Confirmatory factor analyses (CFAs) indicated that neither null nor 1-factor models of the EDI fit item-level or item-parcel data. The proposed 8-factor model did not fit at the item level but did fit item-parcel data. Reliability estimates of the 8 scales ranged from .82 to .93, and low-to-moderate interscale correlations among the eating and weight-related scales provided partial support for convergent validity. EDI personality scales showed moderate interscale correlations and were associated with MCMI-II scales. A final CFA of the EDI scales supported a 2-factor model (Eating and Weight, Personality) of the 8 EDI scales. Strong associations between depression and several EDI scale scores were found in a treatment study sample (n=50). The archival clinic sample scored significantly higher on the 8 EDI scales than the nonpatient college comparison sample (n=487). (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Development and validation of the Delaying Gratification Inventory.

Deficits in gratification delay are associated with a broad range of public health problems, such as obesity, risky sexual behavior, and substance abuse. However, 6 decades of research on the construct has progressed less quickly than might be hoped, largely because of measurement issues. Although past research has implicated 5 domains of delay behavior, involving food, physical pleasures, social interactions, money, and achievement, no published measure to date has tapped all 5 components of the content domain. Existing measures have been criticized for limitations related to efficiency, reliability, and construct validity. Using an innovative Internet-mediated approach to survey construction, we developed the 35-item 5-factor Delaying Gratification Inventory (DGI). Evidence from 4 studies and a large, diverse sample of respondents (N = 10,741) provided support for the psychometric properties of the measure. Specifically, scores on the DGI demonstrated strong internal consistency and test–retest reliability for the 35-item composite, each of the 5 domains, and a 10-item short form. The 5-factor structure fit the data well and had good measurement invariance across subgroups. Construct validity was supported by correlations with scores on closely related self-control measures, behavioral ratings, Big Five personality trait measures, and measures of adjustment and psychopathology, including those on the Minnesota Multiphasic Personality Inventory-2-Restructured Form. DGI scores also showed incremental validity in accounting for well-being and health-related variables. The present investigation holds implications for improving public health, accelerating future research on gratification delay, and facilitating survey construction research more generally by demonstrating the suitability of an Internet-mediated strategy. (PsycINFO Database Record (c) 2011 APA, all rights reserved)     

The psychometric properties and utility of the Short Sadistic Impulse Scale (SSIS).

Sadistic personality disorder (SPD) has been underresearched and often misunderstood in forensic settings. Furthermore, personality disorders in general are the subject of much controversy in terms of their classification (i.e., whether they should be categorical or dimensional). The Sadistic Attitudes and Behaviors Scale (SABS; Davies & Hand, 2003; O'Meara, Davies, & Barnes-Holmes, 2004) is a recently developed scale for measuring sadistic inclinations. Derived from this is the Short Sadistic Impulse Scale (SSIS), which has proved to be a strong unidimensional measure of sadistic inclination. Through cumulative scaling, it was investigated whether the SSIS could measure sadism on a continuum of interest, thus providing a dimensional view of the construct. Further, the SSIS was administered along with a number of other measures related to sadism in order to assess the validity of the scale. Results showed that the SSIS has strong construct and discriminant validity and may be useful as a screening measure for sadistic impulse. (PsycINFO Database Record (c) 2011 APA, all rights reserved)     

Validity issues in clinical assessment.

The data investigators should provide to support the validity of inferences they make based on scores from a measure depend on (a) whether the measure is assumed to assess a hypothetical construct or behavior and (b) the purposes for which the measure is intended. The authors distinguish between the representational phase of validity assessment, which establishes that a measure produces scores that reflect the construct or behavior it purports to assess, and the elaborative validity phase, in which the meaning and utility of scores are examined. Key issues relevant to convergent, discriminant, and criterion-related validity are examined for measures of latent traits or constructs and then for measures of behaviors or response classes. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Note on the multitrait-multimethod matrix.

It has been stated elsewhere by Campbell and Fishe (see 34: 103) that trait validity values should be higher than the correlations among different traits measured by the same method. An analysis of this criterion suggests that its importance is dependent upon the number of different methods that can be used to measure the trait. (PsycINFO Database Record (c) 2010 APA, all rights reserved)