The reliability and validity of the Perceived Stigmatization Questionnaire (PSQ) and the Social Comfort Questionnaire (SCQ) among an adult burn survivor sample.

In this study, 361 adult burn survivors completed the Perceived Stigmatization Questionnaire (PSQ), the Social Comfort Questionnaire (SCQ), and other measures. Both the PSQ and SCQ had good internal consistency indices. Factor analysis of the PSQ yielded 3 factors (absence of friendly behavior, confused/staring behavior, and hostile behavior). The SCQ had 1 factor. Conjoint factor analysis with measures of related constructs (body esteem, body-esteem importance, depression, social support) suggested that PSQ and SCQ measure distinct constructs. Correlations with the related psychosocial constructs and burn characteristics suggested the PSQ and SCQ have good convergent and discriminant validity. Limitations of the study are discussed. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Large-sample confidence intervals for validity and reliability coefficients.

Large-sample confidence intervals (CI) for reliability, validity, and unattenuated validity are presented. The CI for unattenuated validity is based on the Bonferroni inequality, which relies on one CI for test–retest reliability and one for validity. Covered are four reliability–validity situations: (a) both estimates were from random samples; (b) reliability was from a random sample but validity was from a selected sample; (c) validity was from a random sample but reliability was from a selected sample; and (d) both estimates were from selected samples. All CIs were evaluated by using a simulation. CIs on reliability, validity, or unattenuated validity are accurate as long as selection ratio is at least 20% and selected sample size is 100 or larger. When selection ratio is less than 20%, estimators tend to underestimate their parameters. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Reliability and validity of the Functional Outcome Questionnaire for Aphasia (FOQ-A).

Objective: To perform a psychometric evaluation of the Functional Outcome Questionnaire for Aphasia (FOQ-A), a 32-item instrument designed to assess the extent to which a person who has had a stroke performs several important functional communication behaviors. Research Design: The FOQ-A was administered to family caregivers of persons with a history of left hemisphere stroke (N = 91) undergoing a comprehensive screening assessment to determine their eligibility for participation in research trials for novel stroke rehabilitation interventions. Results: Statistical analyses provided strong support for the internal consistency reliability and the convergent and discriminant validity of the FOQ-A. An exploratory factor analysis revealed a two-factor solution, Basic Verbal Expression and Conversational Response Skills. Conclusions: The present findings build on earlier evidence indicating that the FOQ-A has good psychometric properties and considerable promise as a measure of functional communication in aphasia rehabilitation. Future research will focus on the test-retest reliability, criterion-oriented validity, and predictive validity of the instrument. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Validity versus reliability.

After reviewing recent studies involving the selection of items for interest scales, in which scales with higher validity (and fewer items) generally had lower reliability, the author presents the original odd-even reliabilities and recently-collected test-retest reliabilities (over an average 18-year interval) for 15 scales of the Strong VIB. The test-retest reliabilities were all lower than the odd-even reliabilities, and the shrinkage was greatest for those scales with the lowest original reliabilities. It is concluded that, for prediction in the distant future, scale reliability is important. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

The reliability and validity of a multicultural assessment instrument developed for a graduate program in psychology.

The Diversity Mission Evaluation Questionnaire (DMEQ) was developed to assess attitudes, beliefs, and experiences pertaining to multicultural matters at a graduate program in psychology. Using scores of 247 students, 57 faculty, and 19 staff, the authors revealed three latent traits through exploratory factor analysis: Overall Success, Open Discussion of Diversity Issues, and belief that multicultural activities were Freely Undertaken. The high internal consistency of all of these scales, (as > .81), coupled with expected between-groups differences and significant correlations with experiences of prejudice, suggests that the instrument assessed diversity issues in a precise and valid manner. It was concluded that the DMEQ could be used by institutions desiring to assess their multicultural climates. Evaluative data from a graduate school that has adopted and implemented a diversity mission are presented, and issues related to multicultural change are discussed. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Moderating effects and differential reliability and validity.

Classic psychometric theory holds that errors of measurement and of prediction are of the same magnitude for all individuals. Interactive effects are not recognized, and the psychological structure of all individuals is taken to be the same. To increase reliability and validity of measurement, then, attention is entirely focused on improvement of measuring devices. However, a substantial body of evidence indicates there are systematic individual differences in error, and in the importance a given trait has in determining a particular performance. Reliability and validity of measurement can be increased by the use of moderator variables which predict individual differences in error and in the importance of traits. (16 ref.) (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

An examination of the convergent and discriminant validity of the Strengths and Difficulties Questionnaire.

This study examined the factor structure of the parent and teacher versions of the Strengths and Difficulties Questionnaire (SDQ; R. Goodman, 1997) with a sample of first-grade children at risk for educational failure. The 5-factor model previously found in studies using exploratory factor analysis was fit to the data for both parent and teacher questionnaires. Fit indices for both versions were marginally adequate. Model fit was comparable across gender and ethnic groups. Factor fit for the parent questionnaire was invariant across parent educational level. The examination of convergent and discriminant validity included peer evaluations of each SDQ construct. Thus, each of the five constructs was evaluated by three sources (parent, teacher, and child). On the basis of D. T. Campbell and D. W. Fiske's (1959) multitrait-multimethod approach as well as a confirmatory factor analysis using the correlated uniqueness model, the SDQ has good convergent validity but relatively poor discriminant validity. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Reliability and validity of the Kopas Personnel Test Battery.

"For a sample of 88 plant protection officers, the seven tests in the battery were uncorrelated with one another, and correlations with Supervisory Ratings were negligible. The multiple correlation was .348. In two independent samples, the internal consistency reliabilities of the six non-performance tests… ranged from .58 to .93. In another sample, test-retest reliabilities ranged from .40 to .87." (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Construct validity and the Taylor Anxiety Scale.

"The intent of this paper has been to emphasize the directive role of theory in the construction of psychological tests." The several methodological issues arising from the use of theory in test construction are illustrated through a critical examination of the Taylor Anxiety Scale. "Our conclusion was that the A scale has only a tenuous, theoretical and empirical coordination to the Hullian construct of drive." 31 references. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Factor structure and criterion-related validity of the metaperspective version of the Coach–Athlete Relationship Questionnaire (CART-Q).

The coach–athlete relationship has been purported to be shaped by coaches’ and athletes’ self-perceptions (e.g., I trust my coach/athlete) and metaperceptions (e.g., My coach/athlete trusts me) of closeness, commitment, and complementarity (3Cs). The development of the Coach–Athlete Relationship Questionnaire (CART-Q; S. Jowett & N. Ntoumanis, 2004) has enabled the assessment of coaches’ and athletes’ self-perceptions of the relationship as defined by the 3Cs. The author conducted 2 studies to examine the factor structure and criterion-related validity of the CART-Q when its items are worded to express metaperceptions. In the 1st study, confirmatory factor analyses employing a sample of athletes (n = 201) supported the validity of a 3-dimensional model in which the factors were separate but correlated for metacloseness, metacommitment, and metacomplementarity. The 2nd study provided further evidence of validity when the 3 factors were examined relative to criterion variables with 2 independent samples: athletes (n = 189) and coaches (n = 138). These results highlight that the conceptual model from which the CART-Q was developed captures the relationship quality through athletes’ and coaches’ feelings (closeness), thoughts (commitment), and behaviors (complementarity). (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

A lively approach to vividness: A review of McKelvie, S. J. (1995). Vividness of visual imagery: Measurement, nature, function and dynamics.

Reviews the book, Vividness of visual imagery: Measurement, nature, function and dynamics by S. J. McKelvie (1995). This book consists of a target article by Stuart J. McKelvie followed by several reviews of that article, and finally followed by an author's response. The topic of the book is representative of an important strand in the history of Canadian psychology. "Vividness" is the aspect of imagery that McKelvie is concerned to elaborate, and he begins by considering the benchmark work of David F. Marks who invented the Vividness of Visual Imagery Questionnaire (WIQ) in 1972. McKelvie's review of studies of the reliability of the VVIQ shows that it is adequate but not overwhelmingly impressive. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

The Racial and Ethnic Microaggressions Scale (REMS): Construction, reliability, and validity.

Racial microaggressions are subtle statements and behaviors that unconsciously communicate denigrating messages to people of color. In recent years, a theoretical taxonomy and subsequent qualitative studies have introduced the types of microaggressions that people of color experience. In the present study, college- and Internet-based samples of African Americans, Latina/os, Asian Americans, and multiracial participants (N = 661) were used to develop and validate the Racial and Ethnic Microaggression Scale (REMS). In Study 1, an exploratory principal-components analyses (n = 443) yielded a 6-factor model: (a) Assumptions of Inferiority, (b) Second-Class Citizen and Assumptions of Criminality, (c) Microinvalidations, (d) Exoticization/Assumptions of Similarity, (e) Environmental Microaggressions, and (f) Workplace and School Microaggressions, with a Cronbach's alpha of .912 for the overall model and subscales ranging from .783 to .873. In Study 2, a confirmatory factor analysis (n = 218) supported the 6-factor model with a Cronbach's alpha of .892. Further analyses indicate that the REMS is a valid measure of racial microaggressions, as evidenced by high correlations with existing measures of racism and participants' feedback. Future research directions and implications for practice are discussed. (PsycINFO Database Record (c) 2011 APA, all rights reserved)     

Assessing creativity with divergent thinking tasks: Exploring the reliability and validity of new subjective scoring methods.

Divergent thinking is central to the study of individual differences in creativity, but the traditional scoring systems (assigning points for infrequent responses and summing the points) face well-known problems. After critically reviewing past scoring methods, this article describes a new approach to assessing divergent thinking and appraises its reliability and validity. In our new Top 2 scoring method, participants complete a divergent thinking task and then circle the 2 responses that they think are their most creative responses. Raters then evaluate the responses on a 5-point scale. Regarding reliability, a generalizability analysis showed that subjective ratings of unusual-uses tasks and instances tasks yield dependable scores with only 2 or 3 raters. Regarding validity, a latent-variable study (n=226) predicted divergent thinking from the Big Five factors and their higher-order traits (Plasticity and Stability). Over half of the variance in divergent thinking could be explained by dimensions of personality. The article presents instructions for measuring divergent thinking with the new method. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Follow-up on the validity of a forced-choice study activity questionnaire in another setting.

"This study investigates the possibility that (unknown) institutional differences might affect the validity of a forced-choice study activity questionnaire (SAQ) validated at a state college and then applied in a private university." Ss were 189 sophomore, junior, and senior students of finance and commerce taking an introductory psychology course. The 3 variables were the SAQ, SAT-V (Scholastic Aptitude Test—Verbal) and GAP (grade point average). The correlations between SAQ and SAT-V were .03, SAQ and GPA .48. Combined SAQ and SAT-V multiple correlation with GPA .62. "Thus SAQ is significantly valid and, together with the scholastic aptitude test, gives significant multiple prediction of grade-point average in both situations." (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

The reliability and validity of the family history method for assessing pathological gambling and gambling involvement.

The family history (FH) method, which involves the use of an informant to gather information about one or more family members, has been used in a number of previous gambling studies. However, no evaluation of the reliability and validity has been conducted on the use of the FH method for assessing pathological gambling (PG) and gambling involvement. The current study examined the test-retest and inter-rater reliability and the validity of the FH method for assessing PG and gambling involvement among a large community-based sample of adult twins (N = 4,764) reporting on their parents, co-twins, and spouses. The test-retest and inter-rater reliabilities of the FH reports of PG were high. Validity of the FH reports of PG was low, primarily because of substantial underestimation of pathology (low sensitivity). The test-retest and inter-rater reliabilities of the FH reports of gambling involvement (ever gambled, ever gambled monthly, and ever gambled weekly) were moderate and the sensitivities were quite high. The results of this study support the use of the FH method for studies of PG and gambling involvement. A number of potential explanations for the low sensitivity of FH reports of PG are elaborated. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

A cross-cultural study of the psychometric properties of the Reactive–Proactive Aggression Questionnaire among Italian nonclinical adolescents.

Five independent studies were used to test the hypothesis that a reliable 2-factor structure underlies the Reactive–Proactive Aggression Questionnaire (RPQ) items and that the 2 scales show distinct patterns of association with personality and bullying behavior measures. Study 1 (N = 1,447) gave evidence of a clear 2-factor structure of RPQ items with factor loading matrices closely matching reactive (congruence coefficient = .90) and proactive (congruence coefficient = .91) models of item assignment. The RPQ 2-factor structure was consistently replicated in Study 2 (N = 662), as well as across the remaining 3 studies. In Study 3 (N = 536), Neuroticism differentiated reactive and proactive forms of aggression. In Study 4 (N = 674), self-reports of bullying behaviors were selectively correlated with proactive aggression. Findings confirm and extend the differential correlates of proactive–reactive aggression and also support the psychometric properties of the RPQ in a different cultural context. Finally, in Study 5 (N = 347), the RPQ scales showed adequate 2-month test–retest reliability. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Developing a measure of sluggish cognitive tempo for children: Content validity, factor structure, and reliability.

Sluggish cognitive tempo (SCT) is a construct that some researchers believe may be extremely useful in understanding the inattentive subtype of attention-deficit/hyperactivity disorder, and may even help define a completely new disorder. However, the construct of SCT is as yet inadequately operationally or theoretically defined. The authors took the first steps toward developing an empirically supported measure of SCT in children. In Study 1, potential items to measure SCT were identified from a literature review, content validity of the items was evaluated by a group of experts, and a preliminary set of SCT items were selected. In Study 2, ratings completed by parents and teachers of 335 children (ages 4–13) were used to further develop and evaluate the SCT items by computing factor analyses, item-level analyses, reliability analyses, and preliminary validity analyses. The final SCT scale (14 items) produced a total scale score and 3 subscale scores: Slow, Sleepy, and Daydreamer. These scales were constructed with good content validity and were found to have strong reliability. Future directions include replication, extension into a clinical population, and further examination of validity. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Virtue-based measurement of ethical leadership: The Leadership Virtues Questionnaire.

Approaching ethical leadership from a characterological perspective, this study reports on the creation of the Leadership Virtues Questionnaire (LVQ). Defining an ethical leader as one who adheres to the four cardinal virtues of prudence, fortitude, temperance, and justice, as discussed in the ancient texts of Aristotle and St. Thomas Aquinas, we developed a rating instrument for assessing leader virtues. A series of studies with managers examined the psychometric properties and correlates of the LVQ. Factor analyses suggested that one factor best captured the construct, not inconsistent with philosophers' notions of the “unity” of the cardinal virtues. The LVQ was shown to be highly positively correlated with transformational leadership, authentic leadership, and another recently developed measure of ethical leadership, and there was evidence of discriminant validity. The LVQ, used with the virtues approach to ethical leadership, should prove to be a valuable tool for the assessment and development of leader virtues and ethics. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

The reliability and validity of discrete and continuous measures of psychopathology: A quantitative review.

[Correction Notice: An erratum for this article was reported in Vol 137(6) of Psychological Bulletin (see record 2011-24066-002). In the Samples section of Meta-Analysis 1: Reliability, third paragraph, the number of studies reporting data on clinical samples is incorrect. The sentence “Four studies included clinical samples, and eight studies included nonclinical samples” should read “Twenty-four studies included clinical samples, and eight studies included nonclinical samples.”] In 2 meta-analyses involving 58 studies and 59,575 participants, we quantitatively summarized the relative reliability and validity of continuous (i.e., dimensional) and discrete (i.e., categorical) measures of psychopathology. Overall, results suggest an expected 15% increase in reliability and 37% increase in validity through adoption of a continuous over discrete measure of psychopathology alone. This increase occurs across all types of samples and forms of psychopathology, with little evidence for exceptions. For typical observed effect sizes, the increase in validity is sufficient to almost halve sample sizes necessary to achieve standard power levels. With important caveats, the current results, considered with previous research, provide sufficient empirical and theoretical basis to assume a priori that continuous measurement of psychopathology is more reliable and valid. Use of continuous measures in psychopathology assessment has widespread theoretical and practical benefits in research and clinical settings. (PsycINFO Database Record (c) 2011 APA, all rights reserved)