What constitutes cerebral palsy?

OBJECTIVE: To determine whether a newly developed disability scale for patients with neck pain demonstrated acceptable reliability and validity. METHODS: Testing was conducted using three different samples of patients with neck pain (n = 162). Test-retest reliability of the scale was carried out on the same day with one sample (n = 39), and between-day reliability was carried out with another (n = 21). Differential item functioning with regard to the influence of gender and age was carried out with these two patient groups, as was construct validity. Responsiveness was measured using patients participating in a clinical trial involving patients with chronic neck pain (n = 102). Additionally, scale scores were compared with a wide range of physical measurements using the patients in the clinical trial. RESULTS: Short-term, between-day and postal questionnaire reliability coefficients were all extremely high. The Cronbach's alpha coefficient for internal consistency was 0.9 for the entire scale, and the coefficients for individual items were all greater than 0.88. Disability scale scores correlated strongly to pain scores as well as to doctor and patient global assessments, indicating good construct validity. Relative changes in disability scores demonstrated a moderately strong correlation to changes in pain scores after treatment. Scale scores correlated weakly to all physical measurements. CONCLUSIONS: The disability scale demonstrated excellent practicality and reliability. The scale accurately reflects patient perceptions regarding functional status and pain as well as doctor's global assessment and is responsive to change over long periods of time. We feel that this scale can be a valuable tool for the assessment of patients in future clinical trials and quality of care studies.     

Validity and reliability of a new questionnaire on patient satisfaction in rehabilitative therapy

BACKGROUND: The aim of this study was to examine some psychometric properties of a new questionnaire measuring patients' satisfaction with respect to the quality of care during stay in a rehabilitation unit. The instrument (called SAT-16) is composed of 16 four-level items and 2 open-ended questions. The construct validity of the 16-item section was already demonstrated in a previous study based on factorial analysis. In this study the concurrent validity, further aspects of the construct validity and test-retest reliability were analyzed. METHODS: The SAT-16 was administered to 339 inpatients, admitted consecutively to a Rehabilitation Center. RESULTS: 262 questionnaires (77%) were returned, of which 221 with all items filled in. The SAT-16 correlated well with two other measures of satisfaction (CSQ-8 and global satisfaction regarding the hospital stay). The answers to two open-ended questions came out to be consistent with those to the 16 closed-ended questions. The high values for the indices of test-retest reliability (ICC and kappa) are evidence of the stability of the scores in two repeated administrations. CONCLUSIONS: The SAT-16 was found to be provided with good psychometric characteristics. It can be proposed as a valid instrument for use in clinical practice for the continuous quality improvement of inpatient medical rehabilitation programmes.     

The construct validity of egocentrism.

Briefly explains construct validation and applies it to egocentrism. Conceptual and operational referents of this construct are organized into 3 categories: visual/spatial egocentrism (what does the other see), affective egocentrism (what does the other feel), and cognitive/communicative egocentrism (what is the other thinking). Several kinds of reliability information are reported, and construct validity is evaluated primarily by examination of the relationships among measures of egocentrism within and between categories. Although interrater reliability and interrater agreement were found to be uniformly high for all egocentrism measures examined in a review, and the measurement reliability was usually adequate, a few tasks were not internally consistent. Overall, the construct validity of egocentrism was not supported, since most task intercorrelations were low and often nonsignificant. An alternative interpretation of the data based on cognitive constructs and task- and response-specific variables is proposed. (2? p ref) (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Psychometric properties of family members' reports of parental physical aggression toward clinic-referred children.

This study examined (a) differences among mothers', fathers', and children's reports of parental physical aggression toward children; (b) the reliability and validity of family members' reports of aggression using confirmatory factor analysis; and (c) the discriminant validity of the construct of mother–child and father–child aggression. Participants were 72 dual-parent families in which the parents were seeking clinical services for their children's (ages 7–9 years) conduct behavior problems. Each participant completed the parent–child version of the Conflict Tactics Scale (P-CTS). Results indicate that children reported lower levels of mother–child and father–child aggression than either mothers or fathers reported. Although the reliability (total systematic variance accounted for by observed variables) of family members' reports on the P-CTS ranged from moderate to high, convergent validity was generally low. The constructs of mother–child and father–child aggression were highly correlated but could be distinguished from each other when relationships among rater effects were considered. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Intracranial androgenic activation of male-typical behaviours in house mice: concurrent stimulation of the medial preoptic area and medial nucleus of the amygdala

OBJECTIVE: The goal of this study was to develop a reliable and valid tool for quantifying patient-rated wrist pain and disability. DESIGN: Survey, tool development, reliability, and validity study. SETTING: Upper extremity unit. PARTICIPANTS: One hundred members of the International Wrist Investigators were surveyed by mail to assist in development of the scale. Patients with distal radius (n = 64) or scaphoid (n = 35) fractures were enrolled in a reliability study, and 101 patients with distal radius fractures were enrolled in a validity study. INTERVENTION: Information from the expert survey, biomechanical literature, and patient interviews was used as a basis for item generation and definition of structural limitations for a scale that would be practical in the clinic. Patients with distal radius or scaphoid fractures completed the Patient-Rated Wrist Evaluation (PRWE) on two occasions to determine test-retest reliability. Patients with distal radius fractures (n = 101) completed the PRWE and the SF-36 and were tested with traditional impairment measures at baseline and at two, three, and six months after fracture to determine construct and criterion validity. MAIN OUTCOME MEASURES: Reliability coefficients (ICCs) and validity correlations (Pearson product moment correlations). RESULTS: Patient opinions on pain and on ability to do activities of daily living and work were thought to be the most important dimensions to include in subjective outcome tools. Brevity and simplicity were seen as essential in the clinic environment. A fifteen-item questionnaire (the PRWE) was designed to measure wrist pain and disability. Test-retest reliability was excellent (ICCs > 0.90). Validity assessment demonstrated that the instrument detected significant differences over time (p < 0.01) and was appropriately correlated with alternate forms of assessing parameters of pain and disability. CONCLUSIONS: The PRWE provides a brief, reliable, and valid measure of patient-rated pain and disability.     

Self-discrepancy: Comparisons of the psychometric properties of three instruments.

In 2 studies, the psychometric properties of 3 methods for measuring real–ideal and real–ought self-discrepancies were compared: the idiographic Self-Concept Questionnaire–Personal Constructs, the nonidiographic Self-Concept Questionnaire–Conventional Constructs, and the content-free Abstract Measures. In the 1st study, 125 students at a university clinic completed the 3 instruments and measures of anxiety and depression before individual therapy. In the 2nd study, 278 undergraduates completed the 3 instruments at 2 time points 4 weeks apart and completed multiple measures of anxiety and depression at the 2nd time point. Internal consistency alphas were consistently strong for the personal construct measures (.90 to .92) and moderate to strong for the conventional construct measures (.82 to .90). Test–retest reliability coefficients were above .70 for the personal construct and conventional construct measures, but the coefficients for the latter were inflated by the stability of their error terms. The 2 discrepancies were found to be factorially distinct even though they were highly correlated. Convergent and discriminant evidence of validity was found in both studies for all measures except the abstract real–ought discrepancy. Convergence was as strong or stronger for the personal construct measures in comparison to the other measures. Test-criterion evidence of validity, with multiple measures of anxiety and depression as criteria, was found in both studies for all measures except for the abstract real–ought discrepancy in relation to anxiety. Overall, the findings support the idiographic personal construct instrument most strongly for clinical assessment and for clinical, translational, and personality research. (PsycINFO Database Record (c) 2011 APA, all rights reserved)     

A new frame for frame-of-reference training: Enhancing the construct validity of assessment centers.

The authors undertook a comprehensive examination of the construct validity of an assessment center in this study by (1) gathering many different types of evidence to evaluate the strength of the inference between predictor measures and constructs (e.g., reliability, accuracy, convergent and discriminant relationships), (2) introducing a theoretically relevant intervention (frame-of-reference [FOR] training) aimed at improving construct validity, and (3) examining the effect of this intervention on criterion-related validity (something heretofore unexamined in the assessment center literature). Results from 58 assessees and 122 assessors suggested that FOR training was effective at improving the reliability, accuracy, convergent and discriminant validity, and criterion-related validity of assessment center ratings. Findings are discussed in terms of implications and future directions for both FOR training and assessment center practice. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Empathy in preschool children: The development of the Southampton Test of Empathy for Preschoolers (STEP).

In this study, we investigated a new instrument: the Southampton Test of Empathy for Preschoolers (STEP). The test incorporated 8 video vignettes of children in emotional scenarios, assessing a child's ability to understand (STEP-UND) and share (STEP-SHA) in the emotional experience of a story protagonist. Each vignette included 4 emotions (angry, happy, fearful, sad) that reflected emotion judgments based on the protagonist's facial expression, situation, verbal cues, and desire. The STEP was administered to 39 preschool children, and internal reliability, concurrent validity, and construct validity were addressed. The results showed good internal consistency. They also highlighted moderate concurrent validity with parent-rated empathy, a measure of facial indices, and construct validity with teacher-rated prosocial behavior. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Measurement of emotion dysregulation in adolescents.

The construct of emotion dysregulation increasingly has been used to explain diverse psychopathologies across the lifespan. The Difficulties in Emotion Regulation Scale (DERS; K. L. Gratz & L. Roemer, 2004) represents the most comprehensive measure of the construct to date and exhibits good reliability and validity in adults; however, the measure has yet to be tested in adolescents. The present study examined the psychometric properties of the DERS in a community sample of 428 adolescents (ages 13–17 years). Exploratory factor analysis supported a 6-factor structure consistent with the 6 DERS subscales. Internal consistencies for the subscales were good to excellent (alphas ranged from .76 to .89). In support of the measure’s construct validity, the DERS exhibited robust correlations with psychological problems reflecting emotion dysregulation, specifically depression, anxiety, suicidal ideation, eating disorders, alcohol use, and drug use. Intercorrelations among the DERS subscales ranged from negligible to high (range: r = .04 to r = .68), and potential problems with discriminant validity were noted. In general, results support the reliability and validity of the DERS as a measure of emotion dysregulation in adolescents. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Development and Validation of an Observational Coding System for Emotional Overinvolvement.

The present study investigated the reliability and construct validity of a behavioral observation coding system of emotional overinvolvement (EOI), an index of intrusive, excessively self-sacrificing, or exaggeratedly emotional behavior displayed by the relative of a psychiatric patient. Separate behavioral ratings of relatives' intrusiveness, excessive self-sacrifice, and exaggerated emotional response were generated from 10-min problem-solving interactions between adult outpatients with obsessive-compulsive disorder or panic disorder with agoraphobia and their relatives. The interrater reliability for the 3 scales was adequate to excellent, and the scales appeared to tap related, but distinct, aspects of the EOI construct. Results from a multitrait-multimethod matrix and a confirmatory factor analysis supported the measure's convergent validity but were equivocal with respect to its discriminant validity. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Measures of early academic skills: Reliability and validity with a first grade sample.

This study investigated the reliability- (interscorer and test-retest) and criterion-related validity (concurrent and predictive) of 11 curriculum-based measures of early academic skills with a sample of first-grade students. Some measures required production-type responses. Other measures required selection-type responses. The measures involved letters (sounds, names, copying), numbers (names, counting in sequence), colors, and shapes. Subjects were 30 first-grade students from an urban parochial school. Test-Retest reliability was assessed with alternate forms of the measures over a two-week interval. Concurrent validity was assessed with a norm-referenced achievement test (the Woodcock-Johnson Revised). Predictive validity was assessed by measuring oral reading fluency in passages and on word-lists four months after the initial assessment. Results suggested that some measures displayed better reliability and validity than others. The practical utility of these measures in light of their technical characteristics and the need for further construct validity data are discussed. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Replicating the chronic disease score (CDS) from automated pharmacy data

Michael Von Korff and colleagues at the Center for Health Studies, Group Health Cooperative (GHC) of Puget Sound created a measure of chronic disease status (CDS) using automated outpatient pharmacy data. They reported the measure appeared to provide a stable and valid measure of health status. The availability of such a measure could become a new tool for a variety of applications, including screening, resource allocation, and quality assurance. The measure was replicated for its reliability and construct and predictive validity in the KPNW membership using automated pharmacy data. Reliability and validity were tested using correlation and regression techniques. The CDS showed test-retest reliability over time. It showed construct validity with the RAND-36 instrument and the BSI-8 depression screener. It showed predictive validity with health care visits and hospitalizations. The results were similar to those at GHC. The findings indicated that the CDS can serve, with certain precautions, as a readily accessible low cost measure of health status.     

The Children's Depression Scale: assessment of factor structure with data from a normal adolescent population

This study investigated the reliability and construct validity of the Children's Depression Scale. Data were gathered from an Australian sample of male and female students with a mean age of 14.9 years (N = 202). Factor analysis using principal components was conducted to develop a revised version of the scale. Four factors met the stipulated criteria and accounted for 54% of the variance. The revised subscales, three with five items and one with four items, were shown to have strong construct and face validity and high reliability. Further work on this measure is necessary to refine it for future research.     

Student evaluation of courses: determining the reliability and validity of three survey instruments

The purpose of this study was to determine the reliability and validity of three instruments designed for student evaluation of courses: the Course, Library, and Computer (CLC); the Clinical (CLIN); and the Nursing Skills Lab (NSL) evaluation tools. Using data from 294 anonymous associate degree nursing students, internal consistency and reliability were demonstrated by the high alpha coefficients ranging from .85 to .94. An exploratory principal component analysis, with the varimax rotation, provided an estimate of construct validity.     

The pediatric cancer quality of life inventory-32 (PCQL-32): I. Reliability and validity

BACKGROUND: Multidimensional measurement of pediatric cancer patients' health-related quality of life (HRQOL) in Phase III randomized controlled clinical trials is being recognized increasingly as an essential component in evaluating the comprehensive health outcomes of modern antineoplastic treatment protocols. The Pediatric Cancer Quality of Life Inventory-32 (PCQL-32) is a standardized patient self-report and parent proxy-report assessment instrument designed to assess systematically pediatric cancer patients' HRQOL outcomes. METHODS: To validate a patient-report form and a parent-report form, the PCQL-32 was administered to 291 pediatric cancer patients and to their parents. Both forms yield a total score and five a priori multidimensional scales. Clinical validity was determined by the known-groups approach by comparing patients classified as either on or off treatment. To determine construct validity, a battery of standardized psychosocial measures was administered and a multitrait-multimethod matrix was constructed. RESULTS: For both patient and parent forms, internal consistency reliability of the PCQL-32 total scale was high (0.91 and 0.92, respectively). The internal consistency reliabilities of the five component scales for both patient and parent forms were in the acceptable range for group comparisons. With regard to clinical validity, the PCQL-32 total scale and the disease/treatment and physical functioning scales of the PCQL-32 distinguished between patients on and off treatment for both patient- and parent-report. The results of the multitrait-multimethod matrix approach were consistent with hypotheses and lent evidence for the construct validity of the patient and parent forms of the PCQL-32 total scale and the psychological functioning, social functioning, cognitive functioning, physical functioning, and disease/treatment scales. CONCLUSIONS: The PCQL-32 has demonstrated acceptable internal consistency reliability, clinical validity, and construct validity for both patient-report and parent-report forms. Further field testing of the PCQL-32 will determine its practicality and utility in multisite pediatric cancer randomized controlled clinical trials.     

Depressive personality: Reliability, validity, and relation to dysthymia.

The reliability and validity of K. Schneider's (1958) construct of depressive personality was evaluated in a sample of 177 outpatients, who were administered structured diagnostic and family history interviews, an extensive battery of inventories, and a 6-mo follow-up assessment. The criteria for depressive personality had moderate to good interrater reliability, internal consistency, and test–retest stability, and the assessment of depressive personality traits was not influenced by patients' clinical states. In addition, preliminary support for the convergent and discriminant validity of the depressive personality construct was obtained. Although there were significant relations between the depressive personality and diagnoses of dysthymia from the Diagnostic and Statistical Manual of Mental Disorders (DSM-III) and DSM-III—Revised (DSM-III—R), the depressive personality was not entirely subsumed by existing mood disorders. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Construction of the Asian American Family Conflicts Scale.

This study describes the construction and initial validation of the Asian American Family Conflicts Scale (FCS) with 3 samples of Asian American college students. The scale consists of 10 typical Asian American family conflicts that are rated for likelihood of occurrence (FCS-Likelihood) and seriousness of conflict (FCS-Seriousness). In Study 1, FCS-Likelihood and FCS-Seriousness had sound internal reliability, stability, and construct validity. In Study 2, FCS-Likelihood correlated with socioeconomic and cultural orientation variables. Ethnic, generation, and language differences, as well as the parent–child acculturation gap hypothesis, also were confirmed for FCS-Likelihood. In Study 3, FCS-Likelihood correlated with measures of family cohesion, adaptability, and parent-child communication. Although further validation is necessary, FCS-Likelihood in particular is a potentially useful research and clinical instrument for assessing the quality of Asian American parent–child relationships. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Imagery assessment through self-report: What do imagery questionnaires measure?

Assessment difficulties have impeded progress in evaluating the therapeutic role of visual imagery. Four studies with 445 undergraduates examined imagery questionnaires and addressed the issues of (a) reliability, (b) agreement among different questionnaires, (c) social desirability, and (d) construct validity. The (Betts) Questionnaire Upon Mental Imagery, Gordon Test of Visual Imagery Control, and a newer inventory, the Paivio Individual Differences Questionnaire, were examined. Reliability of the Paivio inventory was found to be satisfactory and equivalent to that of other imagery questionnaires. In 2 studies, the Betts and Paivio questionnaires were correlated at the .45–.50 level, but correlations involving the Gordon scale were inconsistent from one study to the next. In general, imagery measures were not influenced by social desirability (Marlowe-Crowne Social Desirability Scale). Factor analysis indicated that subjective and objective measures of visualization are independent. The final study revealed a relationship between imagery questionnaire scores and reported values and interests. It is suggested that imagery is not a unitary construct and that criteria other than visuospatial tests may be appropriate for validating imagery questionnaires. (36 ref) (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Ipsative behavioral variability and the quality of thematic apperceptive measurement of the achievement motive.

Ipsative behavioral variability is defined as change in the behavior of an individual in a constant environment. Through computer simulation of the dynamics of action (J. W. Atkinson and D. Birch; 1970, 1978), one may deduce that increases in ipsative variability in the expression of motivational imagery written in response to equally cued TAT pictures will increase the construct validity of that imagery regardless of the internal consistency reliability that remains. Empirical support for this hypothesis is offered by the finding that TAT need for achievement (nAch), measured in 4 stories written in response to weakly cued pictures, showed improved construct validity for 61 male undergraduates who were high rather than low in ipsative variability. TAT nAch showed significant construct validity for the high-variability group even though the internal consistency of this group's motive measure was –2.229. Findings disconfirm the general applicability of classical reliability theory to thematic apperceptive measures. (29 ref) (PsycINFO Database Record (c) 2010 APA, all rights reserved)