A new self-report scale for assessment of adolescent psychopathology: factor structure, reliability, validity, and diagnostic sensitivity

This paper describes four studies on self-reported problems in 2,243 adolescent males and females, 12 to 17 years of age. In Study 1, principal-axis factoring of 102 items covering 11 problem domains revealed six factors comprising 49.5% of the variance. Study 2 used confirmatory factor analysis of a 64-item reduced set on a new sample of 408 adolescents. Goodness-of-fit indicators suggested that the six-factor model had excellent fit to the data. Study 3 used data from the 2,157 adolescents used in the first two studies. Coefficient alphas ranged from .83 to .92. Median test-retest reliability for the six factors was .86. There was a consistent structure of the correlation matrix across age and gender. Study 4 was a study of criterion validity, using an additional sample of 86 children with attention-deficit hyperactivity disorder (ADHD). Sensitivity and specificity were high, with an overall diagnostic efficiency of 83%. This new self-report scale, the Conners/Wells Adolescent Self-Report of Symptoms (CASS), may provide a useful component of a multimodal assessment of adolescent psychopathology.     

A hierarchical approach to inferences concerning interobserver agreement for multinomial data

BACKGROUND AND PURPOSE: The purpose of this study was to evaluate the interobserver and intraobserver reliability of assessments of impairments and disabilities. SUBJECTS AND METHODS: One physical therapist's assessments were examined for intraobserver reliability. Judgments of two pairs of therapists were used to examine interobserver reliability. Reliability was assessed by Cohen's kappa. RESULTS: Of the 42 impairments and disabilities assessed by the physical therapist in the intraobserver reliability study, kappa values could be calculated for 33 items. For 31 items (94%), kappa values ranged from .40 to .91, and 2 items (6%) had kappa values of less than .40. To determine interobserver reliability, 37 items were assessed in one practice. Kappa values could be calculated for 34 items, with 30 items (88%) having kappa values ranging from .41 to .80 and 4 items (12%) showing "poor" agreement. In the second practice, 47 items were assessed for interobserver reliability. Kappa values could be calculated for 40 items, with 11 items (27.5%) having kappa values ranging from .41 to .84. Poor agreement was shown for the remaining 29 items (72.5%). CONCLUSION AND DISCUSSION: Assessments of impairments and disabilities are potentially reliable. The differences between practices of the interobserver reliability study can be explained by the fact that one of the therapists did not receive training in the use of the assessment form. More generalizable conclusions will require further study with more subjects and therapists.     

Validity versus reliability.

After reviewing recent studies involving the selection of items for interest scales, in which scales with higher validity (and fewer items) generally had lower reliability, the author presents the original odd-even reliabilities and recently-collected test-retest reliabilities (over an average 18-year interval) for 15 scales of the Strong VIB. The test-retest reliabilities were all lower than the odd-even reliabilities, and the shrinkage was greatest for those scales with the lowest original reliabilities. It is concluded that, for prediction in the distant future, scale reliability is important. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Posterior ischemic optic neuropathy associated with migraine

The Foot Function Index is a validated and reliable instrument for measuring foot pain, disability, and activity restriction in patients with rheumatoid arthritis. For the purposes of orthopaedic studies in which one foot serves as an internal control, we assessed the side-to-side reliability of the seven-question Foot Function Index pain subscale. Thirty patients with rheumatoid arthritis completed visual analog scale pain questionnaires for both feet on two occasions 8 days apart. Internal reliability of the scale was high, with Cronbach's alphas ranging from 0.94 to 0.96, suggesting good left versus right discriminatory abilities. Principal component factor analysis segregated the questions into two large clusters containing predominantly either left or right foot items. Intraclass correlation coefficients were examined for test-retest reliability (separated by side) and for side-to-side reliability (separated by the day of test). The resultant intraclass correlation coefficients were nearly equivalent, ranging from 0.79 to 0.89. Generalizability analysis yielded similar results. Intraclass correlation coefficients and generalizability analysis demonstrate that the majority of variation is best explained by the differences within subjects or between subjects rather than by test-retest or side-to-side differences. We recommend the Foot Function Index as a reliable measurement scale for use in orthopaedic interventional trials.     

Comparison of the traditional paper visual analogue scale questionnaire with an Apple Newton electronic appetite rating system (EARS) in free living subjects feeding ad libitum

OBJECTIVE: Assessing the value of a newly developed electronic visual analogue scale questionnaire (Apple Newton Message Pad) with the traditional paper method for appetite rating. DESIGN: In a random, crossover design, subjects completed both electronic and paper questionnaires to compare results obtained by the two methods; individual methods were completed consecutively to assess test-retest reliability; preference was established using a questionnaire. SETTING/SUBJECTS: Healthy, free-living adults were studied for comparison of methods (n = 12), test-retest reliability (n = 8) and preference (n = 13). INTERVENTION: Visual analogue scales were completed each waking hour to assess appetite. Preference was assessed after both methods were completed. RESULTS: There was no significant difference in the hourly results obtained by the paper and electronic methods for 'desire to eat', 'how much can you eat now', 'urge to eat' and 'preoccupation with thoughts of food'. Small differences in 'hunger' and 'fullness' ratings were noted (approximately 5% mean difference between methods, P < 0.05), but patterns of change and sensitivity for these and all other parameters remained similar for both methods across the visual analogue scale. Test-retest reliability demonstrated was similar for both methods. Seven (54%) subjects preferred to use the paper questionnaire, five (38%) the electronic method and one (8%) had no preference. CONCLUSIONS: The electronic Apple Newton questionnaire is as sensitive and reliable as the paper method, has the advantage that it automatically records the time of data acquisition and data collection and processing are more efficient for the researcher. The two methods should not be used interchangeably.     

Expression of retinoblastoma gene product and p21 (WAF1/Cip 1) protein in gliomas: correlations with proliferation markers, p53 expression and survival

AIMS/BACKGROUND: The construction and validation of an instrument for the assessment of subjective visual disability in the cataract patient is described. This instrument is specifically designed for measuring the outcome of cataract surgery with respect to visual disability. METHODS: Visually related activities thought to be affected by cataract were considered for the questionnaire. These were reduced by pilot study and principal components analysis to 18 items. A patient's assessment of his/her ability to perform each task was scored on a four point scale. Scores were averaged to create an overall index of visual disability, as well as subscale indices for mobility related disability, distance/lighting/reading related disability, and near and related tasks visual disability. The questionnaire, administered verbally is entitled "The Visual Disability Assessment (VDA)". Reliability testing included test-retest reliability, interobserver reliability (p, the intraclass correlation coefficient), and internal consistency reliability (Cronbach's alpha). Construct validation, the process for proving that a test measures what it is supposed to measure, included consideration of content validity, comparison with the established Activities of Daily Vision Scale (ADVS) and empirical support with factor analysis. RESULTS: For the four indices, interobserver reliability varied from 0.92 to 0.94, test-retest reliability varied from 0.96 to 0.98, and internal consistency reliability varied from 0.80 to 0.93. The VDA compared favourably with the ADVS by correlation, but Bland-Altman analysis demonstrated that the two instruments were not clinically interchangeable. Factor analysis suggests that all test items measure a common theme, and the subgroupings reflect common themes. CONCLUSIONS: The VDA is easy to administer because it has a short test time and scoring is straightforward. It has excellent interobserver, test-retest, and internal consistency reliability, and compares favourably with the ADVS, another test of visual disability. Factor analysis demonstrated that the 18 items measure a related theme, which can be assumed to be visual disability. The VDA is a valid instrument which provides a comprehensive assessment of visual disability in cataract patients and is designed to detect changes within a patient over time.     

Evaluating health-related quality of life in patients with facial acne: development of a self-administered questionnaire for clinical trials

Although psychosocial aspects of skin diseases are well known, disease-specific questionnaires validated for use in clinical trials are not available to assess the impact of facial acne on health-related quality of life or to evaluate therapeutic change. Development of such an instrument was undertaken and included item generation, reduction and pilot-testing phases. By interviewing acne subjects and dermatologists and literature review, 168 possible items were identified. Next, 165 acne subjects identified which items affected them and rated importance on a 5-point scale. Reduction to a brief questionnaire was performed by evaluating patient-perceived importance and factor analysis; four domains were identified (self-perception, role-emotional, role-social, acne symptoms). After pilot-testing for comprehension in acne subjects, further revisions were made to improve clarity and applicability. The resulting instrument takes 10 minutes to complete, and consists of 24 questions assessing how acne affected certain aspects of patients' lives during the past week on a 7-point scale. Thus, an instrument with excellent content validity was developed to assess health-related quality of life in patients with facial acne, and is comprised of statistically meaningful items of importance to patients. Other measurement characteristics are being assessed in a recently initiated study to evaluate test-retest reliability and responsiveness to therapy.     

Adaptation and psychometric properties of the German version of the Dissociative Experience Scale

We introduce the 'Fragebogen zu Dissoziativen Symptomen' (FDS), a German adaptation of the Dissociative Experience Scale (DES) which was developed to screen for dissociation within an ICD-10 framework. In addition to the original 28 DES items, the FDS contains 16 items covering dissociative phenomena included in the ICD-10, particularly pseudoneurological conversion symptoms. The psychometric properties of the FDS were studied in 927 clinical and nonclinical subjects from different diagnostic groups and compared to results of American studies. The scale had good test-retest reliability of .88, high internal consistency (split-half = .90, Cronbach's alpha = .94) and good construct validity. These results indicate that the FDS may be a valuable screen for dissociative psychopathology in German-speaking countries.     

Topical silicone gel sheeting in the treatment of hypertrophic scars and keloids. A dermatologic experience

BACKGROUND: Topical silicone gel sheeting has been used successfully in the management of hypertrophic and keloid scars resulting from thermal burn wounds. METHODS: An open-labelled approach using the silicone gel sheets was performed using hypertrophic and keloid scars secondary to surgical procedures or traumatic insults. RESULTS: The silicone gel sheets resulted in moderate improvement in scar thickness, scar color and was noted to be effective to some degree in all tested. The material was easy to use and painless. CONCLUSION: Topical silicone gel sheeting is an effective method for the treatment of hypertrophic and keloid scars and may be considered useful in the treatment of these difficult cutaneous lesions.     

An oral contraceptive perception scale for female adolescents

This study sought to develop the initial psychometric properties of a female adolescent oral contraceptive perception scale. Based on qualitative data, a 39-item scale of perceived benefits and barriers was developed, reviewed by adolescence experts and adolescents, and voluntarily completed by 407 female adolescents enrolled in family planning clinics. After item analysis, 15 items were deleted. Maximum likelihood factor analysis with varimax rotation yielded two barrier (relationship-oriented and oral contraceptive regimen) and four benefit (relationship-oriented, pregnancy prevention related to self, pregnancy prevention related to others, personal responsibility) factors that accounted for 53% of the variance. The scale had acceptable reliability (alpha coefficients ranged from 0.71 to 0.87). The scale should be beneficial to further research in this area.     

Development of a new scale for measuring acculturation: the Taiwan Aboriginal Acculturation Scale (TAAS)

As part of the Taiwan Aboriginal Study Project (TASP), a new acculturation scale (the Taiwan Aboriginal Acculturation Scale, or TAAS) has been developed among the aboriginal minorities of Austronesian origin in Taiwan. The design of the original 54 items was based on Milton Gordon's concept of assimilation in association with a careful consideration of cross-cultural validity. These items were administered to 144 subjects stratified by age and sex who were randomly sampled from four major Taiwanese aboriginal groups. Item analysis and factor analysis were applied to select an 18-item scale which has three subscales (factors): cultural assimilation, social assimilation, and social attitude. Results of validity and reliability studies of the TAAS were found to be acceptable. The development of TAAS demonstrates the applicability of the concept of acculturation as a process that involves changes both in attitude, and in behaviour, to non-western societies.     

Photodynamic effects of meso-tetra (4-sulfonatophenyl)porphine on human leukemia cells HEL and HL60, human lymphocytes and bone marrow progenitor cells

A new measure is presented, suitable for documenting severity and response to treatment in chronic low-back pain syndromes. It is self-administered and combines two pain and seven mobility items. These were selected from pre-existing validated instruments on the basis of their sensitivity to change after treatment. Their Italian validated translation was adopted. The measure was administered to 32 chronic low-back pain Italian patients, all refractory to previous conservative treatments. In most cases they presented with herniation or protrusion of 1-3 lumbar discs. Patients were treated with 3-6 sessions of autotraction over a 5- to 15-day period. Scores on the scale were recorded at admission, discharge and follow-up, 1-3 months after treatment. At discharge and at follow-up, patients were asked if, overall, they felt improved, the same or worse. At follow-up, 20 patients out of 32 reported overall improvement. Scalometric properties of the measure were tested using Rasch analysis. For admission and follow-up, items followed a consistent hierarchical relationship along a unidimensional pain/disability variable, which is being called back illness. The items were not redundant, in that they spread well along a wide range of difficulty/severity. The hierarchy matched well with the expected expression of the conditions of the patients. A study was conducted on 34 chronic back pain patients, showing satisfactory test-retest reliability. Depending on the various items, Cohen's unweighted K ranged from 0.27 to 0.78, with ten of the 11 items above the 0.45 level of acceptability, while intraclass correlation coefficients ranged from 0.42 to 0.89. At follow-up, changes in BACKILL of plus 15% or more, with respect to admission, were consistent with patients' reports of improvement in 19 out of 20 cases. Changes in BACKILL of less than 15% were consistent with patients reports of being the same or worse in 11 out of 12 cases.     

The Social Thoughts and Beliefs Scale: A New Inventory for Assessing Cognitions in Social Phobia.

Development and initial psychometric features of a new inventory to assess cognitions associated with social phobia are described. The Social Thoughts and Beliefs Scale (STABS) is designed to assess cognitions in individuals with social phobia. In the 1st study, an initial pool of 45 items was reduced to 21. In the 2nd study, psychometric features of the scale were examined in a sample of individuals with social phobia, other anxiety disorders, and no psychiatric disorder. Total scores and two factor scores significantly differentiated individuals with social phobia from those in the other groups and were found to have adequate test-retest reliability and internal consistency. Potential usefulness of the STABS for assessing cognitions associated with social phobia is discussed. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Measuring progress and outcome in community rehabilitation after brain injury with a new assessment instrument--the BICRO-39 scales. Brain Injury Community Rehabilitation Outcome

OBJECTIVE: Construction and validation of a new instrument, the Brain Injury Community Rehabilitation Outcome scales, to assess problems experienced by brain-injured patients living in the community. DESIGN: Seventy-six items describing aspects of personal and social functioning were generated. Two hundred thirty-five patients and/or their carers (separately) rated the items on 6-point scales, and patients retrospectively rated their functioning before injury. Seven scales were derived from factor analysis; one was included a priori. Thirty-nine items with high factor loadings were retained. Test-retest reliability, interrater reliability, and construct validity were examined in subsamples. SETTING: Patients were recruited from four centers: two community-based teams, a day-patient clinic, and an outpatient clinic. PATIENTS: Of the patients, 127 had traumatic brain injury, 72 had cerebrovascular accidents, 15 had multiple sclerosis, and 21 had acquired brain injury of other origins. Mean time since brain injury was 2.6 years; mean age was 43 years; 164 were men and 71 were women. RESULTS: All scales showed good test-retest reliability, and agreement between patient and carer ratings was moderate to high. They showed predicted moderate correlations with other relevant scales. Postinjury scores differed significantly from preinjury scores, and 6 of the 8 scales showed change over a period of recovery/rehabilitation. CONCLUSIONS: The scales appear reliable and easy to complete. They may have utility as quantitative measures of outcome for clinical and treatment evaluations.     

Development and validation of a questionnaire designed to measure foot-health status

The aim of this study was to apply the principles of content, criterion, and construct validation to a new questionnaire specifically designed to measure foot-health status. One hundred eleven subjects completed two different questionnaires designed to measure foot health (the new Foot Health Status Questionnaire and the previously validated Foot Function Index) and underwent a clinical examination in order to provide data for a second-order confirmatory factor analysis. Presented herein is a psychometrically evaluated questionnaire that contains 13 items covering foot pain, foot function, footwear, and general foot health. The tool demonstrates a high degree of content, criterion, and construct validity and test-retest reliability.     

Perceptual and enactment measurement of self-care

The concept of self-care was conceptualized as having three major components: enabling perceptual elements (motivation, values, responsibility, and decision making); domains for enactment (cognitive/ perceptual, psychosocial/affective, and physical functioning); and self-care enactment factors (capacity), which included self-care action and knowledge adequate for self-care. A new tool, The Self-Care Agency Inventory, was designed to discriminate between those who will enact self-care and those who will not because of either a lack of knowledge or a lack of motivation. Content validity was demonstrated (.77 or greater from each scale) and concurrent validity documented. Alpha reliability for the new scale and principal components factor analysis of the scale items did not achieve desired levels, although a pilot sample demonstrated test-retest reliability of .82. The conceptual model is presented.     

An assertiveness inventory for adults.

Developed the Adult Self-Expression Scale, a 48-item, self-report measure of assertiveness designed for use with adults in general. The scale was administered to 464 students at a large, "open-door" community college; Ss ranged in age from 18-60 yrs, with a mean age of 25.3 yrs. Results show the scale has high test-retest reliability and moderate-to-high construct validity, as established by correlations with Adjective Check List scales and by a discriminant analysis procedure. Factor analysis generally supported the model used in the construction of the scale. Concurrent validity was also established. (22 ref) (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

The Maudsley Addiction Profile (MAP): a brief instrument for assessing treatment outcome

AIM: To develop a brief, multi-dimensional instrument for assessing treatment outcome for people with drug and/or alcohol problems. The Maudsley Addiction Profile (MAP) is the first instrument to be developed in the United Kingdom for this purpose. DESIGN: Field testing with quota-recruitment of problem drug users and problem alcohol users in treatment with researcher and clinician-administered test-retest interviews. SETTING: Two community and two inpatient services at the Bethlem Royal and Maudsley Hospital, London. PARTICIPANTS: Subjects (160 drug users and 80 alcohol users) interviewed by eight interviews (four researchers and four clinicians), each of whom interviewed 30 subjects on two occasions. MEASURES: Sixty items across substance use, health risk, physical/psychological health and personal/social functioning domains. FINDINGS: Average completion time of the MAP was 12 minutes. The questionnaire was acceptable to a majority of subjects and performed well with both researcher and clinician interviewers. Internal reliability and feasible concurrent validity assessments of the scales and items were highly satisfactory. Test-retest reliability was good, average intraclass correlation coefficients across eight substances were 0.94 and 0.81 across health risk, health problems, relationship conflict, employment and crime measures. CONCLUSIONS: The MAP can serve as a core research instrument with additional outcome measures added as required. The collection of a set of reliable quantitative measures of problems among drug and alcohol users by research or treatment personnel for outcome evaluation purposes need not be time-consuming.     

Psychometric evaluation of trauma and posttraumatic stress disorder assessments in persons with severe mental illness.

Interrater reliability, internal consistency, test-retest reliability, and convergent validity were examined for the Trauma History Questionnaire (THQ), the Clinician-Administered Posttraumatic Stress Disorder (PTSD) Scale (CAPS), and the PTSD Checklist (PCL) in 30 clients with severe mental illnesses. Interrater reliability for the THQ and CAPS was high, as was internal consistency of CAPS and PCL subscales. The test-retest reliability of the THQ was moderate to high for different traumas. PTSD diagnoses on the CAPS and PCL showed moderate test-retest reliability. Lower levels of test-retest reliability for PTSD diagnoses were related to psychosis diagnoses and symptoms. However, when more stringent criteria for PTSD were used on the CAPS, it had excellent test-retest reliability across all clients. CAPS and PCL diagnoses of PTSD showed moderate convergent validity. The results support the reliability of trauma and PTSD assessments in clients with severe mental illness. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

A coefficient alpha for test-retest data.

Transient errors are caused by variations in feelings, moods, and mental states over time. If these errors are present, coefficient alpha is an inflated estimate of reliability. A true-score model is presented that incorporates transient errors for test-retest data, and a reliability estimate is derived. This estimate, referred to as the test-retest alpha, is less than coefficient alpha if transient error is present and is less susceptible to effects due to item recall than a test-retest correlation. An assumption underlying the test-retest alpha is essential tau equivalency of items. A test-retest split-half coefficient is presented as an alternative to the test-retest alpha when this assumption is violated. The test-retest alpha is the mean of all possible test-retest split-half coefficients. (PsycINFO Database Record (c) 2010 APA, all rights reserved)