Rating group therapist interventions: The validation of the Group Psychotherapy Intervention Rating Scale.

The present study seeks to establish the validity of the Group Psychotherapy Intervention Rating Scale (GPIRS), an observer-rated measure of the quality of group leader interventions. Concurrent validity was tested by comparing GPIRS results to 2 group gold standard process measures, the Hill Interaction Matrix and the Group Climate Questionnaire. Significant correlations between leader intervention scores and group member perceptions of group climate, as well as verbal interaction scores, were found. In addition, results indicated correlations between interventions aimed to gain balance between confrontation and warmth and member-rated levels of cohesion. Results lend support for the concurrent validity of the GPIRS. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Validation of the Minnesota Scale of Parental Occupations and a modification of the Werner Occupational Rating Scale.

The Minnesota and Warner scales were correlated with material and cultural possession criteria for a sample of 150 urban high school students and 150 rural students. The substantial but not high correlation between the scales and criteria is attributed to the present wide distribution of the criteria possessions in the population, so that they no longer act as adequate socioeconomic differentiators. The Warner scale seems to differentiate more adequately among agricultural occupations than the Minnesota scale. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Meta-analysis of the Brief Psychiatric Rating Scale factor structure.

A meta-analysis (N=17,620; k=26) of factor analyses of the Brief Psychiatric Rating Scale (BPRS) was conducted. Analysis of the 12 items from Overall et al.'s (J. E. Overall, L. E. Hollister, & P. Pichot, 1974) 4 subscales found support for his 4 subscales. Analysis of all 18 BPRS items found 4 components similar to those of Overall et al. In a 5-component solution, a 5th activation component emerged but was best supported among samples of schizophrenic patients. The first 4 components appear to form the core of the BPRS factor structure. Results of the meta-analysis suggest 5 subscales (with items in parentheses): Affect (anxiety, guilt, depression, somatic); Positive Symptoms (thought content, conceptual disorganization, hallucinatory behavior, grandiosity); Negative Symptoms (blunted affect, emotional withdrawal, motor retardation); Resistance (hostility, uncooperativeness, suspiciousness); and Activation (excitement, tension, mannerisms-posturing). (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Assessing the age-related effects of proactive interference on working memory tasks using the Rasch model.

Inhibition-reduction theory (L. Hasher & R. Zacks, 1988) hypothesizes that the age-related decline in working memory (WM) span is a result of a decrease in the ability to inhibit irrelevant information in WM. Using the Rasch psychometric model, this study found that later trials on 2 WM span tasks were more difficult for older adults than for younger adults, consistent with inhibition-reduction theory's hypothesis that older adults are more susceptible to the effects of proactive interference (PI). Furthermore, after accounting for differential susceptibility to the effects of PI, age-related variance in WM span was reduced by about half. These results suggest that differential susceptibility to PI may account for a substantial portion, although not all, of the age-related decline in WM span. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Reliability and validity of Women's Health Initiative Insomnia Rating Scale.

The reliability and construct validity of the 5-item Women's Health Initiative Insomnia Rating Scale (WHIIRS) were evaluated in 2 studies. In Study 1, using a sample of 66,269 postmenopausal women, validity of the WHIIRS was assessed by examining its relationship to other measures known to be related to sleep quality. Reliability of the WHIIRS was estimated using a resampling approach; the mean alpha coefficient was .78. Test-retest reliability coefficients were .96 for same-day administration and .66 after a year or more. Correlations of the WHIIRS with the other measures were in the predicted directions. Study 2 used a sample of 459 women and compared the WHIIRS with objective indicators of sleep quality. Results showed that differences in the objective indicators could be detected by the WHIIRS. Findings suggest that a between-group mean difference of approximately 0.50 of a standard deviation on the WHIIRS may be clinically meaningful. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Quantifying Symptomatic Change During Acute Psychiatric Hospitalization Using New Subscales for the Anchored Brief Psychiatric Rating Scale.

Methods of measuring symptomatic change must demonstrate accuracy before they can be applied in mental health research. Accuracy for the Brief Psychiatric Rating Scale-Anchored version (BPRS-A) was investigated in 2,194 adult patients at a short-term acute-care psychiatric facility. Changes in BPRS-A total and subscale scores from admission to discharge were compared with rated global improvement. The magnitude of BPRS-A change from admission to discharge varied as a function of rated global improvement, with BPRS-A change the most robust for patients classified as markedly improved at discharge. Comparable analyses were also applied to more homogenous subsamples of patients diagnosed with either schizophrenia or nonpsychotic depression. Comparable overall sensitivity and differential sensitivity of subscales to specific symptomatic change were also demonstrated. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Factor structure and measurement invariance of the Women's Health Initiative Insomnia Rating Scale.

As part of the Women's Health Initiative Study, the 5-item Women's Health Initiative Insomnia Rating Scale (WHIIRS) was developed. This article summarizes the development of the scale through the use of responses from 66,269 postmenopausal women (mean age=62.07 years, SD=7.41 years). All women completed a 10-item questionnaire concerning sleep. A novel resampling technique was introduced as part of the data analysis. Principal-axes factor analysis without iteration and rotation to a varimax solution was conducted for 120,000 random samples of 1,000 women each. Use of this strategy led to the development of a scale with a highly stable factor structure. Structural equation modeling revealed no major differences in factor structure across age and race-ethnic groups. WHIIRS norms for race-ethnicity and age subgroups are detailed. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Rasch-modeling the Portuguese SOCRATES in a clinical sample.

The Stages of Change Readiness and Treatment Eagerness Scale (SOCRATES) assesses motivation for treatment in the drug-dependent population. The development of adequate measures of motivation is needed in order to properly understand the role of this construct in rehabilitation. This study probed the psychometric properties of the SOCRATES in the Portuguese population by means of the Rasch Rating Scale Model, which allows the conjoint measurement of items and persons. The participants were 166 substance abusers under treatment for their addiction. Results show that the functioning of the five response categories is not optimal; our re-analysis indicates that a three-category system is the most appropriate one. By using this response category system, both model fit and estimation accuracy are improved. The discussion takes into account other factors such as item format and content in order to make suggestions for the development of better motivation-for-treatment scales. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Development of an item bank for the assessment of depression in persons with mental illnesses and physical diseases using Rasch analysis.

Objective: The calibration of item banks provides the basis for computerized adaptive testing that ensures high diagnostic precision and minimizes participants’ test burden. The present study aimed at developing a new item bank that allows for assessing depression in persons with mental and persons with somatic diseases. Method: The sample consisted of 161 participants treated for a depressive syndrome, and 206 participants with somatic illnesses (103 cardiologic, 103 otorhinolaryngologic; overall mean age = 44.1 years, SD =14.0; 44.7% women) to allow for validation of the item bank in both groups. Persons answered a pool of 182 depression items on a 5-point Likert scale. Results: Evaluation of Rasch model fit (infit 2.0), and reliability (>.80) resulted in a bank of 79 items with good psychometric properties. Conclusions: The bank provides items with a wide range of content coverage and may serve as a sound basis for computerized adaptive testing applications. It might also be useful for researchers who wish to develop new fixed-length scales for the assessment of depression in specific rehabilitation settings. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Discriminating between pre- versus post-theraplay treatment Marschak Interaction Methods using the Marschak Interaction Method Rating System.

The Marschak Interaction Method (MIM) is a play-based observation used to evaluate parent–child relationship quality. This study examined the ability of the Marschak Interaction Method Rating System (MIMRS) to effectively discriminate between MIMs completed pre- versus post-Theraplay treatment. Eleven parent–child dyads received at least 8 Theraplay sessions. Achenbach Child Behavior Checklists (CBCLs) completed by parents before and after treatment demonstrated significant improvement in child behaviors. Interrater reliability for MIMRS = .75. Results of dependent-samples t test revealed strong effect sizes (Cohen's d) on the total MIMRS score (?1.07) and the nurture and challenge dimensions (?1.50, ?0.76, respectively). Although these results are preliminary and modest in terms of sample size, the MIMRS was successful in capturing change in the parent–child relationship following Theraplay treatment. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Construct validity and the Taylor Anxiety Scale.

"The intent of this paper has been to emphasize the directive role of theory in the construction of psychological tests." The several methodological issues arising from the use of theory in test construction are illustrated through a critical examination of the Taylor Anxiety Scale. "Our conclusion was that the A scale has only a tenuous, theoretical and empirical coordination to the Hullian construct of drive." 31 references. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Mapping the Continuum of Alcohol Problems in College Students: A Rasch Model Analysis.

The authors conducted Rasch model (G. Rasch, 1960) analyses of items from the Young Adult Alcohol Problems Screening Test (YAAPST; S. C. Hurlbut & K. J. Sher, 1992) to examine the relative severity and ordering of alcohol problems in 806 college students. Items appeared to measure a single dimension of alcohol problem severity, covering a broad range of the latent continuum. Items fit the Rasch model well, with less severe symptoms reliably preceding more severe symptoms in a potential progression toward increasing levels of problem severity. However, certain items did not index problem severity consistently across demographic subgroups. A shortened, alternative version of the YAAPST is proposed, and a norm table is provided that allows for a linking of total YAAPST scores to expected symptom expression. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

New subscales for an anchored version of the Brief Psychiatric Rating Scale: Construction, reliability, and validity in acute psychiatric admissions.

Attending psychiatrists completed an anchored version of the 18-item Brief Psychiatric Rating Scale (BPRS-A) based on admission and evaluation information on a total of 2,921 adult patients treated at 1 public sector acute psychiatric teaching hospital. Exploratory factor analysis was applied to a 6-month sample to construct 4 nonoverlapping subscales: Resistance, Positive Symptoms, Negative Symptoms, and Psychological Discomfort. Confirmatory factor analysis compared these new subscales to 3 other published subscale models using a second 6-month sample. Internal consistency, rater influence, and interrater agreement were estimated in separate studies. Discriminant validity was explored by comparison of diagnosis-based samples. Application of the BPRS-A as a debriefing instrument in the study of symptomatic change and the multiple challenges inherent in psychometric study of such a rating scale in realistic hospital practice are discussed. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

A validity study of functionally-based behavioral consultation with students with emotional/behavioral disabilities.

Eighteen students (K-11th grade) with emotional/behavioral disorders who were at-risk for change of placement to more restrictive settings participated. Construct validity of functional behavioral assessment (FBA) was assessed with a multifunction-multimethod matrix that showed excellent convergent and divergent agreement with combined FBA methods and functional analysis results. Treatment validity was assessed with random assignment to either a FBA with consultation condition (FBC) or to a behavioral consultation without FBA condition (BC). Growth curve analysis showed a significant decrease in inappropriate behavior from baseline to treatment for both treatment groups compared to a control group. The efficiency of teachers' implementation effected treatment validity. Effect sizes showed that regardless of treatment condition that interventions with good fidelity realized the largest effect (d = -1.14). Social and habilitative validity was assessed with telephone interviews conducted a year after treatment. Sixty-five percent attributed the students' problem behaviors to their thoughts or feelings, whereas only 25% attributed it to classroom variables. Many (57%) indicated the most helpful intervention would be individual counseling, whereas only 14% indicated a more involved classroom management plan would be useful. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

On the dimensionality of the Dispositional Hope Scale.

The Dispositional Hope Scale (DHS; C. R. Snyder et al., 1991) consists of two subsets of items measuring Agency and Pathways. The authors used bifactor analysis to evaluate the dimensionality structure of the scale. Data from 676 persons (295 psychiatric patients, 112 delinquents, and 269 students) were analyzed. The authors conclude that although the Pathway items seem to explain some additional variance when the Hope scale variance is partionalized out, the DHS allows unidimensional measurement. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Taylor Scale characteristics of volunteers and non-volunteers for psychological experiments.

The hypothesis that there are no differences on the Taylor Manifest Anxiety Scale between volunteers and non-volunteers in a classroom setting was tested by requesting students in introductory classes in psychology and education to volunteer for a psychological experiment, then testing those who volunteered and those who did not. The results give no basis for rejecting the null hypothesis. It would appear that level of anxiety as measured by the MAS is not a factor in the act of volunteering for psychological experiments. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Development of the forced-choice rating scale technique.

Forced-choice (FC) rating scales came about because of dissatisfaction with conventional scales. Reliabilities and validities of FC methods compare favorably with other methods. Studies on the FC method show this scale is more resistant than other scales to effects of bias. Formats using 4 favorable items, from which the rater chooses the items most characteristic of the person rated, prove superior to other formats. This superiority appears in validities, reliabilities, and preferences of raters using the form. Conditions under which statement indices are obtained should be as similar as possible to conditions under which the final scale will be administered. Combining FC scores with other scale scores yields better results than using either instrument alone. Ample evidence exists that more research can fruitfully be done in the area. (54 ref.) (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Discriminant validity of the Behavior Rating Inventory of Executive Function Parent Form for children with attention-deficit/hyperactivity disorder.

Attention-deficit/hyperactivity disorder (ADHD) is a neurodevelopmental disorder, with concomitant executive function deficits often being the focus of empirical and clinical investigation. This study explored the validity of the Behavior Rating Inventory of Executive Function Parent Form (BRIEF; Gioia, Isquith, Guy, & Kenworthy, 2000) for children with ADHD and a matched control sample. Fifty-eight children with ADHD (69% with comorbidity) and 58 matched controls were found to exhibit statistically (p     

A review of sex differences in peer relationship processes: Potential trade-offs for the emotional and behavioral development of girls and boys.

Theory and research on sex differences in adjustment focus largely on parental, societal, and biological influences. However, it also is important to consider how peers contribute to girls' and boys' development. This article provides a critical review of sex differences in several peer relationship processes, including behavioral and social-cognitive styles, stress and coping, and relationship provisions. The authors present a speculative peer-socialization model based on this review in which the implications of these sex differences for girls' and boys' emotional and behavioral development are considered. Central to this model is the idea that sex-linked relationship processes have costs and benefits for girls' and boys' adjustment. Finally, the authors present recent research testing certain model components and propose approaches for testing understudied aspects of the model. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

The validity of behavioral rating scale items for the assessment of individual creativity.

In the study of creativity, how would it do to have statements about creative people obtained in an unstructured interview form the basis for rating research personnel? After trial with 78 Ss, the data was subjected to linkage analysis. 8 types of items were identified. "It was suggested that the items presented may be valid discriminators between relatively more or less creative persons in a wide variety of research areas." (PsycINFO Database Record (c) 2010 APA, all rights reserved)