The role of external validity in evidence-based practice for rehabilitation.

Objective: To advance a methodological convention that balances concern for rigor (i.e., internal validity) with equal concern for relevance (i.e., external validity). Method: Conceptual. Results: A rating format for relevance is derived, determined, and applied to cognitive rehabilitation. Implications: The evidentiary base for applying research to practice can be properly determined through expert analysis of multidimensional criteria. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Correction to Hartnell, Ou, and Kinicki (2011).

Reports an error in "Organizational culture and organizational effectiveness: A meta-analytic investigation of the competing values framework's theoretical suppositions" by Chad A. Hartnell, Amy Yi Ou and Angelo Kinicki (Journal of Applied Psychology, Advance online publication, January 17, 2011. doi: 10.1037/a0021987). In this article the supplemental materials doi was incorrect. The correct doi is: http://dx.doi.org/10.1037/a0021987.supp All versions of this article have been corrected. (The following abstract of the original article appeared in record 2011-00494-001.) We apply Quinn and Rohrbaugh's (1983) competing values framework (CVF) as an organizing taxonomy to meta-analytically test hypotheses about the relationship between 3 culture types and 3 major indices of organizational effectiveness (employee attitudes, operational performance [i.e., innovation and product and service quality], and financial performance). The paper also tests theoretical suppositions undergirding the CVF by investigating the framework's nomological validity and proposed internal structure (i.e., interrelationships among culture types). Results based on data from 84 empirical studies with 94 independent samples indicate that clan, adhocracy, and market cultures are differentially and positively associated with the effectiveness criteria, though not always as hypothesized. The findings provide mixed support for the CVF's nomological validity and fail to support aspects of the CVF's proposed internal structure. We propose an alternative theoretical approach to the CVF and delineate directions for future research. (PsycINFO Database Record (c) 2011 APA, all rights reserved)     

Reality monitoring.

People remember information from 2 basic sources: external (perceptual processes) and internal (processes such as reasoning, imagination, and thought). Of particular interest are the processes people use in deciding whether information initially had an external or an internal source, i.e., "reality monitoring." A working model of reality monitoring is proposed to account for both discrimination and confusion between memories for thoughts and memories for perceptions. Examples of questions the model addresses are: What types of information are more likely to be represented in memories of external events than in memories of internal events?; What assumptions do individuals have about their memory for their thoughts compared to their memory for their perceptions?; and How accurate are these assumptions? Research that demonstrates the usefulness of the model is summarized. (100 ref) (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Organizational culture and organizational effectiveness: A meta-analytic investigation of the competing values framework's theoretical suppositions.

[Correction Notice: An erratum for this article was reported in Vol 96(4) of Journal of Applied Psychology (see record 2011-06260-001). In this article the supplemental materials doi was incorrect. The correct doi is: http://dx.doi.org/10.1037/a0021987.supp All versions of this article have been corrected.] We apply Quinn and Rohrbaugh's (1983) competing values framework (CVF) as an organizing taxonomy to meta-analytically test hypotheses about the relationship between 3 culture types and 3 major indices of organizational effectiveness (employee attitudes, operational performance [i.e., innovation and product and service quality], and financial performance). The paper also tests theoretical suppositions undergirding the CVF by investigating the framework's nomological validity and proposed internal structure (i.e., interrelationships among culture types). Results based on data from 84 empirical studies with 94 independent samples indicate that clan, adhocracy, and market cultures are differentially and positively associated with the effectiveness criteria, though not always as hypothesized. The findings provide mixed support for the CVF's nomological validity and fail to support aspects of the CVF's proposed internal structure. We propose an alternative theoretical approach to the CVF and delineate directions for future research. (PsycINFO Database Record (c) 2011 APA, all rights reserved)     

Common dances, uncommon therapies: Response to Ryder.

Comments on the article by Robert Ryder (see record 1989-01372-001). In an article titled "The Common Dance," Ryder offers two fundamental truths about the nature of all human relationships. He also provides an epistemological position that limits the validity (i.e., universality) of these claims. It is the intention of this response to comment both on the reality/truth (i.e., ontological) claims themselves and on the epistemological (i.e., limits of knowledge) framework in which they are propounded. Ryder evidently adopts the "antirealist" or "subjective" epistemology fashionable in many disciplines, including the family systems movement. Having adopted this epistemology, Ryder goes on to assert his two truths about human relationships-truths which, he cautiously argues, are to be taken only as relative to his stand, that is, relative to his definition of the term relationship. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Participation in the performance appraisal process and employee reactions: A meta-analytic review of field investigations.

The relationship between participation in the performance appraisal process and various employee reactions was explored through the meta-analysis of 27 studies containing 32 individual samples. The overall relationship (ρ) between participation and employee reactions, corrected for unreliability, was .61. Various conceptualizations and operationalizations of participation and employee reactions also were discussed and analyzed. Overall, appraisal participation was most strongly related to satisfaction, and value-expressive participation (i.e., participation for the sake of having one's "voice" heard) had a stronger relationship with most of the reaction criteria than did instrumental participation (i.e., participation for the purpose of influencing the end result). The results are discussed within the framework of organizational justice. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

On the automatic evaluation of end-states.

The author's research examined automatically activated attitudes toward desired end-states. Across 4 studies, participants' automatic attitudes toward goals (i.e., thinness, egalitarianism) significantly predicted their goal pursuit, including behaviors, intentions, and judgments. Such attitudes predicted behavior and judgments that are difficult to monitor and control (i.e., restrained eating, subtle prejudice), but not judgments that are easy to monitor and control (i.e., blatant prejudice). Automatic attitudes toward goals also possessed unique predictive validity compared with explicit measures of motivation and with automatic attitudes toward more physical, "graspable" objects. The findings are discussed with regard to the predictive validity of automatic attitudes, the use of automatic attitudes toward goals as an implicit measure of motivation, and the role of automatic evaluative processes in goal-pursuit and self-regulation. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Assessing the validity of ape-human comparisons: A reply to Boesch (2007).

Boesch (2007) criticizes research comparing ape and human cognition on the basis of both internal and external validity. The authors show here that most of those criticisms are not valid because: (i) most threats to internal validity (e.g., conspecific experimenters for humans but not apes) are controlled for experimentally; (ii) externally, there is no empirical evidence that captive apes have fewer cognitive skills than wild apes and indeed some evidence (especially from human-raised apes) that they have more; and (iii) externally, there is no empirical evidence that Western middle-class children have different cognitive skills from other children at very early ages in basic cognitive domains. Although difficult, with appropriate methodological care, experimental cross-species comparisons may be validly made. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Perceived experiences of anti-bisexual prejudice: Instrument development and evaluation.

This research describes the development and psychometric evaluation of the Anti-Bisexual Experiences Scale (ABES). Items were developed on the basis of prior literature, revised on the basis of expert feedback, and submitted to psychometric evaluation. Exploratory factor analysis of data from 350 bisexual participants yielded 3 factors of reported experiences of prejudicial treatment reflecting (a) Sexual Orientation Instability, (b) Sexual Irresponsibility, and (c) Interpersonal Hostility. This structure emerged with bisexual persons' reported experiences of prejudice from heterosexual people as well as from lesbian and gay people. Confirmatory factor analysis of data from a separate sample of 349 bisexual individuals supported the stability of this 3-factor structure. The data offered evidence of acceptable reliability (i.e., Cronbach's alphas of .81 to .94), convergent validity (i.e., with stigma consciousness, r = .37 to .54; with awareness of public devaluation, r = .28 to .41), and discriminant validity (i.e., for impression management, r = –.00 to .09). Relative levels of the various types of perceived experiences of anti-bisexual prejudice and the role of such experiences within the minority stress framework were also explored. With a separate sample of 176 bisexual individuals, data on the final 17-item version of the ABES yielded 2-week test–retest reliability coefficients of .77 to .89 and Cronbach's alphas of .86 to .96 across subscales. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Type of information, familiarity, and the reduction of crowding stress.

Two studies (108 college students) focused on the effectiveness of various types of information in different contexts. Two informational foci (i.e., external and internal) were employed, and Ss were either familiar or unfamiliar with a potentially stressful setting. It was assumed that one's degree of familiarity with the context would render different types of concerns more salient and that these would more effectively be met by one type of information than by the other. Exp I found that situational information was more effective than emotional information for unfamiliar Ss, whose primary concerns in the setting were external. In contrast, emotional information was effective in reducing stress and facilitating performance for familiar Ss, whose concerns were primarily internal; but situational information was also effective for these individuals. Results of Exp II indicate that situational information, if accurate, not only can serve a reinforcing "consensual validation" function that addresses people's general concerns about the "reasonableness" of their responses, but can also reduce distress. (19 ref) (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Correction to Markon et al. (2011).

Reports an error in "The reliability and validity of discrete and continuous measures of psychopathology: A quantitative review" by Kristian E. Markon, Michael Chmielewski and Christopher J. Miller (Psychological Bulletin, 2011[Sep], Vol 137[5], 856-879). In the Samples section of Meta-Analysis 1: Reliability, third paragraph, the number of studies reporting data on clinical samples is incorrect. The sentence “Four studies included clinical samples, and eight studies included nonclinical samples” should read “Twenty-four studies included clinical samples, and eight studies included nonclinical samples.” (The following abstract of the original article appeared in record 2011-09705-001.) In 2 meta-analyses involving 58 studies and 59,575 participants, we quantitatively summarized the relative reliability and validity of continuous (i.e., dimensional) and discrete (i.e., categorical) measures of psychopathology. Overall, results suggest an expected 15% increase in reliability and 37% increase in validity through adoption of a continuous over discrete measure of psychopathology alone. This increase occurs across all types of samples and forms of psychopathology, with little evidence for exceptions. For typical observed effect sizes, the increase in validity is sufficient to almost halve sample sizes necessary to achieve standard power levels. With important caveats, the current results, considered with previous research, provide sufficient empirical and theoretical basis to assume a priori that continuous measurement of psychopathology is more reliable and valid. Use of continuous measures in psychopathology assessment has widespread theoretical and practical benefits in research and clinical settings. (PsycINFO Database Record (c) 2011 APA, all rights reserved)     

I think I canp I think I canp Reconsidering the place for practice methodologies in psychological research.

Psychologists have an array of research methodologies at their disposal as they seek to answer theoretical or applied questions. Methodologies often describe reasons why one methodology is superior to another. Such discriminations are only true in general, and with respect to a certain perspective on scientific acceptability (e.g., in controlling threats to internal validity). But one research method's superiority to another may vanish in certain circumstances, with particular populations, for use with practical problems and so forth. Recent research using alternative ("softer") research methodologies (i.e., self-report measures of behavior, retrospective pretests, autobiographies) yield results demonstrably superior to those studies using more traditional methods. Given these somewhat surprising findings, arguments are offered as to why 2 other underused research methods (i.e., clinical case studies, self-experimentation) might also be seriously considered in psychology's empirical efforts. Greater use of such methods could lead to what L. T. Hoshmand and D. E. Polkinghorne (1992) refer to as practicing knowledge. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Integrating research and practice: An ecological analysis of the dynamics behind bullying and victimization.

Reviews the book, Peer harassment in school: The plight of the vulnerable and victimized edited by J. Juvonen and S. Graham (see record 2001-00685-000). Peer Harassment in School: The Plight of the Vulnerable and Victimized is a timely volume dedicated to understanding the correlates and consequences of chronic victimization in children and adolescents. The editors, Juvonen and Graham, define peer harassment as "victimization that entails face-to-face confrontation (e.g., physical aggression, verbal abuse, nonverbal gesturing) or social manipulation through a third party (e.g., social ostracism, spreading rumors)" (Juvonen & Graham, 2001, p. xiii). They use the term "harassment" as synonymous with "victimization" throughout the volume. The chapter authors include leading experts in peer harassment from both the United States and other industrialized countries (i.e., Canada, Australia, Norway, Great Britain). The book's emphasis on research on victims rather than research on bullies is important for school-based intervention programs, which have historically focused on how to intervene with aggressive students. The book further underscores the complex interconnections that exist among bullies, victims, and onlookers to the bullying events. Peer Harassment in School is a timely, theory-driven, and well-researched book that reviews the empirical evidence on methodological, developmental, social, and ecological factors associated with peer harassment. The volume is a "must-read" for any school practitioner and/or researcher interested in understanding the complexity behind victimization in children and adolescents. Juvonen and Graham draw on more than two decades of their collective researching of social phenomena in school-aged youth (Juvonen, 1991; Graham & Folkes, 1990; Graham & Juvonen, 1998) to produce an important book that advances conceptual models for peer victimization. (PsycINFO Database Record (c) 2011 APA, all rights reserved)     

Diffusion of Computer Aided Design Technology in Architectural Design Practice

Computer aided design (CAD) technology is one of the most influential information technology (IT) innovations of the last four decades. This paper studies the factors that influence the spread of this important IT innovation in the context of the Turkish architectural design practice. It builds on the innovation diffusion theory which proposes that internal (i.e., copying behaviors of others) and external influence (i.e., complying with clients’ requirements, changes in government regulations, demand conditions, and consulting firms’ suggestions) factors drive diffusion of an innovation. The paper empirically tests the propositions of innovation diffusion theory by using three mathematical models: The internal influence model, the external influence model, and the mixed influence model. Research findings point out that the mixed influence model has the highest exploratory power. They show that the diffusion of CAD technology in architectural design practice is primarily driven by internal rather than external influence factors. This study is of importance to researchers because this is the first application of the influence models to the study of the diffusion of CAD technology in architectural design practice. It is also of relevance to design practitioners since the findings should provide a useful guide in their decision to adopt or not to adopt CAD technology.     

Disorder as harmful dysfunction: A conceptual critique of DSM-III-R's definition of mental disorder.

The Diagnostic and Statistical Manual of Mental Disorders (3rd ed., rev.; DSM-III-R) operationally defines disorder essentially as "statistically unexpectable distress or disability." This definition is an attempt to operationalize 2 basic principles: that a disorder is harmful and that a disorder is a dysfunction (i.e., an inability of some internal mechanism to perform its natural function). However, the definition fails to capture the idea of "dysfunction" and so fails to validly distinguish disorders from nondisorders, leading to invalidities in many of DSM-III-R's specific diagnostic criteria. These problems with validity are traced to DSM-III-R's strategies for increasing reliability. (PsycINFO Database Record (c) 2011 APA, all rights reserved)     

Enhancing academic achievement in college students through attributional retraining and instruction.

Attributional retraining is a therapeutic method for reinstating psychological control that may be useful for improving students' achievement in the college classroom. After attributional retraining or no training, internal- and external-locus students observed a videotaped lecture presented by either a low- or a high-expressive instructor in a simulated college classroom. One week later they wrote a test on the lecture and on a homework assignment. Attributional retraining improved external, but not internal, students' performance on both the lecture and homework tests. Expressive instruction also enhanced lecture- and homework-related achievement in external students but not in internal students. These results suggest that cognitive factors influencing students' perceived control (e.g., internal/external locus) must be taken into consideration when remedial interventions for academic achievement are developed. The results are interpreted within a social cognition framework. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Mediation of interpersonal expectancy effects: 31 meta-analyses.

Reviews 135 studies on mediation and classifies results into 31 behavior categories (e.g., praise, climate, asks questions). Separate meta-analyses for each mediating variable were conducted. Results were also analyzed separately for studies that examined the relation between expectations and emitted behaviors and between mediating behaviors and outcome measures. Additional analyses focused on the influence of internal validity and type of publication on effect sizes. Meta-analyses supported the importance of 16 behaviors in the mediation of expectancy effects (e.g., creating a less negative climate, having longer interactions). The 2nd author's (1973) 4 factor (climate, feedback, input, and output) theory of the mediation of interpersonal expectancy effects proved to be a useful framework for conceptualizing broad classes of behaviors involved in the mediation of teacher-expectancy effects. Mediation references are appended. (38 ref) (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Head Reconstruction Method to Balance Flux and Source Terms in Shallow Water Equations

This paper presents the head reconstruction method (HRM), a new technique that can be used within the finite volume framework to make shallow water models well balanced, i.e., to correct the imbalance that exists between flux and source terms in the equation discretization in the case of irregular bathymetry thus providing unphysical solutions. This technique, based on considering, within each computational cell, the total head of the flow (i.e., the sum of the elevation, pressure and kinetic energies per unit weight of the fluid) as an equilibrium variable, enables the preservation of dynamic equilibria under subcritical, transcritical, and supercritical flow conditions. The new technique is applied to the one-dimensional total variation diminishing (TVD) MUSCL-Hancock scheme and the conservation property is then proven mathematically for this scheme under static equilibrium conditions. Furthermore, the effectiveness of the HRM is tested and compared with two other well balancing techniques based on considering the water elevation as an equilibrium variable in various steady flow case studies. In the end the robustness of the HRM is tested in the simulation of dam-break flow over irregular bathymetry.     

Comprehensive meta-analysis of integrity test validities: Findings and implications for personnel selection and theories of job performance.

Conducted a comprehensive meta-analysis based on 665 validity coefficients across 576,460 data points to investigate whether integrity test validities are generalizable and to estimate differences in validity due to potential moderating influences. Results indicate that integrity test validities are substantial for predicting job performance and counterproductive behaviors on the job, such as theft, disciplinary problems, and absenteeism. The estimated mean operational predictive validity of integrity test for predicting supervisory ratings of job performance is .41. Results from predictive validity studies conducted on applicants and using external criterion measures (i.e., excluding self-reports) indicate that integrity tests predict the broad criterion of organizationally disruptive behaviors better than they predict employee theft alone. Despite the influence of moderators, integrity test validities are positive across situations and settings. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

The Scaling of Information to Action in Visually Guided Braking.

Braking to avoid a collision can be controlled by keeping the deceleration required to stop (i.e., ideal deceleration) in the "safe" region below maximum deceleration, but maximum deceleration is not optically specified and can vary as conditions change. When brake strength was manipulated between participants using a simulated braking task, the ratio of ideal to maximum deceleration at brake onset was invariant across groups, suggesting that calibration involves scaling information about ideal deceleration in intrinsic units of maximum deceleration. Evidence of rapid recalibration was found when brake strength was manipulated within participants, and the presence of external forces that affect brake dynamics resulted in biases in performance. Discussion focuses on the role of calibration, internal models, and affordance perception in visually guided action. (PsycINFO Database Record (c) 2011 APA, all rights reserved)