Beyond “ESTs”: Problematic assumptions in the pursuit of evidence-based practice.

There has been much confusion in the literature of psychotherapy between the broad concept of evidence-based practice and the narrower set of criteria that have been employed in designating certain treatments as “empirically validated” or “empirically supported.” In contrast to the appropriate concern with examining the evidence for the efficacy of various approaches to therapy and for the theoretical assumptions that underlie them, the “empirically supported treatments” movement has been characterized more by ideology and faulty assumptions than by good science. This paper examines in detail the scientific and logical limitations of the “EST” movement and aims to place the empirical investigation of theory and practice in psychotherapy on a sounder basis. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Empirically supported treatments in psychology: Implications for Canadian professional psychology.

Examines several interconnected efforts to develop evidence-based practice in professional psychology. We first review the American Psychological Association (APA) Division 12 (Clinical Psychology) Task Force on the Promotion and Dissemination of Psychological Procedures' development of criteria and listings for empirically supported psychological treatments. Next, we present related efforts to develop procedures to identify treatments that have established efficacy and to develop practice guidelines. The possible impact of these initiatives on Canadian professional psychology in the domains of training, credentialing, practice, and research are then examined. Finally, we present recommendations for steps that should be taken by Canadian psychology organizations to respond to these initiatives in order to ensure that psychological practice in Canada is optimally supported by scientific evidence. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Responses of practicing psychologists to a web site developed to promote empirically supported treatments.

Increased adoption of empirically supported treatments (ESTs) has been hindered in part by inadequate and inconvenient access to EST information and training. To improve diffusion of ESTs, the authors developed a Web application to provide practitioners with concise information by disorder on ESTs. The resulting site, therapyadvisor.com, was evaluated by 239 practicing psychologists to assess the usefulness of the site and explore possible interactions of EST attitudes on ratings of usefulness and impact. Two thirds of participants indicated using ESTs in practice, and limited time and resources were cited as primary barriers to EST adoption. The Web application was rated positively by most participants and was reported to increase awareness of and commitment to try ESTs among approximately 60% of participants. The results of this project support the feasibility of a Web application to increase diffusion and promote further adoption of ESTs. Technological and e-learning advances are promising directions for encouraging the adoption of ESTs specifically and evidence-based practice generally, particularly among busy practitioners who have inadequate time and resources for more traditional forms of dissemination and training. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Do haphazard reviews provide sound directions for dissemination efforts?

Comments on The dissemination and implementation of evidence-based psychological treatments: A review of current efforts (see record 2010-02208-010) by Kathryn R. McHugh and David H. Barlow. The lead article in the February–March issue by McHugh and Barlow (2010) emphasized the need for “dissemination and implementation of evidence-based psychological treatments.” The authors identified a number of intervention programs as evidence based and in need of dissemination. One is multisystemic therapy (MST). They claimed that this program is among “the most successful dissemination efforts . . . pursued by treatment developers” (p. 79). McHugh and Barlow’s (2010) discussion of the implementation of MST in Hawaii is troubling, because it neglected to mention concerns about the perceived lack of cultural sensitivity of the MST program in that state. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Effectiveness of Cognitive-Behavioral Treatment for Panic Disorder Versus Treatment as Usual in a Managed Care Setting.

Eighty clients enrolled in a managed care health plan who identified panic disorder as their primary presenting problem were randomly assigned to treatment by a therapist recently trained in a manual-based empirically supported psychotherapy (M. G. Craske, E. Meadows, & D. H. Barlow, 1994) or a therapist conducting treatment as usual (TAU). Participants in both conditions showed significant change from pre- to posttreatment on a number of measures. Those receiving panic control therapy (PCT) showed greater levels of change than those receiving TAU. Among treatment completers, an average of 42.9% of those in PCT and 18.8% in TAU achieved clinically significant change across measures. The results are discussed with reference to the dissemination of PCT and other evidence-based psychotherapies to clinical practice settings. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Attending to the Omissions: A Historical Examination of Evidence-Based Practice Movements.

Evidence-based practice and empirically supported treatment movements are potent forces that affect the practice of psychology today and have the potential to mandate the types of treatments psychologists conduct. The histories of these movements reveal that certain aspects of therapy valued by psychologists have been ignored. It is shown that the evidence-based movements (a) overemphasize treatments and treatment differences and (b) ignore aspects of psychotherapy that have been shown to be related to outcome, such as variation among psychologists, the relationship, and other common factors. It is important that psychologists understand the development of these movements so that they can be critical consumers of research and can effectively influence the future course of events. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

A haphazard reading of McHugh and Barlow (2010).

Replies to comments on Do haphazard reviews provide sound directions for dissemination efforts? (see record 2010-24768-012) by Eileen Gambrill and Julia H. Littell on the current authors' article The dissemination and implementation of evidence-based psychological treatments: A review of current efforts (see record 2010-02208-010) by Kathryn R. McHugh and David H. Barlow. In their commentary, Gambrill and Littell (2010, this issue) suggested that we provided misleading guidance on the selection of treatments for dissemination in our recent article (McHugh & Barlow, February– March 2010) on the dissemination and implementation of evidence-based treatments. These authors misread our article as an affirmation of the evidence base of the treatments involved in the dissemination and implementation efforts we described. In fact, we explicitly disclaimed in the third paragraph that “we do not revisit controversies surrounding the identification or appropriateness of [evidence-based psychological treatments] . . . rather, we focus on the status and adequacy of [dissemination and implementation] efforts currently under way (McHugh & Barlow, 2010, p. 73). Thus, our review was not intended as a guideline for which treatments to disseminate, nor was it a thorough review of the evidence base for the treatments included in the efforts we reviewed. We chose several programs for illustrative purposes as representative efforts from three general domains: national, state, and investigator initiated. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Evidence-Based Practice: Beyond Empirically Supported Treatments.

Must the clinician choose between a practice that is strictly objective and data based and one that is purely subjective and experience based? Optimally, practitioners need to follow a model of evidence-based psychotherapy practice, such as the disciplined inquiry or local clinical scientist model, that encompasses a theoretical formulation, empirically supported treatments (ESTs), empirically supported therapy relationships, clinicians' accumulated practical experience, and their clinical judgment about the case at hand. Some shortcomings of ESTs are reviewed, and a form of evidence for psychotherapy practice is presented that entails the accumulation of systematic case studies published online. Practitioners can contribute to such a database and be guided in their practice by those cases most relevant to their clients' problems. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Cultural competence and evidence-based practice in mental health services: A complementary perspective.

The need for cultural competence and the need for evidence-based practice in mental health services are major issues in contemporary discourse, especially in the psychological treatment of people of color. Although these 2 paradigms are complementary in nature, there is little cross-fertilization in the psychological literature. The present article illustrates the complementary nature of these 2 paradigms. A main point of convergence is related to the development of culturally adapted interventions in the move from efficacy research to effectiveness studies. The implications of cultural adaptations of empirically supported treatments for mental health services in terms of research and practice with ethnic/racial minority populations are discussed. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

The Empirical Status of Empirically Supported Psychotherapies: Assumptions, Findings, and Reporting in Controlled Clinical Trials.

This article provides a critical review of the assumptions and findings of studies used to establish psychotherapies as empirically supported. The attempt to identify empirically supported therapies (ESTs) imposes particular assumptions on the use of randomized controlled trial (RCT) methodology that appear to be valid for some disorders and treatments (notably exposure-based treatments of specific anxiety symptoms) but substantially violated for others. Meta-analytic studies support a more nuanced view of treatment efficacy than implied by a dichotomous judgment of supported versus unsupported. The authors recommend changes in reporting practices to maximize the clinical utility of RCTs, describe alternative methodologies that may be useful when the assumptions underlying EST methodology are violated, and suggest a shift from validating treatment packages to testing intervention strategies and theories of change that clinicians can integrate into empirically informed therapies. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

The Boulder model: A dream deferred—or lost?

Argues that contrary to the vision of the Boulder model for clinical training and practice, few clinicians undertake research or even read about it. The author contends that the infrequency with which clinical practitioners use clinical research continues to be a disappointment and an embarrassment to the discipline. It is concluded that the choice is not between empirically supported treatments and practice guidelines or the old days. It is between empirically supported treatments and practice guidelines developed by and for psychology or empirically supported treatments and practice guidelines developed by and for psychiatry. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Bridging the Gap Between Posttraumatic Stress Disorder Research and Clinical Practice: The Example of Exposure Therapy.

There are notable challenges in translating empirically supported psychosocial treatments (ESTs) into general routine clinical practice. However, there may be additional unique dissemination and implementation obstacles for ESTs for trauma-related disorders. For example, despite considerable evidence from randomized clinical trials that attests to the efficacy of exposure therapy for posttraumatic stress disorder, front-line clinicians in real-world settings rarely use this treatment. Perceived and actual barriers that interfere with adoption include clinician misconceptions about what exposure entails and complex cases to which ESTs may not be readily applicable. Specific suggestions for bridging the science-into-service gap in trauma ESTs (in general) and in exposure therapy (in particular) are proposed. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Family Intervention for Suicide Prevention: A specialized emergency department intervention for suicidal youths.

Suicide attempts and suicidal ideation are common problems among youths seen in clinical practice. Despite the high risk of repeated suicidal behavior in these patients, clinicians are faced with a lack of empirically supported treatments for these youths. This article describes the Family Intervention for Suicide Prevention (FISP), a second-generation adaptation of the Specialized Emergency Room Intervention, an evidence-based practice. Although designed for use in emergency settings, the FISP can be used by practitioners working in a wide range of settings where youths present with suicidal emergencies. Rooted in cognitive–behavioral and family systems theory, the FISP is designed to mobilize family support and problem solving, reframe the suicide attempt as a critical event that requires treatment, reinforce more adaptive coping, motivate patients and families to initiate and adhere to follow-up treatment, and promote linkage to follow-up care. This approach can be used with a wide range of patients and offers an evidence-informed tool for practicing clinicians. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

The science and practice of empirically supported treatments.

The impact on Canadian professional psychological treatment practices of the American Psychological Association""s Division 12 (Clinical Psychology) Task Force""s development of criteria and listings for empirically supported psychological treatments, along with other industrial efforts to standardize the identification of treatments with established efficacy is described in the article by J. Hunsley et al (see record 1999-01869-001). Here Hunsley et al extend their previous discussion and reply to other commentaries (see records 1999-01869-002, 1999-01869-003, 1999-01869-004, 1999-01869-005, 1999-01869-006) by viewing the current emphases in the Canadian health care system on accountability and empirically supported treatment (ESTs) as an unparalleled opportunity for professional psychology to deliver on its birthright. The generalizability of US experiences to Canadian contexts is discussed. Clinical practice guidelines should and will become the norm for providing evidence-based services in psychology, yet it would be impossible to develop such a guideline without empirical evidence proving that there are "best" interventions for a given problem. Canadian research issues in this light are discussed along with future challenges to professional psychology in Canada. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Procedures for identifying evidence-based psychological treatments for older adults.

The authors describe the methods used to identify evidence-based psychological treatments for older adults in this contribution to the special section. Coding teams were assembled to review the literature on several problems relevant to mental health and aging. These teams used the manual developed by the Committee on Science and Practice of the Society for Clinical Psychology (Division 12) of the American Psychological Association that provided definitions of key constructs used in coding. The authors provide an overview of the process followed by the review teams and of some of the issues that emerged to illustrate the steps involved in the coding procedure. Identifying evidence-based treatments is a fundamental aspect of promoting evidence-based practice with older adults; such practice is advocated by most health care disciplines, including psychology. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

EBP ≠ EST: Reply to Crits-Christoph et al. (2005) and Weisz et al. (2005).

Replies to Crits-Christoph et al. (see record 2005-04167-007) and Weisz et al (see record 2005-04167-008). Evidence-based practice (EBP) is not a synonym of empirically supported therapies (ESTs). ESTs reflect 1 kind of evidence that should guide EBP. The authors focus in this response on 4 issues: the distinction between 2 functions of randomized clinical trials (RCTs) with very different methodological and clinical implications, problems with the experimental designs used to test ESTs that have unnecessarily limited their clinical and scientific utility, the question of how to integrate findings from RCTs with findings from other empirical methods to guide evidence-based interventions, and what one means by clinicians (i.e., whether clinicians should be paraprofessionals who implement procedures developed by researchers or full-fledged partners in the development and implementation of evidence-based psychological practice). (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Behavior therapy for Tourette's disorder: Utilization in a community sample and an emerging area of practice for psychologists.

The current article describes the phenomenology and empirically supported treatments for Tourette's disorder (TD) and presents data on treatment utilization from two separate national surveys of adults with TD (N = 672) and parents of children with TD (N = 740). Despite a wealth of empirical evidence demonstrating its effectiveness, results suggest that most people with TD do not receive behavior therapy for the condition. Reasons for this include a lack of information about the disorder among consumers and providers, a shortage of providers trained in the treatment, and concern about possible negative effects of behavioral treatment. The article concludes with a discussion about dissemination efforts aimed at making behavior therapy more widely available to children and adults with chronic tics and a review of beliefs about the negative effects of behavior therapy. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Bridging the gap between alcoholism treatment research and practice: Identifying what works and why.

Despite the proliferation of alcoholism treatment research over the past 2 decades, there is a continued gap between what has been shown to be promising in the extant literature and what is commonly practiced by clinicians in the alcohol treatment field. The present article is an effort to bridge this gap by examining findings from the broad body of alcoholism treatment outcome research to determine how these findings may optimally be used by treatment providers. To this end, the authors provide clinicians with a succinct review of the current alcoholism treatment outcome literature and identify hallmarks of the most empirically supported treatments. Clinical implications of this literature for practitioners working with client with alcohol use disorders are discussed, with a focus on factors underlying effective treatments and on how these factors can be transferred from research to practice. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Empirically Supported Psychotherapies: Comment on Westen, Novotny, and Thompson-Brenner (2004).

D. Westen, C. M. Novotny, and H. Thompson-Brenner (2004; see record 2004-15935-005) suggested that efforts to identify empirically supported treatments are misguided because they are based on assumptions that are not appropriate for some types of treatment and patients. The authors of this comment argue that Westen and colleagues are simply incorrect when they assert that empirically supported treatments require that psychopathology must be highly malleable, that treatments must be brief, or that the samples studied are unrepresentative of the kinds of patients typically encountered in clinical practice--comorbidity is common in many clinical trials. Randomized controlled trials remain the most powerful way to test notions of causal agency. (PsycINFO Database Record (c) 2010 APA, all rights reserved)