Portal de Periódicos da CAPES

Empirically Supported Treatment: Recommendations for a New Model

2015; Wiley; Volume: 22; Issue: 4 Linguagem: Inglês

10.1111/cpsp.12122

1468-2850

David F. Tolin, Dean McKay, Evan M. Forman, E. David Klonsky, Brett D. Thombs,

Meta-analysis and systematic reviews

Clinical Psychology: Science and PracticeVolume 22, Issue 4 p. 317-338 Review Empirically Supported Treatment: Recommendations for a New Model David F. Tolin, Corresponding Author David F. Tolin The Institute of Living and Yale University School of MedicineAddress correspondence to David F. Tolin, Ph.D., Anxiety Disorders Center, The Institute of Living, 200 Retreat Avenue, Hartford, CT 06106. E-mail: [email protected].Search for more papers by this authorDean McKay, Dean McKay Fordham UniversitySearch for more papers by this authorEvan M. Forman, Evan M. Forman Drexel UniversitySearch for more papers by this authorE. David Klonsky, E. David Klonsky University of British ColumbiaSearch for more papers by this authorBrett D. Thombs, Brett D. Thombs Jewish General Hospital and McGill UniversitySearch for more papers by this author David F. Tolin, Corresponding Author David F. Tolin The Institute of Living and Yale University School of MedicineAddress correspondence to David F. Tolin, Ph.D., Anxiety Disorders Center, The Institute of Living, 200 Retreat Avenue, Hartford, CT 06106. E-mail: [email protected].Search for more papers by this authorDean McKay, Dean McKay Fordham UniversitySearch for more papers by this authorEvan M. Forman, Evan M. Forman Drexel UniversitySearch for more papers by this authorE. David Klonsky, E. David Klonsky University of British ColumbiaSearch for more papers by this authorBrett D. Thombs, Brett D. Thombs Jewish General Hospital and McGill UniversitySearch for more papers by this author First published: 09 November 2015 https://doi.org/10.1111/cpsp.12122Citations: 71Read the full textAboutPDF ToolsRequest permissionExport citationAdd to favoritesTrack citation ShareShare Give accessShare full text accessShare full-text accessPlease review our Terms and Conditions of Use and check box below to share full-text version of article.I have read and accept the Wiley Online Library Terms and Conditions of UseShareable LinkUse the link below to share a full-text version of this article with your friends and colleagues. Learn more.Copy URL Abstract Over the 20 years since the criteria for empirically supported treatments (ESTs) were published, standards for synthesizing evidence have evolved and more systematic approaches to reviewing the findings from intervention trials have emerged. Currently, the APA is planning the development of treatment guidelines, a process that will likely take many years. As an intermediate step, we recommend a revised set of criteria for ESTs that will utilize existing systematic reviews of all of the available literature, and recommendations that address the methodological quality, outcomes, populations, and treatment settings included in the literature. References American Psychiatric Association. (2009). Practice guideline for the treatment of patients with panic disorder ( 2nd ed.). Washington, DC: Author. American Psychiatric Association. (2010). Practice guideline for the treatment of patients with major depressive disorder ( 3rd ed.). Washington, DC: Author. American Psychiatric Association. (2013). Diagnostic and statistical manual of mental disorders ( 5th ed.). Washington, DC: Author. American Psychological Association. (1995). Template for developing guidelines: Interventions for mental disorders and psychosocial aspects of physical disorders. Washington, DC: Author. American Psychological Association. (2002). Criteria for evaluating treatment guidelines. American Psychologist, 57, 1052– 1059. doi:10.1037//0003-066X.57.12.1052 Amir, N., Beard, C., Burns, M., & Bomyea, J. (2009). Attention modification program in individuals with generalized anxiety disorder. Journal of Abnormal Psychology, 118(1), 28– 33. doi:10.1037/a0012589 Andreasen, N. C., Carpenter, W. T., Jr., Kane, J. M., Lasser, R. A., Marder, S. R., & Weinberger, D. R. (2005). Remission in schizophrenia: Proposed criteria and rationale for consensus. American Journal of Psychiatry, 162, 441– 449. doi:10.1176/appi.ajp.162.3.441 APA Presidential Task Force on Evidence-Based Practice. (2006). Evidence-based practice in psychology. American Psychologist, 61, 271– 285. doi:10.1037/0003-066X.61.4.271 Areán, P. A., & Kraemer, H. C. (2013). High-quality psychotherapy research. New York, NY: Oxford University Press. Atkins, D., Eccles, M., Flottorp, S., Guyatt, G. H., Henry, D., Hill, S., … GRADE Working Group. (2004). Systems for grading the quality of evidence and the strength of recommendations I: Critical appraisal of existing approaches: The GRADE Working Group. BMC Health Services Research, 4(1), 38. doi:10.1186/1472-6963-4-38 Baker, M., & Kleijnen, J. (2000). The drive towards evidence-based health care. In N. Rowland & S. Goss (Eds.), Evidence-based counseling and psychological therapies: Research and applications (pp. 13– 29). New York, NY: Routledge. Bellg, A. J., Borrelli, B., Resnick, B., Hecht, J., Minicucci, D. S., & Ory, M., … Treatment Fidelity Workgroup of the NIH-BCC. (2004). Enhancing treatment fidelity in health behavior change studies: Best practices and recommendations from the NIH Behavior Change Consortium. Health Psychology, 23, 443– 451. doi:10.1037/0278-6133.23.5.443 Benish, S. G., Quintana, S., & Wampold, B. E. (2011). Culturally adapted psychotherapy and the legitimacy of myth: A direct-comparison meta-analysis. Journal of Counseling Psychology, 58, 279– 289. doi:10.1037/a0023626 Bernardy, K., Fuber, N., Kollner, V., & Hauser, W. (2010). Efficacy of cognitive-behavioral therapies in fibromyalgia syndrome—A systematic review and meta-analysis of randomized controlled trials. Journal of Rheumatology, 37, 1991– 2005. doi:10.3899/jrheum.100104 Bero, L. A. (2013). Why the Cochrane risk of bias tool should include funding source as a standard item. Cochrane Database Systematic Review, 12, ED000075. doi:10.1002/14651858.ED000075 Beutler, L. E. (1998). Identifying empirically supported treatments: What if we didn't? Journal of Consulting and Clinical Psychology, 66, 113– 120. doi:10.1037/0022-006X.66.1.113 Blatt, S. J., & Zuroff, D. C. (2005). Empirical evaluation of the assumptions in identifying evidence based treatments in mental health. Clinical Psychology Review, 25, 459– 486. doi:10.1016/j.cpr.2005.03.001 Borkovec, T. D., & Castonguay, L. G. (1998). What is the scientific meaning of empirically supported therapy? Journal of Consulting and Clinical Psychology, 66, 136– 142. doi:10.1037/0022-006X.66.1.136 Castonguay, L. G., & Beutler, L. E. (2006). Principles of therapeutic change that work. New York, NY: Oxford University Press. Chambless, D. L., Baker, M. J., Baucom, D. H., Beutler, L. E., Calhoun, K. S., Crits-Christoph, P., … Woody, S. (1998). Update on empirically validated therapies. II. The Clinical Psychologist, 51(1), 3– 16. Chambless, D. L., & Hollon, S. D. (1998). Defining empirically supported therapies. Journal of Consulting and Clinical Psychology, 66, 7– 18. doi:10.1037/0022-006X.66.1.7 Chambless, D. L., & Ollendick, T. H. (2001). Empirically supported psychological interventions: Controversies and evidence. Annual Review of Psychology, 52, 685– 716. doi:10.1146/annurev.psych.52.1.685 Cohen, J. (1988). Statistical power analysis for the behavioral sciences ( 2nd ed.). Hillsdale, NJ: Erlbaum. Commission on Accreditation. (2013). Guidelines and principles for accreditation of programs in professional psychology. Washington, DC: American Psychological Association. Cowen, E. L. (1991). In pursuit of wellness. American Psychologist, 46, 404. doi:10.1037/0003-066X.46.4.40 Djulbegovic, B., & Guyatt, G. H. (2014). Evidence-based practice is not synonymous with delivery of uniform health care. JAMA, 312, 1293– 1294. doi:10.1001/jama.2014.10713 Dobson, K., & Beshai, S. (2013). The theory-practice gap in cognitive behavioral therapy: Reflections and a modest proposal to bridge the gap. Behavior Therapy, 44, 559– 567. doi:10.1016/j.beth.2013.03.002 Doyle, A. C., & Pollack, M. H. (2003). Establishment of remission criteria for anxiety disorders. Journal of Clinical Psychiatry, 64(Suppl. 15), 40– 45. Feeny, N. C., Zoellner, L. A., & Foa, E. B. (2002). Treatment outcome for chronic PTSD among female assault victims with borderline personality characteristics: A preliminary examination. Journal of Personality Disorders, 16(1), 30– 40. doi:10.1521/pedi.16.1.30.22555 Fensterheim, H., & Raw, S. D. (1996). Psychotherapy research is not psychotherapy practice. Clinical Psychology: Science and Practice, 3, 168– 171. doi:10.1111/j.1468-2850.1996.tb00067.x Fonagy, P. (1999). Achieving evidence-based psychotherapy practice: A psychodynamic perspective on the general acceptance of treatment manuals. Clinical Psychology: Science and Practice, 6, 442– 444. doi:10.1093/clipsy.6.4.442 Frank, E., Prien, R. F., Jarrett, R. B., Keller, M. B., Kupfer, D. J., Lavori, P. W., … Weissman, M. M. (1991). Conceptualization and rationale for consensus definitions of terms in major depressive disorder: Remission, recovery, relapse, and recurrence. Archives of General Psychiatry, 48, 851– 855. doi:10.1001/archpsyc.1991.01810330075011 Franklin, M. E., Abramowitz, J. S., Kozak, M. J., Levitt, J. T., & Foa, E. B. (2000). Effectiveness of exposure and ritual prevention for obsessive-compulsive disorder: Randomized compared with nonrandomized samples. Journal of Consulting and Clinical Psychology, 68, 594– 602. doi:10.1037/0022-006X.68.4.59 Friedman, L. S., & Richter, E. D. (2004). Relationship between conflicts of interest and research results. Journal of General Internal Medicine, 19(1), 51– 56. doi:10.1111/j.1525-1497.2004.30617.x Gaffan, E. A., Tsaousis, I., & Kemp-Wheeler, S. M. (1995). Researcher allegiance and meta-analysis: The case of cognitive therapy for depression. Journal of Consulting and Clinical Psychology, 63, 966– 980. doi:10.1037/0022-006X.63.6.966 Gibbons, C. R., Stirman, S. W., DeRubeis, R. J., Newman, C. F., & Beck, A. T. (2013). Research setting versus clinic setting: Which produces better outcomes in cognitive therapy for depression? Cognitive Therapy and Research, 37, 605– 612. doi:10.1007/s10608-012-9499-7 Gill, T. M., & Feinstein, A. R. (1994). A critical appraisal of the quality of quality-of-life measurements. JAMA, 272, 619– 626. doi:10.1001/jama.1994.03520080061045 Goldfried, M. R., & Eubanks-Carter, C. (2004). On the need for a new psychotherapy research paradigm: Comment on Westen, Novotny, and Thompson-Brenner (2004). Psychological Bulletin, 130, 669– 673; author reply 677-683. doi:10.1037/0033-2909.130.4.669 Goldfried, M. R., & Wolfe, B. E. (1996). Psychotherapy practice and research: Repairing a strained alliance. American Psychologist, 51, 1007– 1016. doi:10.1037//0003-066X.51.10.1007 Goldfried, M. R., & Wolfe, B. E. (1998). Toward a more clinically valid approach to therapy research. Journal of Consulting and Clinical Psychology, 66, 143– 150. doi:10.1037/0022-006X.66.1.143 Gonzales, J. J., & Chambers, D. A. (2002). The tangled and thorny path of science to practice: Tensions in interpreting and applying "evidence." Clinical Psychology: Science and Practice, 9, 204– 209. doi:10.1093/clipsy.9.2.204 Greenland, S., & O'Rourke, K. (2001). On the bias produced by quality scores in meta-analysis, and a hierarchical view of proposed solutions. Biostatistics, 2, 463– 471. doi:10.1093/biostatistics/2.4.463 Griner, D., & Smith, T. B. (2006). Culturally adapted mental health intervention: A meta-analytic review. Psychotherapy (Chic), 43, 531– 548. doi:10.1037/0033-3204.43.4.531 Guyatt, G. H., Gutterman, D., Baumann, M. H., Addrizzo-Harris, D., Hylek, E. M., Phillips, B., … Schunemann, H. (2006). Grading strength of recommendations and quality of evidence in clinical guidelines: Report from an American College of Chest Physicians task force. Chest, 129(1), 174– 181. doi:10.1378/chest.129.1.174 Guyatt, G. H., Oxman, A. D., Vist, G. E., Kunz, R., Falck-Ytter, Y., Alonso-Coello, P., … GRADE Working Group. (2008). GRADE: An emerging consensus on rating quality of evidence and strength of recommendations. British Medical Journal, 336, 924– 926. doi:10.1136/bmj.39489.470347.AD Hayes, S. C. (2004). Acceptance and commitment therapy, relational frame theory, and the third wave of behavioral and cognitive therapies. Behavior Therapy, 35, 639– 665. doi:10.1016/S0005-7894(04)80013-3 Henry, W. P. (1998). Science, politics, and the politics of science: The use and misuse of empirically validated treatment research. Psychotherapy Research, 8(2), 126– 140. doi:10.1093/ptr/8.2.126 Herbert, J. D. (2003). The science and practice of empirically supported treatments. Behavior Modification, 27, 412– 430. doi:10.1177/0145445503253836 Higgins, J. P., Altman, D. G., Gotzsche, P. C., Juni, P., Moher, D., Oxman, A. D., … Cochrane Statistical Methods Group. (2011). The Cochrane Collaboration's tool for assessing risk of bias in randomised trials. British Medical Journal, 343, d5928. doi:10.1136/bmj.d5928 Higgins, J. P., & Green, S. (Eds.). (2008). Cochrane handbook for systematic reviews of interventions. Hoboken, NJ: Wiley-Blackwell. Hollon, S. D. (1999). Allegiance effects in treatment research: A commentary. Clinical Psychology: Science and Practice, 6, 107– 112. doi:10.1093/clipsy.6.1.107 Hollon, S. D., Arean, P. A., Craske, M. G., Crawford, K. A., Kivlahan, D. R., Magnavita, J. J., … Kurtzman, H. (2014). Development of clinical practice guidelines. Annual Review of Clinical Psychology, 10, 213– 241. doi:10.1146/annurev-clinpsy-050212-185529 Horner, R. H., Carr, E. G., Halle, J., McGee, G., Odom, S. & Wolery, M. (2005). The use of single-subject research to identify evidence-based practice in special education. Exceptional Child, 71(2), 165– 179. doi:10.1177/001440290507100203 Hunt, S. M., & McKenna, S. P. (1993). Measuring quality of life in psychiatry. In S. R. Walker & R. M. Rossner (Eds.), Quality of life assessment: Key issues in the 1990s (pp. 343– 354). Boston: Kluwer Academic. Insel, T., Cuthbert, B., Garvey, M., Heinssen, R., Pine, D. S., Quinn, K., … Wang, P. (2010). Research domain criteria (RDoC): Toward a new classification framework for research on mental disorders. American Journal of Psychiatry, 167, 748– 751. doi:10.1176/appi.ajp.2010.09091379 Institute of Medicine. (2001). Crossing the quality chasm: A new health system for the 21st century. Washington, DC: National Academies Press. Institute of Medicine. (2011a). Clinical practice guidelines we can trust. Washington, DC: National Academies Press. Institute of Medicine. (2011b). Finding what works in health care: Standards for systematic reviews. Washington, DC: National Academies Press. Ioannidis, J. P. (2008). Interpretation of tests of heterogeneity and bias in meta-analysis. Journal of Evaluation in Clinical Practice, 14, 951– 957. doi:10.1111/j.1365-2753.2008.00986.x Jacobson, N. S., Follette, W. C., & Revenstorf, D. (1984). Toward a standard definition of clinically significant change. Behavior Therapy, 17, 308– 311. doi:10.1016/S0005-7894(86)80061-2 Juni, P., Witschi, A., Bloch, R., & Egger, M. (1999). The hazards of scoring the quality of clinical trials for meta-analysis. JAMA, 282, 1054– 1060. doi:10.1001/jama.282.11.1054 Keltner, J. R., Vaida, F., Ellis, R. J., Moeller-Bertram, T., Fitzsimmons, C., Duarte, N. A., … CHARTER Group. (2012). Health-related quality of life 'well-being' in HIV distal neuropathic pain is more strongly associated with depression severity than with pain intensity. Psychosomatics, 53, 380– 386. doi:10.1016/j.psym.2012.05.002 Kocsis, J. H., Gerber, A. J., Milrod, B., Roose, S. P., Barber, J., Thase, M. E., … Leon, A. C. (2010). A new scale for assessing the quality of randomized clinical trials of psychotherapy. Comprehensive Psychiatry, 51, 319– 324. doi:10.1016/j.comppsych.2009.07.001 Kushner, S. C., Quilty, L. C., McBride, C. & Bagby, R. M. (2009). A comparison of depressed patients in randomized versus nonrandomized trials of antidepressant medication and psychotherapy. Depression and Anxiety, 26, 666– 673. doi:10.1002/da.20566 Lambert, M. J., & Bailey, R. J. (2012). Measures of clinically significant change. In H. Cooper, P. M. Camic, D. L. Long, A. T. Panter, D. Rindskopf, & K. J. Sher (Eds.), APA handbook of research methods in psychology, Vol. 3: Data analysis and research publication, (pp. 147– 160). Washington, DC: American Psychological Association. Lambert, M. J., & Barley, D. E. (2001). Research summary on the therapeutic relationship and psychotherapy outcome. Psychotherapy, 38, 357– 361. doi:10.1037/0033-3204.38.4.357 Lambert, M. J., Hansen, N. B., Umphress, V., Lunnen, K. M., Okiishi, J., Burlingame, G. M., … Reisinger, C. R. (1996). Administration and scoring manual for the Outcome Questionnaire (OQ-45.2). Wilmington, DE: American Professional Credentialing Services. Layard, R., & Clark, D. M. (2014). Thrive: The power of evidence-based psychological therapies. London, UK: Penguin. Lejuez, C. W., Hopko, D. R., & Hopko, S. D. (2001). A brief behavioral activation treatment for depression: Treatment manual. Behavior Modification, 25, 255– 286. doi:10.1177/0145445501252005 Leon, A. C., Solomon, D. A., Mueller, T. I., Turvey, C. L., Endicott, J., & Keller, M. B. (1999). The Range of Impaired Functioning Tool (LIFE-RIFT): A brief measure of functional impairment. Psychological Medicine, 29, 869– 878. doi:10.1017/S0033291799008570 Levant, R. F. (2004). The empirically validated treatments movement: A practitioner/educator perspective. Clinical Psychology: Science and Practice, 11, 219– 224. doi:10.1093/clipsy.bph075 Lewinsohn, P. M., Biglan, A., & Zeiss, A. M. (1976). Behavioral treatment for depression. In P. O. Davidson (Ed.), Behavioral management of anxiety, depression, and pain (pp. 91– 146). New York, NY: Brunner/Mazel. Lexchin, J., Bero, L. A., Djulbegovic, B., & Clark, O. (2003). Pharmaceutical industry sponsorship and research outcome and quality: Systematic review. BMJ, 326, 1167– 1170. doi:10.1136/bmj.326.7400.1167 Leykin, Y., & DeRubeis, R. J. (2009). Allegiance in psychotherapy outcome research: Separating association from bias. Clinical Psychology: Science and Practice, 16, 54– 65. doi:10.1111/j.1468-2850.2009.01143.x Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gotzsche, P. C., Ioannidis, J. P., … Moher, D. (2009). The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: Explanation and elaboration. PLoS Medicine, 6(7), e1000100. doi:10.1371/journal.pmed.1000100 Lock, J., Le Grange, D., Agras, W. S., Moye, A., Bryson, S. W., & Jo, B. (2010). Randomized clinical trial comparing family-based treatment with adolescent-focused individual therapy for adolescents with anorexia nervosa. Archives of General Psychiatry, 67, 1025– 1032. doi:10.1001/archgenpsychiatry.2010.128 Lohr, J. M., Tolin, D. F., & Lilienfeld, S. O. (1998). Efficacy of eye movement desensitization and reprocessing: Implications for behavior therapy. Behavior Therapy, 29, 123– 156. doi:10.1016/S0005-7894(98)80035-X van Loon, A., van Schaik, A., Dekker, J., & Beekman, A. (2013). Bridging the gap for ethnic minority adult outpatients with depression and anxiety disorders by culturally adapted treatments. Journal of Affective Disorders, 147(1–3), 9– 16. doi:10.1016/j.jad.2012.12.014 Luborsky, L., Diguer, L., Seligman, D. A., Rosenthal, R., Krause, E. D., Johnson, S., … Schweizer, E. (1999). The researcher's own therapy allegiances: A "wild card" in comparisons of treatment efficacy. Clinical Psychology: Science and Practice, 6, 95– 106. doi:10.1093/clipsy.6.1.95 Lundh, A., Sismondo, S., Lexchin, J., Busuioc, O. A., & Bero, L. (2012). Industry sponsorship and research outcome. Cochrane Database Systematic Review, 12, MR000033. doi:10.1002/14651858.MR000033.pub2 Martell, C. R., Addis, M. E., & Jacobson, N. S. (2001). Depression in context: Strategies for guided action. New York, NY: W. W. Norton. McIntyre, R. S., Fallu, A., & Konarski, J. Z. (2006). Measurable outcomes in psychiatric disorders: Remission as a marker of wellness. Clinical Therapeutics, 28, 1882– 1891. doi:10.1016/j.clinthera.2006.11.007 Milette, K., Roseman, M., & Thombs, B. D. (2011). Transparency of outcome reporting and trial registration of randomized controlled trials in top psychosomatic and behavioral health journals: A systematic review. Journal of Psychosomatic Research, 70, 205– 217. doi:10.1016/j.jpsychores.2010.09.015 Milrod, B., Leon, A. C., Busch, F., Rudden, M., Schwalberg, M., Clarkin, J., … Shear, M. K. (2007). A randomized controlled clinical trial of psychoanalytic psychotherapy for panic disorder. American Journal of Psychiatry, 164, 265– 272. doi:10.1176/appi.ajp.164.2.265 Miranda, J., Bernal, G., Lau, A., Kohn, L., Hwang, W. C., & LaFromboise, T. (2005). State of the science on psychosocial interventions for ethnic minorities. Annual Review of Clinical Psychology, 1, 113– 142. doi:10.1146/annurev.clinpsy.1.102803.143822 Moher, D., Schulz, K. F., & Altman, D. G. (2001). The CONSORT statement: Revised recommendations for improving the quality of reports of parallel group randomized trials. BMC Medical Research Methodology, 1, 2. doi:10.7326/0003-4819-134-8-200104170-00011 Muldoon, M. F., Barger, S. D., Flory, J. D., & Manuck, S. B. (1998). What are quality of life measurements measuring? British Medical Journal, 316, 542– 545. doi:10.1136/bmj.316.7130.542 Mundt, J. C., Marks, I. M., Shear, M. K., & Greist, J. H. (2002). The Work and Social Adjustment Scale: A simple measure of impairment in functioning. British Journal of Psychiatry, 180, 461– 464. doi:10.1192/bjp.180.5.46 National Institute for Clinical Excellence. (2011). Generalised anxiety disorder and panic disorder (with or without agoraphobia) in adults: Management in primary, secondary and community care (National Clinical Practice Guideline number CG113). London: British Psychological Society and Royal College of Psychiatrists. Norcross, J. C. (1999). Collegially validated limitations of empirically validated treatments. Clinical Psychology: Science and Practice, 6, 472– 476. doi:10.1093/clipsy.6.4.472 O'Farrell, T. J., Cutter, H. S. G., Choquette, K. A., Floyd, F. J., & Bayog, R. D. (1992). Behavioral marital therapy for male alcoholics: Marital and drinking adjustment during the two years after treatment. Behavior Therapy, 23, 529– 549. doi:10.1016/S0005-7894(05)80220-5 Parker, G., Parker, I., Brotchie, H., & Stuart, S. (2006). Interpersonal psychotherapy for depression? The need to define its ecological niche. Journal of Affective Disorders, 95(1–3), 1– 11. doi:10.1016/j.jad.2006.03.019 Perlis, R. H., Perlis, C. S., Wu, Y., Hwang, C., Joseph, M., & Nierenberg, A. A. (2005). Industry sponsorship and financial conflict of interest in the reporting of clinical trials in psychiatry. American Journal of Psychiatry, 162, 1957– 1960. doi:10.1176/appi.ajp.162.10.1957 Perri, M. G., Sears, S. F., Jr., & Clark, J. E. (1993). Strategies for improving maintenance of weight loss: Toward a continuous care model of obesity management. Diabetes Care, 16(1), 200– 209. doi:10.2337/diacare.16.1.200 Petry, N. M., Martin, B., Cooney, J. L., & Kranzler, H. R. (2000). Give them prizes, and they will come: Contingency management for treatment of alcohol dependence. Journal of Consulting and Clinical Psychology, 68, 250– 257. doi:10.1037//0022-006X.68.2.250 Riehm, K. E., Azar, M., & Thombs, B. D. (2015). Transparency of outcome reporting and trial registration of randomized controlled trials in top psychosomatic and behavioral health journals: A 5-year follow-up. Journal of Psychosomatic Research, 79(1), 1– 12. doi:10.1016/j.jpsychores.2015.04.010 Roseman, M., Milette, K., Bero, L. A., Coyne, J. C., Lexchin, J., Turner, E. H., & Thombs, B. D. (2011). Reporting of conflicts of interest in meta-analyses of trials of pharmacological treatments. JAMA, 305, 1008– 1017. doi:10.1001/jama.2011.257 Roseman, M., Turner, E. H., Lexchin, J., Coyne, J. C., Bero, L. A., & Thombs, B. D. (2012). Reporting of conflicts of interest from drug trials in Cochrane reviews: Cross sectional study. British Medical Journal, 345, e5155. doi:10.1136/bmj.e5155 Rosen, G. M., & Davison, G. C. (2003). Psychology should list empirically supported principles of change (ESPs) and not credential trademarked therapies or other treatment packages. Behavior Modification, 27, 300– 312. doi:10.1177/0145445503027003003 Ruzek, J. I., Karlin, B. E., & Zeiss, A. M. (2012). Implementation of evidence-based psychological treatments in the Veterans Health Administration. In R. K. McHugh & D. H. Barlow (Eds.), Dissemination of evidence-based psychological treatments (pp. 78– 96). New York, NY: Oxford University Press. Savovic, J., Jones, H. E., Altman, D. G., Harris, R. J., Juni, P., Pildal, J., … Sterne, J. A. (2012). Influence of reported study design characteristics on intervention effect estimates from randomized, controlled trials. Annals of Internal Medicine, 157, 429– 438. doi:10.7326/0003-4819-157-6-201209180-00537 Schneier, F. R., Heckelman, L. R., Garfinkel, R., Campeas, R., Fallon, B. A., Gitow, A., … Liebowitz, M. R. (1994). Functional impairment in social phobia. Journal of Clinical Psychiatry, 55, 322– 331. Seligman, M. E. (1995). The effectiveness of psychotherapy: The Consumer Reports Study. American Psychologist, 50, 965– 974. doi:10.1037/0003-066X.50.12.965 Seligman, M. E. (1996). Science as an ally of practice. American Psychologist, 51, 1072– 1079. doi:10.1037/0003-066X.51.10.1072 Shadish, W. R. (2014). Statistical analyses of single-case designs: The shape of things to come. Current Directions in Psychological Science, 23, 139– 146. doi:10.1177/0963721414524773 Shea, B. J., Bouter, L. M., Peterson, J., Boers, M., Andersson, N., Ortiz, Z., … Grimshaw, J. M. (2007). External validation of a measurement tool to assess systematic reviews (AMSTAR). PLoS ONE, 2, e1350. doi:10.1371/journal.pone.0001350 Shea, B. J., Grimshaw, J. M., Wells, G. A., Boers, M., Andersson, N., Hamel, C., … Bouter, L. M. (2007). Development of AMSTAR: A measurement tool to assess the methodological quality of systematic reviews. BMC Medical Research Methodology, 7, 10. doi:10.1186/1471-2288-7-10 Shea, B. J., Hamel, C., Wells, G. A., Bouter, L. M., Kristjansson, E., Grimshaw, J., … Boers, M. (2009). AMSTAR is a reliable and valid measurement tool to assess the methodological quality of systematic reviews. Journal of Clinical Epidemiology, 62, 1013– 1020. doi:10.1016/j.jclinepi.2008.10.009 Sheehan, D. V. (2008). Sheehan Disability Scale. In A. Rush, M. First, & D. Blacker, (Eds.), Handbook of psychiatric measures (2nd. ed., pp. 100– 102). Washington, DC: American Psychiatric Publishing. Simpson, H. B., Huppert, J. D., Petkova, E., Foa, E. B., & Liebowitz, M. R. (2006). Response versus remission in obsessive-compulsive disorder. Journal of Clinical Psychiatry, 67, 269– 276. doi:10.4088/jcp.v67n0214 Smith, T., Scahill, L., Dawson, G., Guthrie, D., Lord, C., Odom, S., … Wagner, A. (2007). Designing research studies on psychosocial interventions in autism. Journal of Autism and Developmental Disorders, 37, 354– 366. doi:10.1007/s10803-006-0173-3 Stirman, S. W., DeRubeis, R. J., Crits-Christoph, P., & Rothman, A. (2005). Can the randomized controlled trial literature generalize to nonrandomized patients? Journal of Consulting and Clinical Psychology, 73, 127– 135. doi:10.1037/0022-006X.73.1.127 Task Force on Promotion and Dissemination of Psychological Procedures. (1993). Training in and dissemination of empirically-validated psychological treatments: Report and recommendation. The Clinical Psychologist, 48, 3– 23. Thoma, N. C., McKay, D., Gerber, A. J., Milrod, B. L., Edwards, A. R., & Kocsis, J. H. (2012). A quality-based review of randomized controlled trials of cognitive-behavioral therapy for depression: An assessment and metaregression. American Journal of Psychiatry, 169, 22– 30. doi:10.1176/appi.ajp.2011.11030433 Thombs, B. D., Kwakkenbos, L., & Coronado-Montoya, S. (2014). Trial registration in rheumatology: The next step. Arthritis Care and Research, 66, 1435– 1437. doi:10.1002/acr.22335 Tolin, D. F. (2014). Evidence-based practice: Three-legged stool or filter system? The Clinical Psychologist, 67(3), 1– 3. Vatne, S., & Bjorkly, S. (2008). Empirical evidence for using subjective quality of life as an outcome variable in clinical studies: A meta-analysis of correlates and predictors in persons with a major mental disorder living in the community. Clinical Psychology Review, 28, 869– 889. doi:10.1016/j.cpr.2008.01.001 Veterans Health Administration, Department of Defense. (2004). VA/DoD clinical practice guideline for the management of post-traumatic stress. Version 1.0. Retrieved January 2004. Veterans Health Administration, Department of Defense. (2009). VA/DoD clinical practice guideline for the management of major depressive disorder. Version 2.0. Retrieved June 2015. Wachtel, P. L. (2010). Beyond "ESTs:" Problematic assumptions in the pursuit of evidence-based practice. Psychoanalytic Psychology, 27, 251– 272. doi:10.1037/a0020532 Westen, D., Novotny, C. M., & Thompson-Brenner, H. (2004). The empirical status of empirically supported psychotherapies: Assumptions, findings, and reporting in controlled clinical trials. Psychological Bulletin, 130, 631– 663. doi:10.1037/0033-2909.130.4.63 Wood, L., Egger, M., Gluud, L. L., Schulz, K. F., Juni, P., Altman, D. G., … Sterne, J. A. (2008). Empirical evidence of bias in treatment effect estimates in controlled trials with different interventions and outcomes: Meta-epidemiological study. British Medical Journal, 336, 601– 605. doi:10.1136/bmj.39465.451748.AD Yeomans, F. E., Levy, K. N., & Caligor, E. (2013). Transference-focused psychotherapy. Psychotherapy (Chic), 50, 449– 453. doi:10.1037/a0033417 Zalta, A. K. (2015). Psychological mechanisms of effective cognitive-behavioral treatments for PTSD. Current Psychiatry Reports, 17, 560. doi:10.1007/s11920-015-0560-6 Citing Literature Supporting Information Filename Description cpsp12122-sup-0001-TableS1-3.pdfapplication/PDF, 322.8 KB Table S1. Domains for determining risk of bias in systematic reviews of psychotherapy outcome studies.Table S2. Summary assessments of risk of bias.Table S3. Scoring criteria for the Assessment of Multiple Systematic Reviews System. Please note: The publisher is not responsible for the content or functionality of any supporting information supplied by the authors. Any queries (other than missing content) should be directed to the corresponding author for the article. Volume22, Issue4December 2015Pages 317-338 ReferencesRelatedInformation