The primary goal of this R01 proposal is to study the impact of varying supervision strategies on clinician fidelity and client outcomes in a community-based setting. Prior research has established that training approaches that do not include a period of intervention-specific supervision or consultation are ineffective and that implementation efforts that include only an initial period of supervision show an eventual attenuation of gains in knowledge and fidelity in practice. Ongoing supervision may be required for effective and sustained implementation of evidence-based practices (EBPs) in community-based settings. However, supervision is one of the least investigated aspects of training. """"""""Gold standard"""""""" elements of supervision from efficacy trials include review of sessions, standardized procedures for monitoring client outcomes and model fidelity, and ongoing skill-building (e.g., behavioral rehearsal). The degree (e.g., frequency, intensity) to which these strategies are used in community-based settings is unknown. There are a growing number of national and statewide efforts to increase the reach of EBPs through dissemination and implementation initiatives. There are 18 statewide initiatives to implement Trauma-focused Cognitive Behavioral Therapy (TF-CBT), an EBP for child trauma exposure and sequelae. The five-year, state- funded, Washington State TF-CBT Initiative is representative of many of these efforts. Many of the community- based TF-CBT implementation efforts, and those for other EBPs, include a specific focus on supervisors. However, the limited scientific literature provides very little guidance for these efforts.
Aims of the current trial include 1) studying supervision with existing implementation supports;particularly presence of gold standard elements;2) evaluating the effects of varying supervision strategies on fidelity and client outcomes;and 3) testing the mediating effect of treatment fidelity on the relationship between supervision type and client outcomes. We propose a two-phased, within-subjects and between subjects design. In Phase I (9 months), we will examine supervision with implementation support. In Phase II (30 months), we will examine two specific supervision conditions, each including varying EBP supervision elements. We plan to enroll 20 supervisors and 140 clinicians, with randomization to condition occurring at the clinician level (i.e., all supervisors will provide all conditions). We will enroll 1 youth per clinician in Phase I (N = 140) and 3 cases per clinician in Phase II (N = 420). The findings will yield important recommendations for supervision strategies that are effective in promoting high-fidelity implementation and are most feasible in community-based settings.

Public Health Relevance

This grant will provide support for studying a necessary, but often overlooked aspect in effective implementation of evidence-based practices (EBPs) for child and adolescent mental health disorders- supervision in community-based settings. As efforts to implement EBPs in community-based settings continue to increase, it is critical to identify feasible, affordable, and effective strategies to support EBP practice, with the ultimate goal of improving outcomes for children and adolescents served in these settings. EBPs hold considerable promise;however, for their public health impact to be realized, it is necessary to identify effective supervision strategies that enhance EBP fidelity, improve client outcomes, and offer a means of sustaining EBP implementation at the local level.

National Institute of Health (NIH)
National Institute of Mental Health (NIMH)
Research Project (R01)
Project #
Application #
Study Section
Dissemination and Implementation Research in Health Study Section (DIRH)
Program Officer
Chambers, David A
Project Start
Project End
Budget Start
Budget End
Support Year
Fiscal Year
Total Cost
Indirect Cost
University of Washington
Schools of Medicine
United States
Zip Code
Lucid, Leah; Meza, Rosemary; Pullmann, Michael D et al. (2018) Supervision in Community Mental Health: Understanding Intensity of EBT Focus. Behav Ther 49:481-493
Dorsey, Shannon; Kerns, Suzanne E U; Lucid, Leah et al. (2018) Objective coding of content and techniques in workplace-based supervision of an EBT in public mental health. Implement Sci 13:19
Locke, Jill; Violante, Stephanie; Pullmann, Michael D et al. (2018) Agreement and Discrepancy Between Supervisor and Clinician Alliance: Associations with Clinicians' Perceptions of Psychological Climate and Emotional Exhaustion. Adm Policy Ment Health 45:505-517
Dorsey, Shannon; Pullmann, Michael D; Kerns, Suzanne E U et al. (2017) The Juggling Act of Supervision in Community Mental Health: Implications for Supporting Evidence-Based Treatment. Adm Policy Ment Health 44:838-852
Dorsey, Shannon; McLaughlin, Katie A; Kerns, Suzanne E U et al. (2017) Evidence Base Update for Psychosocial Treatments for Children and Adolescents Exposed to Traumatic Events. J Clin Child Adolesc Psychol 46:303-330
Dorsey, Shannon; Lyon, Aaron R; Pullmann, Michael D et al. (2017) Behavioral Rehearsal for Analogue Fidelity: Feasibility in a State-Funded Children's Mental Health Initiative. Adm Policy Ment Health 44:395-404
Dorsey, Shannon; Berliner, Lucy; Lyon, Aaron R et al. (2016) A Statewide Common Elements Initiative for Children's Mental Health. J Behav Health Serv Res 43:246-61
Lyon, Aaron R; Dorsey, Shannon; Pullmann, Michael et al. (2015) Clinician use of standardized assessments following a common elements psychotherapy training and consultation program. Adm Policy Ment Health 42:47-60
Dorsey, Shannon; Pullmann, Michael D; Deblinger, Esther et al. (2013) Improving practice in community-based settings: a randomized trial of supervision - study protocol. Implement Sci 8:89