Abstract
The Interdisciplinary Collaborative Team (ICT) strategy uses front-line providers as adaptation, training and quality control agents for multi-agency EBT implementation. This study tests whether an ICT transmits fidelity to subsequent provider cohorts. SafeCare was implemented by home visitors from multiple community-based agencies contracting with child welfare. Client-reported fidelity trajectories for 5,769 visits, 957 clients and 45 providers were compared using three-level growth models. Provider cohorts trained and live-coached by the ICT attained benchmark fidelity after 12 weeks, and this was sustained. Hispanic clients reported high cultural competency, supporting a cultural adaptation crafted by the ICT.
Similar content being viewed by others
References
Aarons, G. A., Fettes, D. L., Hurlburt, M. S., Palinkas, L. A., Gunderson, L., Willging, C. E., & Chaffin, M. J. (2014). Collaboration, negotiation, and coalescence for Interagency-Collaborative Teams to scale-up evidence-based practice. J Clin Child Adolesc Psychol. doi:10.1080/15374416.2013.876642.
Aarons, G. A., Hurlburt, M., & Horwitz, S. M. (2011). Advancing a conceptual model of evidence-based practice implementation in public service sectors. Administration and Policy In Mental Health, 38(1), 4–23. doi:10.1007/s10488-010-0327-7.
Bollen, K. A., & Curran, P. J. (2004). Autoregressive latent trajectory (ALT) models a synthesis of two traditions. Sociological Methods & Research, 32(3), 336–383. doi:10.1177/0049124103260222.
Chaffin, M., Bard, D., Bigfoot, D. S., & Maher, E. J. (2012a). Is a structured, manualized, evidence-based treatment protocol culturally competent and equivalently effective among American Indian parents in child welfare? Child Maltreatment, 17(3), 242–252. doi:10.1177/1077559512457239.
Chaffin, M., Hecht, D., Bard, D., Silovsky, J. F., & Beasley, W. H. (2012b). A statewide trial of the SafeCare home-based services model with parents in Child Protective Services. Pediatrics, 129(3), 509–515. doi:10.1542/peds.2011-1840.
Chamberlain, P., Price, J., Reid, J., & Landsverk, J. (2008). Cascading implementation of a foster and kinship parent intervention. Child Welfare, 87(5), 27–48.
Dumka, L., Lopez, V., & Carter, S. (2002). Parenting interventions adapted for Latino families: Progress and prospects. In J. Contreras, K. Kerns, & A. Neal-Barnett (Eds.), Latino children and families in the United States: Current research and future directions (pp. 203–233). Westport, CT: Praeger.
Edwards, A., & Lutzker, J. R. (2008). Iterations of the SafeCare model: An evidence-based child maltreatment prevention program. Behavior Modification, 32(5), 736–756. doi:10.1177/0145445508317137.
Finno-Velasquez, M., Fettes, D., Aarons, G. A., & Hurlburt, M. S. (2014). Cultural adaptation of an evidence-based home visitation program: Latino clients’ experiences of service delivery during implementation. Journal of Children’s Services, 9, 280–294.
Funderburk, B., Chaffin, M., Bard, E., Shanley, J., Bard, D., & Berliner, L. (2014). Comparing client outcomes for two evidence-based treatment consultation strategies. Journal of Clinical Child and Adolescent Psychology. doi:10.1080/15374416.2014.910790.
Garland, A. F., Hawley, K. M., Brookman-Frazee, L., & Hurlburt, M. S. (2008). Identifying common elements of evidence-based psychosocial treatments for children’s disruptive behavior problems. Journal of the American Academy of Child and Adolescent Psychiatry, 47(5), 505–514. doi:10.1097/CHI.0b013e31816765c2.
Horwitz, S. M., Hurlburt, M. S., Goldhaber-Fiebert, J. D., Heneghan, A. M., Zhang, J., Rolls-Reutz, J., et al. (2012). Mental health services use by children investigated by child welfare agencies. Pediatrics, 130(5), 861–869. doi:10.1542/peds.2012-1330.
Hurlburt, M., Aarons, G. A., Fettes, D., Willging, C., Gunderson, L., & Chaffin, M. J. (2014). Interagency Collaborative Team model for capacity building to scale-up evidence-based practice. Children and Youth Services Review, 39, 160–168. doi:10.1016/J.Childyouth2013.10.005.
LeBeau, R. T., Davies, C. D., Culver, N. C., & Craske, M. G. (2013). Homework compliance in cognitive-behavioral therapy. Cognitive Behaviour Therapy, 42, 171–179.
Love, S. M., Koob, J. J., & Hill, L. E. (2007). Meeting the challenges of evidence-based practice: Can mental health therapists evaluate their practice? Brief Treatment and Crisis Intervention, 7(3), 184–193.
Martinez, R. G., Lewis, C. C., & Weiner, B. J. (2014). Instrumentation issues in implementation science. Implementation Science, 9(1), 118. doi:10.1186/s13012-014-0118-8.
Mowbray, C. T., Holter, M. C., Bybee, T., & Bybee, D. (2003). Fidelity criteria: Development, measurement and validation. American Journal of Evaluation, 24, 315–340.
Muthen, L. K., & Muthen, B. O. (2012). MPlus user’s guide. Los Angeles: Muthen & Muthen.
Schoenwald, S. K., Henggeler, S. W., Brondino, M. J., & Rowland, M. D. (2000). Multisystemic therapy: Monitoring treatment fidelity. Family Process, 39(1), 83–103.
Switzer, G., Scholle, S., Johnson, B., & Kelleher, K. (1998). The Client Cultural Competency Inventory: An instrument for assessing cultural competence in behavioral managed care organizations. Journal of Child and Family Studies, 7(4), 483–491.
Torrey, W. C., & Drake, R. E. (2011). An overview of evidence-based mental health. Canadian Journal of Psychiatry, 56(9), 511–513.
Whitaker, D. J., Ryan, K. A., Wild, R. C., Self-Brown, S., Lutzker, J. R., Shanley, J. R., et al. (2012). Initial implementation indicators from a statewide rollout of SafeCare within a child welfare system. Child Maltreatment, 17(1), 96–101. doi:10.1177/1077559511430722.
Willging, C. E., Green, A. E., Gunderson, L., Chaffin, M., & Aarons, G. A. (2014). From a “perfect storm” to “smooth sailing”: Policymaker perspectives on implementation and sustainment of an evidence-based practice in two states. Child Maltreatment. doi:10.1177/1077559514547384.
Acknowledgments
This study was supported by Grant R18CE001334 from the U.S. Centers for Disease Control and Prevention (CDC) to the University of Oklahoma Health Sciences Center, with Mark Chaffin as PI. Support for the SafeCare implementation initiative was provided by the United Way of San Diego. The contents of this report are solely the responsibility of the authors and do not necessarily represent the views of the CDC or any other supporting organizations or individuals. The authors wish to recognize the support and contributions of the community-based organizations providing San Diego County Community Services for Families. We also wish to recognize the contributions of San Diego County Child Welfare Services, United Way of San Diego, and the National SafeCare Training and Research Center. Additional thanks go out to Roseann Myers, Mary Harris, Richele Swagler, Charles Wilson, Clorinda Merino, Steve Ross, Tia McGill, Courtney Jones, John Lutzker, Dan Whitaker, Jane Silovsky, Darden White, Anna Edwards-Gaura, Jennifer Perrot, Amanda Zimmerman, John Landsverk, and David Bard. A version of this paper was presented at the 22nd NIMH Conference on Mental Health Services Research, April 2, 2014.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Chaffin, M., Hecht, D., Aarons, G. et al. EBT Fidelity Trajectories Across Training Cohorts Using the Interagency Collaborative Team Strategy. Adm Policy Ment Health 43, 144–156 (2016). https://doi.org/10.1007/s10488-015-0627-z
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10488-015-0627-z