Skip to main content
Log in

EBT Fidelity Trajectories Across Training Cohorts Using the Interagency Collaborative Team Strategy

  • Original Article
  • Published:
Administration and Policy in Mental Health and Mental Health Services Research Aims and scope Submit manuscript

Abstract

The Interdisciplinary Collaborative Team (ICT) strategy uses front-line providers as adaptation, training and quality control agents for multi-agency EBT implementation. This study tests whether an ICT transmits fidelity to subsequent provider cohorts. SafeCare was implemented by home visitors from multiple community-based agencies contracting with child welfare. Client-reported fidelity trajectories for 5,769 visits, 957 clients and 45 providers were compared using three-level growth models. Provider cohorts trained and live-coached by the ICT attained benchmark fidelity after 12 weeks, and this was sustained. Hispanic clients reported high cultural competency, supporting a cultural adaptation crafted by the ICT.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3

Similar content being viewed by others

References

  • Aarons, G. A., Fettes, D. L., Hurlburt, M. S., Palinkas, L. A., Gunderson, L., Willging, C. E., & Chaffin, M. J. (2014). Collaboration, negotiation, and coalescence for Interagency-Collaborative Teams to scale-up evidence-based practice. J Clin Child Adolesc Psychol. doi:10.1080/15374416.2013.876642.

    PubMed Central  PubMed  Google Scholar 

  • Aarons, G. A., Hurlburt, M., & Horwitz, S. M. (2011). Advancing a conceptual model of evidence-based practice implementation in public service sectors. Administration and Policy In Mental Health, 38(1), 4–23. doi:10.1007/s10488-010-0327-7.

    Article  PubMed Central  PubMed  Google Scholar 

  • Bollen, K. A., & Curran, P. J. (2004). Autoregressive latent trajectory (ALT) models a synthesis of two traditions. Sociological Methods & Research, 32(3), 336–383. doi:10.1177/0049124103260222.

    Article  Google Scholar 

  • Chaffin, M., Bard, D., Bigfoot, D. S., & Maher, E. J. (2012a). Is a structured, manualized, evidence-based treatment protocol culturally competent and equivalently effective among American Indian parents in child welfare? Child Maltreatment, 17(3), 242–252. doi:10.1177/1077559512457239.

    Article  PubMed Central  PubMed  Google Scholar 

  • Chaffin, M., Hecht, D., Bard, D., Silovsky, J. F., & Beasley, W. H. (2012b). A statewide trial of the SafeCare home-based services model with parents in Child Protective Services. Pediatrics, 129(3), 509–515. doi:10.1542/peds.2011-1840.

    Article  PubMed Central  PubMed  Google Scholar 

  • Chamberlain, P., Price, J., Reid, J., & Landsverk, J. (2008). Cascading implementation of a foster and kinship parent intervention. Child Welfare, 87(5), 27–48.

    PubMed Central  PubMed  Google Scholar 

  • Dumka, L., Lopez, V., & Carter, S. (2002). Parenting interventions adapted for Latino families: Progress and prospects. In J. Contreras, K. Kerns, & A. Neal-Barnett (Eds.), Latino children and families in the United States: Current research and future directions (pp. 203–233). Westport, CT: Praeger.

    Google Scholar 

  • Edwards, A., & Lutzker, J. R. (2008). Iterations of the SafeCare model: An evidence-based child maltreatment prevention program. Behavior Modification, 32(5), 736–756. doi:10.1177/0145445508317137.

    Article  PubMed  Google Scholar 

  • Finno-Velasquez, M., Fettes, D., Aarons, G. A., & Hurlburt, M. S. (2014). Cultural adaptation of an evidence-based home visitation program: Latino clients’ experiences of service delivery during implementation. Journal of Children’s Services, 9, 280–294.

    Article  Google Scholar 

  • Funderburk, B., Chaffin, M., Bard, E., Shanley, J., Bard, D., & Berliner, L. (2014). Comparing client outcomes for two evidence-based treatment consultation strategies. Journal of Clinical Child and Adolescent Psychology. doi:10.1080/15374416.2014.910790.

    PubMed  Google Scholar 

  • Garland, A. F., Hawley, K. M., Brookman-Frazee, L., & Hurlburt, M. S. (2008). Identifying common elements of evidence-based psychosocial treatments for children’s disruptive behavior problems. Journal of the American Academy of Child and Adolescent Psychiatry, 47(5), 505–514. doi:10.1097/CHI.0b013e31816765c2.

    Article  PubMed  Google Scholar 

  • Horwitz, S. M., Hurlburt, M. S., Goldhaber-Fiebert, J. D., Heneghan, A. M., Zhang, J., Rolls-Reutz, J., et al. (2012). Mental health services use by children investigated by child welfare agencies. Pediatrics, 130(5), 861–869. doi:10.1542/peds.2012-1330.

    Article  PubMed Central  PubMed  Google Scholar 

  • Hurlburt, M., Aarons, G. A., Fettes, D., Willging, C., Gunderson, L., & Chaffin, M. J. (2014). Interagency Collaborative Team model for capacity building to scale-up evidence-based practice. Children and Youth Services Review, 39, 160–168. doi:10.1016/J.Childyouth2013.10.005.

    Article  Google Scholar 

  • LeBeau, R. T., Davies, C. D., Culver, N. C., & Craske, M. G. (2013). Homework compliance in cognitive-behavioral therapy. Cognitive Behaviour Therapy, 42, 171–179.

  • Love, S. M., Koob, J. J., & Hill, L. E. (2007). Meeting the challenges of evidence-based practice: Can mental health therapists evaluate their practice? Brief Treatment and Crisis Intervention, 7(3), 184–193.

    Article  Google Scholar 

  • Martinez, R. G., Lewis, C. C., & Weiner, B. J. (2014). Instrumentation issues in implementation science. Implementation Science, 9(1), 118. doi:10.1186/s13012-014-0118-8.

    Article  PubMed Central  PubMed  Google Scholar 

  • Mowbray, C. T., Holter, M. C., Bybee, T., & Bybee, D. (2003). Fidelity criteria: Development, measurement and validation. American Journal of Evaluation, 24, 315–340.

    Article  Google Scholar 

  • Muthen, L. K., & Muthen, B. O. (2012). MPlus user’s guide. Los Angeles: Muthen & Muthen.

    Google Scholar 

  • Schoenwald, S. K., Henggeler, S. W., Brondino, M. J., & Rowland, M. D. (2000). Multisystemic therapy: Monitoring treatment fidelity. Family Process, 39(1), 83–103.

    Article  CAS  PubMed  Google Scholar 

  • Switzer, G., Scholle, S., Johnson, B., & Kelleher, K. (1998). The Client Cultural Competency Inventory: An instrument for assessing cultural competence in behavioral managed care organizations. Journal of Child and Family Studies, 7(4), 483–491.

    Article  Google Scholar 

  • Torrey, W. C., & Drake, R. E. (2011). An overview of evidence-based mental health. Canadian Journal of Psychiatry, 56(9), 511–513.

    PubMed  Google Scholar 

  • Whitaker, D. J., Ryan, K. A., Wild, R. C., Self-Brown, S., Lutzker, J. R., Shanley, J. R., et al. (2012). Initial implementation indicators from a statewide rollout of SafeCare within a child welfare system. Child Maltreatment, 17(1), 96–101. doi:10.1177/1077559511430722.

    Article  PubMed  Google Scholar 

  • Willging, C. E., Green, A. E., Gunderson, L., Chaffin, M., & Aarons, G. A. (2014). From a “perfect storm” to “smooth sailing”: Policymaker perspectives on implementation and sustainment of an evidence-based practice in two states. Child Maltreatment. doi:10.1177/1077559514547384.

    PubMed Central  PubMed  Google Scholar 

Download references

Acknowledgments

This study was supported by Grant R18CE001334 from the U.S. Centers for Disease Control and Prevention (CDC) to the University of Oklahoma Health Sciences Center, with Mark Chaffin as PI. Support for the SafeCare implementation initiative was provided by the United Way of San Diego. The contents of this report are solely the responsibility of the authors and do not necessarily represent the views of the CDC or any other supporting organizations or individuals. The authors wish to recognize the support and contributions of the community-based organizations providing San Diego County Community Services for Families. We also wish to recognize the contributions of San Diego County Child Welfare Services, United Way of San Diego, and the National SafeCare Training and Research Center. Additional thanks go out to Roseann Myers, Mary Harris, Richele Swagler, Charles Wilson, Clorinda Merino, Steve Ross, Tia McGill, Courtney Jones, John Lutzker, Dan Whitaker, Jane Silovsky, Darden White, Anna Edwards-Gaura, Jennifer Perrot, Amanda Zimmerman, John Landsverk, and David Bard. A version of this paper was presented at the 22nd NIMH Conference on Mental Health Services Research, April 2, 2014.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Mark Chaffin.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Chaffin, M., Hecht, D., Aarons, G. et al. EBT Fidelity Trajectories Across Training Cohorts Using the Interagency Collaborative Team Strategy. Adm Policy Ment Health 43, 144–156 (2016). https://doi.org/10.1007/s10488-015-0627-z

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10488-015-0627-z

Keywords

Navigation