Skip to main content
SpringerLink
Log in

Development and Validation of Fidelity Monitoring and Enhancement in an Evidence-Based Parenting Program

  • Published:
The Journal of Behavioral Health Services & Research Aims and scope Submit manuscript

Abstract

This article adds to current research by examining treatment fidelity of an evidence-based parenting program (namely Triple P) as part of a large clinical trial which included a range of procedures for promoting fidelity including both expert and peer supervision. Procedures for monitoring and promoting fidelity are described, and two major aspects of fidelity, namely content adherence and process fidelity, were evaluated. All treatment sessions for 166 families participating in the Standard Triple P-Positive Parenting Program were video-recorded and then sampled for evaluation without advanced knowledge by delivery practitioners. Independent coders at an external site assessed content adherence and rated delivery process. Fidelity promotion included high-quality training of practitioners on a standardized protocol, ongoing clinical supervision by peers and supervisors, and fidelity feedback sessions. Average content fidelity was consistently high (i.e., over 80%). Process fidelity scores were similarly high across sessions. A brief survey indicated practitioners found that the fidelity and implementation model was useful and contributed to increasing self-efficacy over the course of the initiative.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

References

  1. Moncher, F.J. & Prinz, R.J. Treatment fidelity in outcome studies. Clinical Psychology Review. 1991;11:247-266.

    Article  Google Scholar 

  2. Garbacz, L.L., Brown, D.M., Spee, G.A., et al. Establishing treatment fidelity in evidence-based parent training programs for externalizing disorders in children and adolescents. Clinical Child & Family Psychology Review. 2014;17:230–247. doi: https://doi.org/10.1007/s10567-014-0166-2

    Article  Google Scholar 

  3. Dumas, J.E., Lynch, A.M., Laughlin, J.E., et al. Promoting intervention fidelity: Conceptual issues, methods, and preliminary results from the EARLY ALLIANCE prevention trial. American Journal of Preventive Medicine. 2001;20(1S):38-47.

    Article  CAS  Google Scholar 

  4. Perepletchikova, F. Treat, T.A. & Kazdin, A.E. Treatment integrity in psychotherapy research: analysis of the studies and examination of the associated factors. Journal of Consulting and Clinical Psychology. 2007;75:829-841. doi: https://doi.org/10.1037/0022-006X.75.6.829

    Article  PubMed  Google Scholar 

  5. Paivio, S. C., Holowaty, K. A. M., & Hall, I. E. The influence of therapist adherence and competence on client reprocessing of child abuse memories. Psychotherapy: Theory, Research, Practice, Training. 2004;41(1):56-68. doi: https://doi.org/10.1037/0033-3204.41.1.56

    Article  Google Scholar 

  6. Barber, J. P., Gallop, R., Crits-Cristoph, P. et al. The role of therapist adherence, therapist competence, and alliance in predicting outcome of individual drug counseling: results from the National Institute Drug Abuse Collaborative Cocaine Treatment Study. Psychotherapy Research. 2006;16:229-240. doi: https://doi.org/10.1080/10503300500288951

    Article  Google Scholar 

  7. Shaw, B. F., Elkin, I., Yamaguchi, J., et al. Therapist competence ratings in relation to clinical outcome in cognitive therapy of depression. Journal of Consulting and Clinical Psychology. 1999;67:837-846. doi: https://doi.org/10.1037/0022-006X.67.6.837

    Article  CAS  PubMed  Google Scholar 

  8. Borrelli, B., Sepinwall, D., Ernst, D., et al. A new tool to access treatment fidelity and evaluation of treatment fidelity across 10 years of health behavior research. Journal of Consulting and Clinical Psychology, 2005;72(5):852–860. doi:https://doi.org/10.1037/0022006X.73.5.852

    Article  Google Scholar 

  9. Hukkelberg, S. S., & Ogden, T. Working alliance and treatment fidelity as predictors of externalizing problem behaviors in parent management training. Journal of Consulting and Clinical Psychology. 2013;81(6):1010-1020. doi:https://doi.org/10.1037/a0033825

    Article  PubMed  Google Scholar 

  10. Thijssen, J., Albrecht, G., Muris, P., et al. Treatment fidelity during therapist initial training is related to subsequent effectiveness of parent management training—Oregon model. Journal of Child and Family Studies. 2017;26(7):1991-1999. doi:https://doi.org/10.1007/s10826-017-0706-8

    Article  PubMed  PubMed Central  Google Scholar 

  11. Webster-Stratton, C. H., Reid, M. J., & Marsenich, L. Improving therapist fidelity during implementation of evidence-based practices: incredible years program. Psychiatric Services. 2014;65(6):789-795. doi:https://doi.org/10.1176/appi.ps.201200177

    Article  PubMed  Google Scholar 

  12. Beidas, R.S. & Kendall, P.C. Training therapists in evidence-based practice: a critical review of studies from a systems-contextual perspective. Clinical Psychology. 2010;17:1-30. doi: https://doi.org/10.1111/j.1468-2850.2009.01187.x

    Article  PubMed  PubMed Central  Google Scholar 

  13. Herschell, A.D, Kolko, D.J., Baumann, B.L. et al. The role of therapist training in the implementation of psychosocial treatments: a review and critique with recommendations. Clinical Psychology Review. 2010;30:448-466. doi: https://doi.org/10.1016/j.cpr.2010.02.005

    Article  PubMed  PubMed Central  Google Scholar 

  14. Schoenwald, S.K., Scheidow, A.J., and Chapman, J.E. Clinical supervision in treatment transport: effects on adherence and outcomes. Journal of Consulting and Clinical Psychology. 2009;77:410-421. doi: https://doi.org/10.1037/a0013788

    Article  PubMed  PubMed Central  Google Scholar 

  15. Sanders, M. R., Kirby, J.N., Tellegen, C.L. et al. The Triple P-positive parenting program: a systematic review and meta-analysis of a multi-level system of parenting support. Clinical Psychology Review, 2014;34:337-357. doi: https://doi.org/10.1016/j.cpr.2014.04.003

    Article  PubMed  Google Scholar 

  16. Sanders, M. R., & Mazzucchelli, T. G. (Eds.) The power of positive parenting: transforming the lives of children, parents, and communities using the Triple P system. 2018. New York: Oxford University Press.

    Google Scholar 

  17. Sanders, M. R., & Murphy-Brennan, M. Creating conditions for success beyond the professional training environment. Clinical Psychology: Science and Practice. 2010;17:31-35.

    Google Scholar 

  18. McPherson, K.E., Sanders, M.R., Schroeter, B., et al. Acceptability and feasibility of peer assisted supervision and support for intervention practitioners: a Q-methodology evaluation. Journal of Child and Family Studies. 2016;25:720-732.

    Article  Google Scholar 

  19. Eyberg, S., & Pincus, D. (1999). Eyberg child behavior inventory and Sutter-Eyberg student behavior inventory-revised: professional manual. Odessa, FL: Psychological Assessment Resources.

    Google Scholar 

  20. Ralph, A. & Dittman, C.K. Training a workforce to implement evidence-based parenting programs. In M.R. Sanders & T.G. Mazzucchelli (Eds.) The power of positive parenting: transforming the lives of children, parents, and communities using the Triple P system (pp. 371-383). 2018; New York: Oxford University Press.

    Google Scholar 

  21. Sanders, M. R., Markie-Dadds, C. & Turner, K.M.T. Practitioner’s manual for standard Triple P. 2001. Australian Academic Press: Brisbane.

    Google Scholar 

  22. Kirby, J.N., & Sanders, M.R. Instruction manual for the adherence measures for the process quality in Standard Triple P. 2014, Parenting and Family Support Centre. The University of Queensland.

  23. Kirby, J.N., & Sanders, M.R. Practitioner survey for fidelity project for Standard Triple P. 2014, Parenting and Family Support Centre. The University of Queensland.

  24. Cortina, J. M. What is coefficient alpha? An examination of theory and applications. Journal of Applied Psychology. 1993;78:98.

    Article  Google Scholar 

  25. Shapiro, C.J., Prinz, R. J., & Sanders, M. R. Sustaining use of an evidence-based parenting intervention: practitioner perspectives. Journal of Child and Family Studies. 2014;24:1615-1624.

    Article  Google Scholar 

  26. Sanders, M. R., & Mazzucchelli, T. G. The promotion of self-regulation through parenting interventions. Clinical Child and Family Psychology Review. 2013;16:1-17.

    Article  Google Scholar 

Download references

Acknowledgments

Research reported in this publication was supported by the National Institute of Mental Health of the US National Institutes of Health under award number R01MH097699 (PI: Ronald Prinz). The content is solely the responsibility of the authors and does not necessarily represent the official views of the NIH.

Author information

Authors and Affiliations

  1. Parenting and Family Support Centre, School of Psychology, The University of Queensland, St Lucia, QLD, 4072, Australia

    Matthew R. Sanders PhD, Carmen S. Spry PhD, Cassandra L. Tellegen PhD & James N. Kirby PhD

  2. Oregon Research Institute, Eugene, OR, USA

    Carol M. Metzler PhD

  3. University of South Carolina, Columbia, SC, USA

    Ronald J. Prinz PhD

Authors
  1. Matthew R. Sanders PhD
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Carmen S. Spry PhD
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Cassandra L. Tellegen PhD
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. James N. Kirby PhD
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Carol M. Metzler PhD
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Ronald J. Prinz PhD
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Carmen S. Spry PhD.

Ethics declarations

Conflict of Interest

The Parenting and Family Support Centre is partly funded by royalties stemming from published resources of the Triple P—Positive Parenting Program, which is developed and owned by The University of Queensland (UQ). Royalties are also distributed to the Faculty of Health and Behavioral Sciences at UQ and contributory authors of published Triple P resources. Triple P International (TPI) Pty Ltd. is a private company licensed by Uniquest Pty Ltd. on behalf of UQ, to publish and disseminate Triple P worldwide. The authors of this report have no share or ownership of TPI. Matthew Sanders receives royalties and/or consultancy fees from TPI. James Kirby and Carmen Spry may in future receive royalties and/or consultancy fees from TPI. TPI had no involvement in the study design, collection, analysis or interpretation of data, or writing of this report. Matthew Sanders, Carmen Spry, James Kirby, and Cassandra Tellegen are employees at UQ. Ronald Prinz has been a consultant to TPI. Carol Metzler has no conflict of interest to declare.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Sanders, M.R., Spry, C.S., Tellegen, C.L. et al. Development and Validation of Fidelity Monitoring and Enhancement in an Evidence-Based Parenting Program. J Behav Health Serv Res 47, 569–580 (2020). https://doi.org/10.1007/s11414-020-09713-5

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11414-020-09713-5

Keywords

Search

Navigation