Skip to main content
Log in

Sustaining Fidelity Following the Nationwide PMTO™ Implementation in Norway

  • Published:
Prevention Science Aims and scope Submit manuscript

Abstract

This report describes three studies from the nationwide Norwegian implementation of Parent Management Training—Oregon Model (PMTO™), an empirically supported treatment for families of children with behavior problems (Forgatch and Patterson 2010). Separate stages of the implementation were evaluated using a fidelity measure based on direct observation of intervention sessions. Study 1 assessed growth in fidelity observed early, mid, and late in the training of a group of practitioners. We hypothesized increased fidelity and decreased variability in practice. Study 2 evaluated method fidelity over the course of three generations of practitioners trained in PMTO. Generation 1 (G1) was trained by the PMTO developer/purveyors; Generation 2 (G2) was trained by selected G1 Norwegian trainers; and Generation 3 (G3) was trained by G1 and G2 trainers. We hypothesized decrease in fidelity with each generation. Study 3 tested the predictive validity of fidelity in a cross-cultural replication, hypothesizing that higher fidelity scores would correlate with improved parenting practices observed in parent–child interactions before and after treatment. In Study 1, trainees’ performance improved and became more homogeneous as predicted. In Study 2, a small decline in fidelity followed the transfer from the purveyor trainers to Norwegian trainers in G2, but G3 scores were equivalent to those attained by G1. Thus, the hypothesis was not fully supported. Finally, the FIMP validity model replicated; PMTO fidelity significantly contributed to improvements in parenting practices from pre- to post-treatment. The data indicate that PMTO was transferred successfully to Norwegian implementation with sustained fidelity and cross-cultural generalization.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1

Similar content being viewed by others

References

  • Arthur, M. W., Hawkins, J. D., Pollard, J. A., Catalano, R. F., & Baglioni, A. J., Jr. (2002). Measuring risk and protective factors for substance use, delinquency, and other adolescent problem behaviors: The Communities That Care Youth Survey. Evaluation Review, 26, 575–601.

    PubMed  Google Scholar 

  • Bagner, D. M., & Eyberg, S. M. (2003). Father involvement in parent training: When does it matter? Journal of Clinical Child and Adolescent Psychology, 32, 599–605.

    Article  PubMed  Google Scholar 

  • Beauchaine, T. P., Webster-Stratton, C., & Reid, M. J. (2005). Mediators, moderators, and predictors of 1-year outcomes among children treated for early-onset conduct problems: A latent growth curve analysis. Journal of Consulting and Clinical Psychology, 73, 371–388.

    Article  PubMed  Google Scholar 

  • Bernal, G., Bonilla, J., & Bellido, J. (1995). Ecological validity and cultural sensitivity for outcome research: Issues for the cultural adaptation and development of psychosocial treatments with Hispanics. Journal of Abnormal Child Psychology, 23, 67–82.

    Article  PubMed  CAS  Google Scholar 

  • Björnsdóttir, A., & Simarsdóttir, M. (2009). Parent Management Training—The Oregon Model (PMTO™): Effect of a prevention and treatment program for behavioral problems among kindergarten and elementary school children in Hafnarfjördur. Icelandic Journal of Education, 18, 9–28.

    Google Scholar 

  • Brown, H. C., Wang, W., Kellam, S. G., Muthén, B. O., Petras, H., Toyinbo, P., et al. (2008). Methods for testing theory and evaluating impact in randomized field trials: Intent-to-treat analyses for integrating the perspectives of person, place, and time. Drug and Alcohol Dependence, 95, S74–S104.

    Article  PubMed  Google Scholar 

  • Bullard, L., Wachlarowicz, M., DeLeeuw, J., Snyder, J., Low, S., Forgatch, M. S., et al. (2010). Effects of the Oregon Model of Parent Management Training (PMTO) on marital adjustment in new stepfamilies: A randomized trial. Journal of Family Psychology, 24, 485–496.

    Article  PubMed  Google Scholar 

  • Chamberlain, P., Davis, B., Forgatch, M. S., Frey, S., Patterson, G. R., Ray, J. R., et al. (1986). The Therapy Process Code: An observational system. Eugene: Oregon Social Learning Center.

    Google Scholar 

  • Clarke, P. (2008). When can group level clustering be ignored? Multilevel models versus single-level models with sparse data. Journal of Epidemiological Community Health, 62, 752–758.

    Article  CAS  Google Scholar 

  • DeGarmo, D. S., & Forgatch, M. S. (2007). Efficacy of parent training for stepfathers: From playful spectator and polite stranger to effective stepfathering. Parenting: Science and Practice, 7, 1–25.

    Google Scholar 

  • DeGarmo, D. S., Patterson, G. R., & Forgatch, M. S. (2004). How do outcomes in a specified parent training intervention maintain or wane over time? Prevention Science, 5, 73–89.

    Article  PubMed  Google Scholar 

  • Domenech Rodríguez, M. M., Baumann, A. A., & Schwartz, A. L. (2011). Cultural adaptation of an evidence based intervention: From theory to practice in a Latino/a community context. American Journal of Community Psychology, 47, 170–186.

    Article  PubMed  Google Scholar 

  • Dumas, J. E., Lynch, A. M., Laughlin, J. E., Smith, E. P., & Prinz, R. J. (2001). Promoting intervention fidelity: Conceptual issues, methods, and preliminary results from the EARLY ALLIANCE prevention trial. American Journal of Preventive Medicine, 20, 38–47.

    Article  PubMed  CAS  Google Scholar 

  • Eames, C. (2008). The Leader Observation Tool: A process skills treatment fidelity measure for the Incredible Years parenting programme. Child Care, Health and Development, 34, 391–400.

    Article  PubMed  CAS  Google Scholar 

  • Eddy, J. M., & Chamberlain, P. (2000). Family management and deviant peer association as mediators of the impact of treatment condition on youth antisocial behavior. Journal of Consulting and Clinical Psychology, 68, 857–863.

    Article  PubMed  CAS  Google Scholar 

  • Fixsen, D. L., Naoom, S. F., Blase, K. A., Friedman, R. M., & Wallace, F. (2005). Implementation research: A synthesis of the literature. Tampa: University of South Florida, Louis de la Parte Florida Mental Health Institute, National Implementation Research Network.

    Google Scholar 

  • Fixsen, D. L., Naoom, S. F., Blase, K. A., & Wallace, F. (2007). Implementation: The missing link between research and practice. The APSAC Advisor, Winter/Spring, 4–11.

  • Follette, W. C., & Beitz, K. (2003). Adding a more rigorous scientific agenda to the empirically supported treatment movement. Behavior Modification, 27, 369–386.

    Article  PubMed  Google Scholar 

  • Forgatch, M. S., Principal Investigator. (2002–2007). Implementing parent management training in Norway (Grant No. R0116097). NIDA NNPRI: Community Multi-Site Prevention Trials (CMPT). Eugene: Oregon Social Learning Center.

  • Forgatch, M. S., & DeGarmo, D. S. (1999). Parenting through change: An effective prevention program for single mothers. Journal of Consulting and Clinical Psychology, 67, 711–724.

    Article  PubMed  CAS  Google Scholar 

  • Forgatch, M. S., & Patterson, G. R. (2010). Parent management training—Oregon model: An intervention for antisocial behavior in children and adolescents. In J. R. Weisz & A. E. Kazdin (Eds.), Evidence-based psychotherapies for children and adolescents (2nd ed., pp. 159–178). New York: Guilford.

    Google Scholar 

  • Forgatch, M. S., Knutson, N. M., & Mayne, T. (1992). Coder impressions of ODS lab tasks. Eugene: Oregon Social Learning Center.

    Google Scholar 

  • Forgatch, M. S., DeGarmo, D. S., & Beldavs, Z. (2005a). An efficacious theory-based intervention for stepfamilies. Behavior Therapy, 36, 357–365.

    Article  PubMed  Google Scholar 

  • Forgatch, M. S., Patterson, G. R., & DeGarmo, D. S. (2005b). Evaluating fidelity: Predictive validity for a measure of competent adherence to the Oregon model of parent management training (PMTO). Behavior Therapy, 36, 3–13.

    Article  PubMed  Google Scholar 

  • Forgatch, M. S., Patterson, G. R., DeGarmo, D. S., & Beldavs, Z. G. (2009). Testing the Oregon delinquency model with nine-year follow-up of the Oregon Divorce Study. Development and Psychopathology, 21, 637–660.

    Article  PubMed  Google Scholar 

  • Glisson, C. (2007). Assessing and changing organizational culture and climate for effective services. Research on Social Work Practice, 17, 736–747.

    Article  Google Scholar 

  • Herschell, A. D., McNeil, C. B., & McNeil, D. W. (2004). Clinical child psychology’s progress in disseminating empirically supported treatments. Clinical Psychology: Science and Practice, 11, 267–288.

    Article  Google Scholar 

  • Hogue, A., Liddle, H. A., Singer, A., & Leckrone, J. (2005). Intervention fidelity in family-based prevention counseling for adolescent problem behaviors. Journal of Community Psychology, 33, 191–211.

    Article  Google Scholar 

  • Jeličić, H., Phelps, E., & Lerner, R. M. (2009). Use of missing data methods in longitudinal studies: The persistence of bad practices in developmental psychology. Developmental Psychobiology, 45, 1195–1199.

    Google Scholar 

  • Knutson, N. M., Forgatch, M. S., Rains, L. A., & Sigmarsdóttir, M. (2009). Fidelity of Implementation Rating System (FIMP): The manual for PMTO™ (Revised ed.). Eugene, OR: Implementation Sciences International, Inc.

    Google Scholar 

  • McHugh, R. K., & Barlow, D. H. (2010). The dissemination and implementation of evidence-based psychological treatments: A review of current efforts. American Psychologist, 65, 73–84.

    Article  PubMed  Google Scholar 

  • Muthén, L. K., & Muthén, B. O. (2010). MPlus: Statistical analysis with latent variables user’s guide (6th ed.). Los Angeles, CA: StatModel.

    Google Scholar 

  • Ogden, T., & Amlund-Hagen, K. (2008). Treatment effectiveness of parent management training in Norway: A randomized controlled trial of children with conduct problems. Journal of Consulting and Clinical Psychology, 76, 607–621.

    Article  PubMed  Google Scholar 

  • Ogden, T., Forgatch, M. S., Askeland, E., Patterson, G. R., & Bullock, B. M. (2005). Implementation of parent management training at the national level: The case of Norway. Journal of Social Work Practice, 19, 317–329.

    Article  Google Scholar 

  • Patterson, G. R., Reid, J. B., & Dishion, T. J. (1992). Antisocial boys (Vol. 4). Eugene, OR: Castalia.

    Google Scholar 

  • Perepletchikova, F., Treat, T. A., & Kazdin, A. E. (2007). Treatment integrity in psychotherapy research: Analysis of the studies and examination of the associated factors. Journal of Consulting and Clinical Psychology, 75, 829–841.

    Article  PubMed  Google Scholar 

  • Price, R. H. (2000, December). Mobilization, reinvention, and scaling up: Three core processes in knowledge exchange, adaptation, and implementation. Paper presented at the Inaugural World Conference, “The Promotion of Mental Health and Prevention of Mental and Behavioral Disorders,” Atlanta, GA.

  • Reid, J. B., Fleischman, M. J., Arthur, J., Toobert, D. J., Stern, S., & Patterson, G. R. (1979, December). Therapist performance observational system. Paper presented at the Association for the Advancement of Behavior Therapy, San Francisco.

  • Reid, J. B., Patterson, G. R., & Snyder, J. (2002). Antisocial behavior in children and adolescents: A developmental analysis and model for intervention. Washington, DC: American Psychological Association.

    Book  Google Scholar 

  • Rogers, E. M. (1995). Diffusion of innovations (4th ed.). New York: Free Press.

    Google Scholar 

  • Rohrbach, L. (2006). Type II translation: Transporting prevention interventions from research to real-world settings. Evaluation & the Health Professions, 29, 302–333.

    Article  Google Scholar 

  • Salas, E., & Cannon-Bowers, J. A. (2001). The science of training: A decade of progress. Annual Review of Psychology, 52, 471–499.

    Article  PubMed  CAS  Google Scholar 

  • Stevens, V., Bourdeaudhuij, I. D., & Oost, P. V. (2001). Anti-bullying interventions at school: Aspects of programme adaptation and critical issues for further programme development. Health Promotion International, 16, 155–167.

    Article  PubMed  CAS  Google Scholar 

  • Stoolmiller, M., & Bank, L. (1995). Autoregressive effects in structural equation models: We see some problems. In J. M. Gottman & G. Sackett (Eds.), The analysis of change (pp. 263–276). Hillsdale, NJ: Erlbaum.

    Google Scholar 

  • Stoolmiller, M., Duncan, T. E., Bank, L., & Patterson, G. R. (1993). Some problems and solutions in the study of change: Significant patterns of client resistance. Journal of Consulting and Clinical Psychology, 61, 920–928.

    Article  PubMed  CAS  Google Scholar 

  • Stubbs, J., Crosby, L., Forgatch, M. S., & Capaldi, D. M. (1998). Family and peer process code: A synthesis of three Oregon Social Learning Center behavior codes. (Training manual.) Available at www.oslc.org/resources/codemanuals/familypeerprocesscode.pdf.

  • Tremblay, R. E., Pagani-Kurtz, L., Mâsse, L. C., Vitaro, F., & Pihl, R. O. (1995). A bimodal preventive intervention for disruptive kindergarten boys: Its impact through mid-adolescence. Journal of Consulting and Clinical Psychology, 63, 560–568.

    Article  PubMed  CAS  Google Scholar 

  • Waller, G. (2009). Evidence-based treatment and therapist drift. Behaviour Research and Therapy, 47, 119–127.

    Article  PubMed  Google Scholar 

  • Waltz, J., Addis, M. E., Koerner, K., & Jacobson, N. S. (1993). Testing the integrity of a psychotherapy protocol: Assessment of adherence and competence. Journal of Consulting and Clinical Psychology, 61, 620–630.

    Article  PubMed  CAS  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Marion S. Forgatch.

Additional information

The project described was supported by Award Number R01DA 16097 from the Prevention Research Branch, NIDA, U.S. PHS; and Award Number P30 DA023920 from the Division of Epidemiology, Services and Prevention Research, Prevention Research Branch, NIDA, U.S. PHS. The content is solely the responsibility of the authors and does not necessarily represent the official views of NIDA.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Forgatch, M.S., DeGarmo, D.S. Sustaining Fidelity Following the Nationwide PMTO™ Implementation in Norway. Prev Sci 12, 235–246 (2011). https://doi.org/10.1007/s11121-011-0225-6

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11121-011-0225-6

Keywords

Navigation