Skip to main content
Top
Gepubliceerd in: Journal of Child and Family Studies 6/2012

01-12-2012 | Original Paper

Description of a Fidelity Implementation System: An Example from a Community-Based Children’s Mental Health Program

Auteurs: Krista Kutash, Brittany Cross, Anthony Madias, Albert J. Duchnowski, Amy L. Green

Gepubliceerd in: Journal of Child and Family Studies | Uitgave 6/2012

Log in om toegang te krijgen
share
DELEN

Deel dit onderdeel of sectie (kopieer de link)

  • Optie A:
    Klik op de rechtermuisknop op de link en selecteer de optie “linkadres kopiëren”
  • Optie B:
    Deel de link per e-mail

Abstract

Public policy initiatives to deliver evidence-based practices in community settings have increased the need to develop implementation feedback systems to assist program administrators adopting the practices as well as researchers who wish to continue the line of research. This paper contributes to the efforts to reduce the implementation gap in the children’s mental health services field by exploring the concept of fidelity and highlights its importance to the adoption of evidence-based practices. Fidelity, or the degree to which interventions are implemented as originally designed, is generally conceptualized as a system of five unique and interrelated components including adherence, dosage, participant responsiveness, quality of delivery, and program differentiation. Definitions and a critical analysis of each of the component’s strengths and weaknesses are offered while discussing the integrated nature of each component. An example of the development and use of the five components of fidelity within a community-based evidence-based program is described.
Literatuur
go back to reference Abbott, R. D., O’Donnell, J., Hawkins, D., Hill, K. G., Kosterman, R., & Catalano, R. F. (1998). Changing teaching practices to promote achievement and bonding to school. American Journal of Orthopsychiatry, 68, 542–552.PubMedCrossRef Abbott, R. D., O’Donnell, J., Hawkins, D., Hill, K. G., Kosterman, R., & Catalano, R. F. (1998). Changing teaching practices to promote achievement and bonding to school. American Journal of Orthopsychiatry, 68, 542–552.PubMedCrossRef
go back to reference Barat, I., Andreasen, F., & Damsgaard, E. M. S. (2001). Drug therapy in the elderly: What doctors believe and patients actually do. British Journal of Clinical Pharmacology, 51, 615–622.PubMedCrossRef Barat, I., Andreasen, F., & Damsgaard, E. M. S. (2001). Drug therapy in the elderly: What doctors believe and patients actually do. British Journal of Clinical Pharmacology, 51, 615–622.PubMedCrossRef
go back to reference Barkham, M., Connell, J., Stiles, W., Miles, J., Margison, F., Evans, C., et al. (2006). Dose-effect relations and responsive regulation of treatment duration: The good enough level. Journal of Consulting and Clinical Psychology, 74(1), 160–167.PubMedCrossRef Barkham, M., Connell, J., Stiles, W., Miles, J., Margison, F., Evans, C., et al. (2006). Dose-effect relations and responsive regulation of treatment duration: The good enough level. Journal of Consulting and Clinical Psychology, 74(1), 160–167.PubMedCrossRef
go back to reference Bernfield, G. A., Farrington, D. P., & Leschied, A. W. (2001). Offender rehabilitation in practice; Implementation and evaluation effective programs. New York: Wiley. Bernfield, G. A., Farrington, D. P., & Leschied, A. W. (2001). Offender rehabilitation in practice; Implementation and evaluation effective programs. New York: Wiley.
go back to reference Bickman, L., Andrade, A. R., & Lambert, E. W. (2002). Dose response in child and adolescent mental health services. Mental Health Services Research, 4(2), 57–70.PubMedCrossRef Bickman, L., Andrade, A. R., & Lambert, E. W. (2002). Dose response in child and adolescent mental health services. Mental Health Services Research, 4(2), 57–70.PubMedCrossRef
go back to reference Botvin, G. J., Baker, E., Dusenbemy, L., Tortu, S., & Botvin, E. M. (1990). Preventing adolescent drug abuse through a multimodal cognitive behavioral approach: Results of a 3 year study. Journal of Consulting and Clinical Psychology, 5(8), 437–446.CrossRef Botvin, G. J., Baker, E., Dusenbemy, L., Tortu, S., & Botvin, E. M. (1990). Preventing adolescent drug abuse through a multimodal cognitive behavioral approach: Results of a 3 year study. Journal of Consulting and Clinical Psychology, 5(8), 437–446.CrossRef
go back to reference Botvin, G. J., Dusenberry, L., Baker, E., James-Ortiz, S., & Rerner, J. (1989). A skills training approach to smoking prevention among Hispanic youth. Journal of Behavioral Medicine, 12, 279–296.PubMedCrossRef Botvin, G. J., Dusenberry, L., Baker, E., James-Ortiz, S., & Rerner, J. (1989). A skills training approach to smoking prevention among Hispanic youth. Journal of Behavioral Medicine, 12, 279–296.PubMedCrossRef
go back to reference Brandon, P. R., Taum, A. K. H., Young, D. B., Pottenger, P. M., I. I. I., & Speitel, T. W. (2008). The complexity of measuring the quality of program implementation with observations. The American Journal of Evaluation, 29(3), 235–250.CrossRef Brandon, P. R., Taum, A. K. H., Young, D. B., Pottenger, P. M., I. I. I., & Speitel, T. W. (2008). The complexity of measuring the quality of program implementation with observations. The American Journal of Evaluation, 29(3), 235–250.CrossRef
go back to reference Burns, N., & Grove, S. K. (2005). The practice of nursing research: Conduct, critique, and utilization (5th ed.). St. Louis, MO: Elsevier Saunders. Burns, N., & Grove, S. K. (2005). The practice of nursing research: Conduct, critique, and utilization (5th ed.). St. Louis, MO: Elsevier Saunders.
go back to reference Dane, A., & Schneider, B. (1998). Program integrity in primary and early secondary prevention: Are implementation effects out of control? Clinical Psychology Review, 18, 23–24.PubMedCrossRef Dane, A., & Schneider, B. (1998). Program integrity in primary and early secondary prevention: Are implementation effects out of control? Clinical Psychology Review, 18, 23–24.PubMedCrossRef
go back to reference Domitrovich, C. E., & Greenberg, M. T. (2000). The study of implementation: Current findings from effective programs that prevent mental disorders in school-aged children. Journal of Educational and Psychological Consultation, 11(2), 193–221.CrossRef Domitrovich, C. E., & Greenberg, M. T. (2000). The study of implementation: Current findings from effective programs that prevent mental disorders in school-aged children. Journal of Educational and Psychological Consultation, 11(2), 193–221.CrossRef
go back to reference Durlak, J. A. (1998). Why program implementation is important. Journal of Prevention and Intervention in the Community, 17, 5–18.CrossRef Durlak, J. A. (1998). Why program implementation is important. Journal of Prevention and Intervention in the Community, 17, 5–18.CrossRef
go back to reference Dusenbury, L., Brannigan, R., Falco, M., & Hansen, W. B. (2003). A review of research on fidelity of implementation: Implications for drug abuse prevention in school settings. Health Education Research, 18(2), 237–256.PubMedCrossRef Dusenbury, L., Brannigan, R., Falco, M., & Hansen, W. B. (2003). A review of research on fidelity of implementation: Implications for drug abuse prevention in school settings. Health Education Research, 18(2), 237–256.PubMedCrossRef
go back to reference Fixsen, D. L, Naoom, S. F., Blase, K. A., Friedman, R. M., & Wallace, F. (2005). Implementation research: A synthesis of the literature. Tampa, FL: University of South Florida, Louis de la Parte Florida Mental Health Institute, The National Implementation Research Network (FMHI Publication #231). Fixsen, D. L, Naoom, S. F., Blase, K. A., Friedman, R. M., & Wallace, F. (2005). Implementation research: A synthesis of the literature. Tampa, FL: University of South Florida, Louis de la Parte Florida Mental Health Institute, The National Implementation Research Network (FMHI Publication #231).
go back to reference Glisson, C., & Schoenwald, S. K. (2005). The ARC organizational and community intervention strategy for implementing evidence-based children’s mental health treatments. Mental Health Services Research, 7(4), 243–259.PubMedCrossRef Glisson, C., & Schoenwald, S. K. (2005). The ARC organizational and community intervention strategy for implementing evidence-based children’s mental health treatments. Mental Health Services Research, 7(4), 243–259.PubMedCrossRef
go back to reference Gonzales, J. J., Ringeisen, H. L., & Chambers, D. A. (2002). The tangled and thorny path of science to practice: Tensions in interpreting and applying “evidence”. Clinical Psychology: Science and Practice, 9, 204–209.CrossRef Gonzales, J. J., Ringeisen, H. L., & Chambers, D. A. (2002). The tangled and thorny path of science to practice: Tensions in interpreting and applying “evidence”. Clinical Psychology: Science and Practice, 9, 204–209.CrossRef
go back to reference Greenberg, M. T., Domitrovich, C., & Bumbarger, B. (1999). Preventing mental disorder in school-aged children: A review of the effectiveness of prevention programs. Report submitted to The Center for Mental Health Services (SAMHSA), Prevention Research Center, Pennsylvania State University (obtainable at http://www.psu.edu/dept/prevention/). Greenberg, M. T., Domitrovich, C., & Bumbarger, B. (1999). Preventing mental disorder in school-aged children: A review of the effectiveness of prevention programs. Report submitted to The Center for Mental Health Services (SAMHSA), Prevention Research Center, Pennsylvania State University (obtainable at http://​www.​psu.​edu/​dept/​prevention/​).
go back to reference Hansen, W. B., Graham, J. W., Wolkenstein, B. H., & Rohrbach, L. A. (1991). Program integrity as a moderator of prevention program effectiveness: Results for fifth-grade students in the Adolescent Alcohol Prevention Trial. Journal of Studies on Alcohol, 52, 568–579.PubMed Hansen, W. B., Graham, J. W., Wolkenstein, B. H., & Rohrbach, L. A. (1991). Program integrity as a moderator of prevention program effectiveness: Results for fifth-grade students in the Adolescent Alcohol Prevention Trial. Journal of Studies on Alcohol, 52, 568–579.PubMed
go back to reference Hansen, W. B., & McNeil, R. B. (1999). Drug education practice: Results of an observational study. Health Education Research, 14(1), 85–97.PubMedCrossRef Hansen, W. B., & McNeil, R. B. (1999). Drug education practice: Results of an observational study. Health Education Research, 14(1), 85–97.PubMedCrossRef
go back to reference Harachi, T. W., Abbott, R. D., Catalano, R. F., Haggerty, K. P., & Fleming, C. B. (1999). Opening the black box: Using process evaluation measures to assess implementation and theory building. American Journal of Community Psychology, 27, 711–731.PubMedCrossRef Harachi, T. W., Abbott, R. D., Catalano, R. F., Haggerty, K. P., & Fleming, C. B. (1999). Opening the black box: Using process evaluation measures to assess implementation and theory building. American Journal of Community Psychology, 27, 711–731.PubMedCrossRef
go back to reference Henggeler, S. W., Schoenwald, S. K., Rowland, M. D., & Cunningham, P. B. (2002). Serious emotional disturbance in children and adolescents: Multisystemic therapy. New York: Guilford Press. http://www.guilford.com. Henggeler, S. W., Schoenwald, S. K., Rowland, M. D., & Cunningham, P. B. (2002). Serious emotional disturbance in children and adolescents: Multisystemic therapy. New York: Guilford Press. http://​www.​guilford.​com.
go back to reference Hoagwood, K., Cavaleri, M., Olin, S., Burns, B., Slaton, E., Gruttadaro, D., et al. (2010). Family support in children’s mental health: A review and synthesis. Clinical Child and Family Psychology Review, 13(1), 1–45.PubMedCrossRef Hoagwood, K., Cavaleri, M., Olin, S., Burns, B., Slaton, E., Gruttadaro, D., et al. (2010). Family support in children’s mental health: A review and synthesis. Clinical Child and Family Psychology Review, 13(1), 1–45.PubMedCrossRef
go back to reference Hogue, A., Liddle, H. A., Singer, A., & Leckrone, J. (2005). Intervention fidelity in family-based prevention counseling for adolescent problem behaviors. Journal of Community Psychology, 33(2), 191–211.CrossRef Hogue, A., Liddle, H. A., Singer, A., & Leckrone, J. (2005). Intervention fidelity in family-based prevention counseling for adolescent problem behaviors. Journal of Community Psychology, 33(2), 191–211.CrossRef
go back to reference Hulleman, C., & Cordray, D. (2009). Moving from the lab to the field: The role of fidelity and achieved relative intervention strength. Journal of Research on Educational Effectiveness, 2, 88–110.CrossRef Hulleman, C., & Cordray, D. (2009). Moving from the lab to the field: The role of fidelity and achieved relative intervention strength. Journal of Research on Educational Effectiveness, 2, 88–110.CrossRef
go back to reference Institute of Medicine. (2001). Crossing the quality chasm: A new health system for the 21st Century. Washington, DC: National Academy Press. Institute of Medicine. (2001). Crossing the quality chasm: A new health system for the 21st Century. Washington, DC: National Academy Press.
go back to reference Kessler, R. C., Chiu, W. T., Demler, O., & Walters, E. E. (2005). Prevalence, severity, and comorbidity of 12-month DSM-IV disorders in the national comorbidity survey replication. Archives of General Psychiatry, 62, 617–627.PubMedCrossRef Kessler, R. C., Chiu, W. T., Demler, O., & Walters, E. E. (2005). Prevalence, severity, and comorbidity of 12-month DSM-IV disorders in the national comorbidity survey replication. Archives of General Psychiatry, 62, 617–627.PubMedCrossRef
go back to reference Kutash, K., Duchnowski, A. J., Green, A., & Ferron, J. M. (2011). Supporting parents who have youth with emotional disturbances through a parent-to-parent support program: A proof of concept study using random assignment. Administration and Policy in Mental Health and Mental Health Services Research, 38(5), 412–427. doi:10.1007/s10488-010-0329-5.PubMedCrossRef Kutash, K., Duchnowski, A. J., Green, A., & Ferron, J. M. (2011). Supporting parents who have youth with emotional disturbances through a parent-to-parent support program: A proof of concept study using random assignment. Administration and Policy in Mental Health and Mental Health Services Research, 38(5), 412–427. doi:10.​1007/​s10488-010-0329-5.PubMedCrossRef
go back to reference Landsverk, J., Brown, H., Aarons, G. A., Chamberlain, P., Gibbons, R., Horwitz, S. M., et al. (2010). Study design issues in implementation research: Application to child welfare settings. Administration and Policy in Mental Health and Mental Health Services Research, 38, 44–63. Landsverk, J., Brown, H., Aarons, G. A., Chamberlain, P., Gibbons, R., Horwitz, S. M., et al. (2010). Study design issues in implementation research: Application to child welfare settings. Administration and Policy in Mental Health and Mental Health Services Research, 38, 44–63.
go back to reference Lutz, W., Saunders, S. M., Leon, S. C., Martinovich, Z., Kosfelder, J., Schulte, D., et al. (2006). Empirically and clinically useful decision making in psychotherapy: Differential predictions with treatment response models. Psychological Assessment, 18(2), 133–141.PubMedCrossRef Lutz, W., Saunders, S. M., Leon, S. C., Martinovich, Z., Kosfelder, J., Schulte, D., et al. (2006). Empirically and clinically useful decision making in psychotherapy: Differential predictions with treatment response models. Psychological Assessment, 18(2), 133–141.PubMedCrossRef
go back to reference Lynch, S., & O’Donnell, C. (2005). The evolving definition, measurement, and conceptualization of fidelity of implementation in scale-up of highly rated science curriculum units in diverse middle schools. Paper presented at the meeting of the American Educational Research Association, Montreal, Canada. Lynch, S., & O’Donnell, C. (2005). The evolving definition, measurement, and conceptualization of fidelity of implementation in scale-up of highly rated science curriculum units in diverse middle schools. Paper presented at the meeting of the American Educational Research Association, Montreal, Canada.
go back to reference Maidment, R., Livingston, G., & Katona, C. (2003). “Just keep taking the tablets”: Adherence to antidepressant treatment in older people in primary care. International Journal of Geriatric Psychiatry, 17, 752–757.CrossRef Maidment, R., Livingston, G., & Katona, C. (2003). “Just keep taking the tablets”: Adherence to antidepressant treatment in older people in primary care. International Journal of Geriatric Psychiatry, 17, 752–757.CrossRef
go back to reference McBride, N., Farringdon, F., & Midford, R. (2002). Implementing a school drug education programme: Reflections on fidelity. International Journal of Health Promotion Education, 40, 40–50. McBride, N., Farringdon, F., & Midford, R. (2002). Implementing a school drug education programme: Reflections on fidelity. International Journal of Health Promotion Education, 40, 40–50.
go back to reference O’Donnell, C. L. (2008). Defining, conceptualizing, and measuring fidelity of implementation and its relationship to outcomes in k-12 curriculum intervention research. Review of Educational Research, 78(1), 33–84.CrossRef O’Donnell, C. L. (2008). Defining, conceptualizing, and measuring fidelity of implementation and its relationship to outcomes in k-12 curriculum intervention research. Review of Educational Research, 78(1), 33–84.CrossRef
go back to reference Proctor, E. K., & Landsverk, J. (2005). Challenges of translating evidence-based treatments into practice contexts and service sectors. Paper presented at the Mental Health Services Research Conference, Washington, DC. Proctor, E. K., & Landsverk, J. (2005). Challenges of translating evidence-based treatments into practice contexts and service sectors. Paper presented at the Mental Health Services Research Conference, Washington, DC.
go back to reference Proctor, E. K., Landsverk, J., Aarons, G. A., Chambers, D., Glisson, C., & Mittman, C. (2009). Implementation research in mental health services: An emerging science with conceptual, methodological, and training challenges. Administration and Policy in Mental Health and Mental Health Services, 36, 24–34.CrossRef Proctor, E. K., Landsverk, J., Aarons, G. A., Chambers, D., Glisson, C., & Mittman, C. (2009). Implementation research in mental health services: An emerging science with conceptual, methodological, and training challenges. Administration and Policy in Mental Health and Mental Health Services, 36, 24–34.CrossRef
go back to reference Resnick, B., Bellg, A. J., Borrelli, B., DeFrancesco, C., Breger, R., & Hecht, J. (2005). Examples of implementation and evaluation of treatment fidelity in the BCC studies: Where we are and where we need to go. Annals of Behavioral Medicine, 29, 46–54.PubMedCrossRef Resnick, B., Bellg, A. J., Borrelli, B., DeFrancesco, C., Breger, R., & Hecht, J. (2005). Examples of implementation and evaluation of treatment fidelity in the BCC studies: Where we are and where we need to go. Annals of Behavioral Medicine, 29, 46–54.PubMedCrossRef
go back to reference Rohrbach, L. A., Grana, R., Sussman, S., & Valente, T. W. (2006). Type II translation: Transporting prevention interventions from research to real-world settings. Evaluation and the Health Professions, 29, 302–333.CrossRef Rohrbach, L. A., Grana, R., Sussman, S., & Valente, T. W. (2006). Type II translation: Transporting prevention interventions from research to real-world settings. Evaluation and the Health Professions, 29, 302–333.CrossRef
go back to reference Sanchez, V., Steckler, A., Nitirat, P., Hallfors, D., Cho, H., & Brodish, P. (2007). Fidelity of implementation in a treatment effectiveness trial of Reconnecting Youth. Health Education Research, 22, 95–107. doi:10.1093/her/cyl052.PubMedCrossRef Sanchez, V., Steckler, A., Nitirat, P., Hallfors, D., Cho, H., & Brodish, P. (2007). Fidelity of implementation in a treatment effectiveness trial of Reconnecting Youth. Health Education Research, 22, 95–107. doi:10.​1093/​her/​cyl052.PubMedCrossRef
go back to reference Scanlon, J. W., Horst, P., Nay, J. W., Schmidt, R. E., & Waller, J. D. (1977). Evaluability assessment: Avoiding type III or IV errors. In G. R. Gilbert & P. J. Conklin (Eds.), Evaluation management: A source book of readings. Charlottesville: U.S. Civil Service Commission. Scanlon, J. W., Horst, P., Nay, J. W., Schmidt, R. E., & Waller, J. D. (1977). Evaluability assessment: Avoiding type III or IV errors. In G. R. Gilbert & P. J. Conklin (Eds.), Evaluation management: A source book of readings. Charlottesville: U.S. Civil Service Commission.
go back to reference Schoenwald, S. K., Garland, A. F., Chapman, J. E., Frazier, S. L., Sheidow, A. L., & Southam-Gerow, M. A. (2011). Toward the effective and efficient measurement of implementation fidelity. Administration and Policy in Mental Health and Mental Health Services Research, 38, 32–43.PubMedCrossRef Schoenwald, S. K., Garland, A. F., Chapman, J. E., Frazier, S. L., Sheidow, A. L., & Southam-Gerow, M. A. (2011). Toward the effective and efficient measurement of implementation fidelity. Administration and Policy in Mental Health and Mental Health Services Research, 38, 32–43.PubMedCrossRef
go back to reference Schoenwald, S. K., Henggeler, S. W., Brondino, M. J., & Rowland, M. D. (2000). Multisystemic therapy: Monitoring treatment fidelity. Family Process, 39, 83–103.PubMedCrossRef Schoenwald, S. K., Henggeler, S. W., Brondino, M. J., & Rowland, M. D. (2000). Multisystemic therapy: Monitoring treatment fidelity. Family Process, 39, 83–103.PubMedCrossRef
go back to reference Schoenwald, S. K., & Hoagwood, K. (2001). Effectiveness, transportability, and dissemination of interventions: What matters when? Psychiatric Services, 52, 1190–1197.PubMedCrossRef Schoenwald, S. K., & Hoagwood, K. (2001). Effectiveness, transportability, and dissemination of interventions: What matters when? Psychiatric Services, 52, 1190–1197.PubMedCrossRef
go back to reference Schoenwald, S. K., Sheidow, A. J., & Letourneau, E. J. (2004). Toward effective quality assurance in evidence-based practice: Links between expert consultation, therapist fidelity, and child outcomes. Journal of Child and Adolescent Clinical Psychology, 33, 94–104.CrossRef Schoenwald, S. K., Sheidow, A. J., & Letourneau, E. J. (2004). Toward effective quality assurance in evidence-based practice: Links between expert consultation, therapist fidelity, and child outcomes. Journal of Child and Adolescent Clinical Psychology, 33, 94–104.CrossRef
go back to reference Schulte, A. C., Easton, J. E., & Parker, J. (2009). Advances in treatment integrity research: Multidisciplinary perspectives on the conceptualization, measurement, and enhancement of treatment integrity. School Psychology Review, 38(4), 460–475. Schulte, A. C., Easton, J. E., & Parker, J. (2009). Advances in treatment integrity research: Multidisciplinary perspectives on the conceptualization, measurement, and enhancement of treatment integrity. School Psychology Review, 38(4), 460–475.
go back to reference Waltz, J., Addis, M. E., Koerner, K., & Jacobson, N. E. (1993). Testing the integrity of a psychotherapy protocol: Assessment of adherence and competence. Journal of Consulting and Clinical Psychology, 61, 620–630.PubMedCrossRef Waltz, J., Addis, M. E., Koerner, K., & Jacobson, N. E. (1993). Testing the integrity of a psychotherapy protocol: Assessment of adherence and competence. Journal of Consulting and Clinical Psychology, 61, 620–630.PubMedCrossRef
Metagegevens
Titel
Description of a Fidelity Implementation System: An Example from a Community-Based Children’s Mental Health Program
Auteurs
Krista Kutash
Brittany Cross
Anthony Madias
Albert J. Duchnowski
Amy L. Green
Publicatiedatum
01-12-2012
Uitgeverij
Springer US
Gepubliceerd in
Journal of Child and Family Studies / Uitgave 6/2012
Print ISSN: 1062-1024
Elektronisch ISSN: 1573-2843
DOI
https://doi.org/10.1007/s10826-012-9565-5

Andere artikelen Uitgave 6/2012

Journal of Child and Family Studies 6/2012 Naar de uitgave