Skip to main content
Top

2023 | OriginalPaper | Hoofdstuk

22. Evaluatie van het proces van implementatie

Auteurs : Prof. dr. Marlies Hulscher, Prof. dr. Michel Wensing

Gepubliceerd in: Implementatie

Uitgeverij: Bohn Stafleu van Loghum

share
DELEN

Deel dit onderdeel of sectie (kopieer de link)

  • Optie A:
    Klik op de rechtermuisknop op de link en selecteer de optie “linkadres kopiëren”
  • Optie B:
    Deel de link per e-mail

Samenvatting

Naast uitkomsten van implementatiestrategieën zijn ook processen onderwerp van evaluatie. Procesevaluatie omvat allereerst een gedetailleerde beschrijving van de feitelijk gerealiseerde activiteiten en de blootstelling van de doelgroep aan deze activiteiten. Deze worden vergeleken met de de geplande implementatiestrategieën, die ten behoeve hiervan goed in kaart moeten worden gebracht. Daarnaast kunnen diverse thema’s aan bod komen in procesevaluatie, zoals contextfactoren, niet-verwachte uitkomsten, en ervaringen van deelnemers. De gegevensverzameling in procesevaluatie is vaak gebaseerd op vragenlijsten en interviews. De analyse is beschrijvend en soms (aanvullend) ook theoriegestuurd.
Literatuur
go back to reference Bellg AJ, Borrelli B, Resnick B, et al. Enhancing treatment fidelity in health behaviour change studies: best practices and recommendations from the NIH behaviour change consortium. Health Psych. 2004;23:443–51.CrossRef Bellg AJ, Borrelli B, Resnick B, et al. Enhancing treatment fidelity in health behaviour change studies: best practices and recommendations from the NIH behaviour change consortium. Health Psych. 2004;23:443–51.CrossRef
go back to reference Bonell C, Fletcher A, Morton M, et al. Realist randomized controlled trials: a new approach to evaluating complex public health interventions. Soc Sci Med. 2012;75:2299–306.CrossRef Bonell C, Fletcher A, Morton M, et al. Realist randomized controlled trials: a new approach to evaluating complex public health interventions. Soc Sci Med. 2012;75:2299–306.CrossRef
go back to reference Bryman A. Barriers to integrating quantitative and qualitative research. J Mixed Methods Res. 1998;1(1):8–22.CrossRef Bryman A. Barriers to integrating quantitative and qualitative research. J Mixed Methods Res. 1998;1(1):8–22.CrossRef
go back to reference Carroll C, Patterson M, Wood S, et al. A conceptual framework for implementation fidelity. BMC Implement Sci. 2007;2:40–8.CrossRef Carroll C, Patterson M, Wood S, et al. A conceptual framework for implementation fidelity. BMC Implement Sci. 2007;2:40–8.CrossRef
go back to reference Craig P, Dieppe P, Macintyre S, Michie S, Nazareth I, Petticrew M. Developing and evaluating complex interventions: the new medical research council guidance. BMJ. 2008;337:979–83. Craig P, Dieppe P, Macintyre S, Michie S, Nazareth I, Petticrew M. Developing and evaluating complex interventions: the new medical research council guidance. BMJ. 2008;337:979–83.
go back to reference Crocker-Buque T, Edelstein M, Mounier-Jack S. A process evaluation of how the routine vaccination programme is implemented at GP practices in England. Implem Sci. 2018;13:132.CrossRef Crocker-Buque T, Edelstein M, Mounier-Jack S. A process evaluation of how the routine vaccination programme is implemented at GP practices in England. Implem Sci. 2018;13:132.CrossRef
go back to reference Dane A, Schneider B. Program integrity in primary and early secondary prevention: are implementation effects out of control. Clin Psychol Rev. 1998;18:23–45.CrossRef Dane A, Schneider B. Program integrity in primary and early secondary prevention: are implementation effects out of control. Clin Psychol Rev. 1998;18:23–45.CrossRef
go back to reference De la Perrelle L, Cations M, Barbery G, Radisic G, Kaambwa B, Crotty M, Fitzgerald JA, Kurrle S, Cameron I, Whitehead C, Thompson J, Laver K. How, why and under what circumstances does a quality improvement collaborative build knowledge and skills in clinicians working with people with dementia? A realist informed process evaluation. BMJ Open Qual. 2021;10(2): e001147.CrossRef De la Perrelle L, Cations M, Barbery G, Radisic G, Kaambwa B, Crotty M, Fitzgerald JA, Kurrle S, Cameron I, Whitehead C, Thompson J, Laver K. How, why and under what circumstances does a quality improvement collaborative build knowledge and skills in clinicians working with people with dementia? A realist informed process evaluation. BMJ Open Qual. 2021;10(2): e001147.CrossRef
go back to reference Dixon-Woods M, Leslie M, Tarrant C, Bion J. Explaining matching Michigan: an ethnographic study of a patient safety program. Implem Sci. 2013;8:70.CrossRef Dixon-Woods M, Leslie M, Tarrant C, Bion J. Explaining matching Michigan: an ethnographic study of a patient safety program. Implem Sci. 2013;8:70.CrossRef
go back to reference Dusenbury L, Brannigan R, Falco M, Hansen WB. A review of research on fidelity of implementation: implications for drug abuse prevention in school settings. Health Educ Res. 2003;18:237–56.CrossRef Dusenbury L, Brannigan R, Falco M, Hansen WB. A review of research on fidelity of implementation: implications for drug abuse prevention in school settings. Health Educ Res. 2003;18:237–56.CrossRef
go back to reference Glidewell L, Hunter C, Ward V, McEachan RRC, Lawton R, Willis TA, Hartley S, Collinson M, Holland M, Farrin AJ, Foy R; ASPIRE programme team. Explaining variable effects of an adaptable implementation package to promote evidence-based practice in primary care: a longitudinal process evaluation. Implement Sci. 2022 27;17(1):9. Glidewell L, Hunter C, Ward V, McEachan RRC, Lawton R, Willis TA, Hartley S, Collinson M, Holland M, Farrin AJ, Foy R; ASPIRE programme team. Explaining variable effects of an adaptable implementation package to promote evidence-based practice in primary care: a longitudinal process evaluation. Implement Sci. 2022 27;17(1):9.
go back to reference Gotlib Conn L, McKenzie M, Pearsall EA, McLeod RS. Successful implementation of an enhanced recovery after surgery programme for elective colorectal surgery: a process evaluation of champions’ experiences. Implement Sci. 2015;10:99.CrossRef Gotlib Conn L, McKenzie M, Pearsall EA, McLeod RS. Successful implementation of an enhanced recovery after surgery programme for elective colorectal surgery: a process evaluation of champions’ experiences. Implement Sci. 2015;10:99.CrossRef
go back to reference Grant E, Treweek S, Dreischulte T, Foy R, Guthrie B. Process evaluations for cluster randomised trials of complex interventions: a proposed framework for design and reporting. Trials. 2013;14:15.CrossRef Grant E, Treweek S, Dreischulte T, Foy R, Guthrie B. Process evaluations for cluster randomised trials of complex interventions: a proposed framework for design and reporting. Trials. 2013;14:15.CrossRef
go back to reference Hulscher ME, Laurant MG, Grol RP. Process evaluation on quality improvement interventions. Qual Saf Health Care. 2003;12:40–6.CrossRef Hulscher ME, Laurant MG, Grol RP. Process evaluation on quality improvement interventions. Qual Saf Health Care. 2003;12:40–6.CrossRef
go back to reference Jäger C, Steinhäuser J, Freund T, Baker R, Agaral S, Godycki-Cwirko M, Kowalczyk A, Aakhus E, Granlund I, Van Lieshout J, Szecsenyi J, Wensing M. Process evaluation of five tailored programs to improve the implementation of evidence-based recommendations for chronic conditions in primary care. Implem Sci. 2016;11:123.CrossRef Jäger C, Steinhäuser J, Freund T, Baker R, Agaral S, Godycki-Cwirko M, Kowalczyk A, Aakhus E, Granlund I, Van Lieshout J, Szecsenyi J, Wensing M. Process evaluation of five tailored programs to improve the implementation of evidence-based recommendations for chronic conditions in primary care. Implem Sci. 2016;11:123.CrossRef
go back to reference Klaic M, Kapp S, Hudson P, Chapman W, Denehy L, Story D, Francis JJ. Implementability of healthcare interventions: an overview of reviews and development of a conceptual framework. Implement Sci. 2022;17(1):10.CrossRef Klaic M, Kapp S, Hudson P, Chapman W, Denehy L, Story D, Francis JJ. Implementability of healthcare interventions: an overview of reviews and development of a conceptual framework. Implement Sci. 2022;17(1):10.CrossRef
go back to reference May CR, Cummings A, Girling M, Bracher M, Mair FS, May CM, Murray E, Myall M, Rapley T, Finch T. Using normalization process theory in feasibility studies and process evaluations of complex healthcare interventions: a systematic review. Implement Sci. 2018;13(1):80.CrossRef May CR, Cummings A, Girling M, Bracher M, Mair FS, May CM, Murray E, Myall M, Rapley T, Finch T. Using normalization process theory in feasibility studies and process evaluations of complex healthcare interventions: a systematic review. Implement Sci. 2018;13(1):80.CrossRef
go back to reference May CR, Mair F, Finch T, MacFarlane A, Dowrick C, Treweek S, Rapley T, Ballini L, Ong BN, Rogers A, Murray E, Elwyn G, Légaré F, Gunn J, Montori VM. Development of a theory of implementation and integration: normalization Process Theory. Implem Sci. 2009;4:29.CrossRef May CR, Mair F, Finch T, MacFarlane A, Dowrick C, Treweek S, Rapley T, Ballini L, Ong BN, Rogers A, Murray E, Elwyn G, Légaré F, Gunn J, Montori VM. Development of a theory of implementation and integration: normalization Process Theory. Implem Sci. 2009;4:29.CrossRef
go back to reference McIntyre SA, Francis JJ, Gould NJ, Lorencatto F. The use of theory in process evaluations conducted alongside randomized trials of implementation interventions: a systematic review. Transl Behav Med. 2020;10(1):168–78. McIntyre SA, Francis JJ, Gould NJ, Lorencatto F. The use of theory in process evaluations conducted alongside randomized trials of implementation interventions: a systematic review. Transl Behav Med. 2020;10(1):168–78.
go back to reference Miller CJ, Barnett ML, Baumann AA, Gutner CA, Wiltsey-Stirman S. The FRAME-IS: a framework for documenting modifications to implementation strategies in healthcare. Implement Sci. 2021;16(1):36.CrossRef Miller CJ, Barnett ML, Baumann AA, Gutner CA, Wiltsey-Stirman S. The FRAME-IS: a framework for documenting modifications to implementation strategies in healthcare. Implement Sci. 2021;16(1):36.CrossRef
go back to reference Montgomery P, Underhill K, Gardner F, Operario D, Mayo-Wilson E. The Oxford Implementation Index: a new tool for incorporating implementation data into systematic reviews and meta-analyses. J Clin Epidemiol. 2013;66(8):874–82.CrossRef Montgomery P, Underhill K, Gardner F, Operario D, Mayo-Wilson E. The Oxford Implementation Index: a new tool for incorporating implementation data into systematic reviews and meta-analyses. J Clin Epidemiol. 2013;66(8):874–82.CrossRef
go back to reference Moore GF, Audrey S, Barker M, Bond L, Bonell C, Hardeman W, Moore L, O’Cathain A, Tinati T, Wight D, Baird D. Process evaluation of complex interventions: Medical Research Council guidance. BMJ. 2015;350: h1258.CrossRef Moore GF, Audrey S, Barker M, Bond L, Bonell C, Hardeman W, Moore L, O’Cathain A, Tinati T, Wight D, Baird D. Process evaluation of complex interventions: Medical Research Council guidance. BMJ. 2015;350: h1258.CrossRef
go back to reference Musuuza JS, Barker A, Ngam C, Vellardita L, Safdar N. Assessment of fidelity in interventions to improve hand hygiene of healthcare workers: a systematic review. Infect Control Hosp Epidemiol. 2016;37:567–75.CrossRef Musuuza JS, Barker A, Ngam C, Vellardita L, Safdar N. Assessment of fidelity in interventions to improve hand hygiene of healthcare workers: a systematic review. Infect Control Hosp Epidemiol. 2016;37:567–75.CrossRef
go back to reference O’Cathain A, Murphy E, Nicholl J. The quality of mixed methods studies in health services research. J Health Serv Res Policy. 2008;13(2):92–8.CrossRef O’Cathain A, Murphy E, Nicholl J. The quality of mixed methods studies in health services research. J Health Serv Res Policy. 2008;13(2):92–8.CrossRef
go back to reference Odendaal W, Atkins S, Lewin S. Multiple and mixed methods in formative evaluation: is more better? Reflections from a South African study. BMC Med Res Method. 2016;16:173.CrossRef Odendaal W, Atkins S, Lewin S. Multiple and mixed methods in formative evaluation: is more better? Reflections from a South African study. BMC Med Res Method. 2016;16:173.CrossRef
go back to reference Pérez D, Van der Stuyft P, Zabala MC, Castro M, Lefèvre P. A modified theoretical framework to assess implementation fidelity of adaptive public health interventions. Implem Sci. 2016;11:91.CrossRef Pérez D, Van der Stuyft P, Zabala MC, Castro M, Lefèvre P. A modified theoretical framework to assess implementation fidelity of adaptive public health interventions. Implem Sci. 2016;11:91.CrossRef
go back to reference Schalkwijk AA, Nijpels G, Bot SD, Chin A Paw MJ, Renders CM, Elders PJ. Lessen geleerd van de implementatie van Zorgstandaard Obesitas voor kinderen. Ned Tijdschr Geneeskd. 2016;160:D525. Schalkwijk AA, Nijpels G, Bot SD, Chin A Paw MJ, Renders CM, Elders PJ. Lessen geleerd van de implementatie van Zorgstandaard Obesitas voor kinderen. Ned Tijdschr Geneeskd. 2016;160:D525.
go back to reference Slaughter SE, Hill JN, Snelgrove-Clarke E. What is the extent and quality of documentation and reporting of fidelity to implementation strategies: a scoping review. Implem Sci. 2015;10:129.CrossRef Slaughter SE, Hill JN, Snelgrove-Clarke E. What is the extent and quality of documentation and reporting of fidelity to implementation strategies: a scoping review. Implem Sci. 2015;10:129.CrossRef
go back to reference Spoorenberg V, Hulscher ME, Geskus RB, De Reijke TM, Opmeer BC, Prins JM, Geerlings SE. A cluster-randomized trial of two strategies to improve antibiotic use for patients with a complicated urinary tract infection. PLoS ONE. 2015;10: e0142672.CrossRef Spoorenberg V, Hulscher ME, Geskus RB, De Reijke TM, Opmeer BC, Prins JM, Geerlings SE. A cluster-randomized trial of two strategies to improve antibiotic use for patients with a complicated urinary tract infection. PLoS ONE. 2015;10: e0142672.CrossRef
go back to reference Squires JE, Graham I, Bashir K, Nadalin-Penno L, Lavis J, Francis J, Curran J, Grimshaw JM, Brehaut J, Ivers N, Michie S, Hillmer M, Noseworthy T, Vine J, Demery Varin M, Aloisio LD, Coughlin M, Hutchinson AM. Understanding context: a concept analysis. J Adv Nurs. 2019;75(12):3448–70.CrossRef Squires JE, Graham I, Bashir K, Nadalin-Penno L, Lavis J, Francis J, Curran J, Grimshaw JM, Brehaut J, Ivers N, Michie S, Hillmer M, Noseworthy T, Vine J, Demery Varin M, Aloisio LD, Coughlin M, Hutchinson AM. Understanding context: a concept analysis. J Adv Nurs. 2019;75(12):3448–70.CrossRef
go back to reference Swanborn PG. Evalueren. Het ontwerpen, begeleiden en evalueren van interventies: een methodische basis voor evaluatie-onderzoek. Amsterdam: Uitgeverij Boom; 1999. Swanborn PG. Evalueren. Het ontwerpen, begeleiden en evalueren van interventies: een methodische basis voor evaluatie-onderzoek. Amsterdam: Uitgeverij Boom; 1999.
go back to reference Tashakkori A, Creswell JW. The newe era of mixed methods (editorial). J Mixed Methods Res. 2007;1:3–7.CrossRef Tashakkori A, Creswell JW. The newe era of mixed methods (editorial). J Mixed Methods Res. 2007;1:3–7.CrossRef
go back to reference Vindrola-Padros C, Pape T, Utley M, Fulop NJ. The role of embedded research in quality improvement: a narrative review. BMJ Qual Saf. 2017;26:70–80.CrossRef Vindrola-Padros C, Pape T, Utley M, Fulop NJ. The role of embedded research in quality improvement: a narrative review. BMJ Qual Saf. 2017;26:70–80.CrossRef
go back to reference Wiltsey Stirman S, Baumann AA, Miller CJ. The FRAME: an expanded framework for reporting adaptations and modifications to evidence-based interventions. Implement Sci. 2019;14(1):58.CrossRef Wiltsey Stirman S, Baumann AA, Miller CJ. The FRAME: an expanded framework for reporting adaptations and modifications to evidence-based interventions. Implement Sci. 2019;14(1):58.CrossRef
go back to reference Wiltsey Stirman SW, Miller CJ, Toder K, Calloway A. Development of a framework and coding system for modifications and adaptations of evidence-based interventions. Implement Sci. 2013;8:65.CrossRef Wiltsey Stirman SW, Miller CJ, Toder K, Calloway A. Development of a framework and coding system for modifications and adaptations of evidence-based interventions. Implement Sci. 2013;8:65.CrossRef
go back to reference Wolfenden L, Yoong SL, Williams CM, et al. Embedding researchers in health service organizations improves research translation and health service performance: the Australian Hunter New England Population Health example. J Clin Epidemiol. 2017;85:3–11.CrossRef Wolfenden L, Yoong SL, Williams CM, et al. Embedding researchers in health service organizations improves research translation and health service performance: the Australian Hunter New England Population Health example. J Clin Epidemiol. 2017;85:3–11.CrossRef
Metagegevens
Titel
Evaluatie van het proces van implementatie
Auteurs
Prof. dr. Marlies Hulscher
Prof. dr. Michel Wensing
Copyright
2023
Uitgeverij
Bohn Stafleu van Loghum
DOI
https://doi.org/10.1007/978-90-368-2909-0_22