Skip to main content
Top

2015 | OriginalPaper | Hoofdstuk

20 Effecten van implementatie: gecontroleerde evaluaties

Auteurs : prof.dr. Trudy van der Weijden, prof. Martin Eccles, MD, FMedSci, FRCP, FRCGP, prof.dr. Jeremy Grimshaw, MBCHb, FRCGP, prof.dr. Richard Grol

Gepubliceerd in: Implementatie

Uitgeverij: Bohn Stafleu van Loghum

share
DELEN

Deel dit onderdeel of sectie (kopieer de link)

  • Optie A:
    Klik op de rechtermuisknop op de link en selecteer de optie “linkadres kopiëren”
  • Optie B:
    Deel de link per e-mail

Samenvatting

  • Er is een reeks van meer of minder complexe, en al dan niet gecontroleerde of gerandomiseerde onderzoeksopzetten beschikbaar voor de evaluatie van de effecten van implementatieprojecten.
  • Terwijl met een niet-gecontroleerd design alleen nagegaan kan worden of de verbeterdoelen daadwerkelijk worden gehaald, kan met een gecontroleerd design geëvalueerd worden of de implementatiestrategie heeft bijgedragen aan het halen van de verbeterdoelen.
  • Bij gecontroleerde studies heeft het gerandomiseerd design de voorkeur. Indien gerandomiseerde designs niet haalbaar zijn kunnen niet-gerandomiseerde designs worden toegepast, hoewel de kans op systematische vertekening van het effect van de implementatiestrategie hierbij groter is.
  • Voor welk design ook wordt gekozen, het is van belang om systematische vertekening zo veel mogelijk te beperken en de generaliseerbaarheid van de resultaten zo groot mogelijk te maken.
  • In het toepassen van deze designs is het van belang om het juiste clusterni• veau te kiezen voor de allocatie van onderzoeksgroepen; dat is vaak niet het niveau van de individuele patiënt.
  • Bij clustergerandomiseerde studies moet gewaakt worden voor postrando• misatie recruitment bias, dat wil zeggen: een verschil in recruitment tussen de zorgverleners in de experimentele en controlegroep.
  • Wanneer de nadruk ligt op evaluatie van het effect van een implementatie• strategie, zijn trials in kleine groepen van voorlopers met relatief optimale condities (explanatoir karakter) aangewezen. Wanneer de nadruk ligt op het beklijven van het effect van een implementatiestrategie op lange termijn, dan zijn trials met een uitgesproken pragmatisch karakter aangewezen.
Literatuur
go back to reference Campbell DT, Stanley J. Experimental and quasi-experimental designs for research. Chicago: Rand McNally, 1966. Campbell DT, Stanley J. Experimental and quasi-experimental designs for research. Chicago: Rand McNally, 1966.
go back to reference Craig P, Dieppe P, Macintyre S, et al. Developing and evaluating complex interventions: the new Medical research Council guidance. BMJ 2008;337:979-83.CrossRef Craig P, Dieppe P, Macintyre S, et al. Developing and evaluating complex interventions: the new Medical research Council guidance. BMJ 2008;337:979-83.CrossRef
go back to reference Donner A, Klar N. Design and analysis of cluster randomization trials in health research. London: Arnold, 2000. Donner A, Klar N. Design and analysis of cluster randomization trials in health research. London: Arnold, 2000.
go back to reference Borm G, Melis R, Teeenstra S, Peer G. Pseudo cluster randomization: a treatment allocation method to minimize contamination and selection bias. Stat Med 2005;24(23): 3535-47.CrossRefPubMed Borm G, Melis R, Teeenstra S, Peer G. Pseudo cluster randomization: a treatment allocation method to minimize contamination and selection bias. Stat Med 2005;24(23): 3535-47.CrossRefPubMed
go back to reference Broek IVF van den, Hoebe CJPA, Bergen JEAM van, et al. Evaluation design of a systematic, selective, internet-based, Chlamydia screening implementation in the Netherlands, 2008-2010: implications of first results for the analysis. BMC Infectious Diseases 2010;10:89.CrossRefPubMedPubMedCentral Broek IVF van den, Hoebe CJPA, Bergen JEAM van, et al. Evaluation design of a systematic, selective, internet-based, Chlamydia screening implementation in the Netherlands, 2008-2010: implications of first results for the analysis. BMC Infectious Diseases 2010;10:89.CrossRefPubMedPubMedCentral
go back to reference Cals JW, Butler CC, Hopstaken RM, et al. Effect of point of care testing for C reactive protein and training in communication skills on antibiotic use in lower respiratory tract infections: cluster randomised trial. BMJ 2009;338:b1374.CrossRefPubMedPubMedCentral Cals JW, Butler CC, Hopstaken RM, et al. Effect of point of care testing for C reactive protein and training in communication skills on antibiotic use in lower respiratory tract infections: cluster randomised trial. BMJ 2009;338:b1374.CrossRefPubMedPubMedCentral
go back to reference Campbell DT, Stanley J. Experimental and quasi-experimental designs for research. Chicago: Rand McNally, 1966. Campbell DT, Stanley J. Experimental and quasi-experimental designs for research. Chicago: Rand McNally, 1966.
go back to reference Campbell MK, Mollison J, Steen N, et al. 2000b. Analysis of cluster randomized trails in primary care: a practical approach. Fam Pract 2000;17(2):192-6.CrossRefPubMed Campbell MK, Mollison J, Steen N, et al. 2000b. Analysis of cluster randomized trails in primary care: a practical approach. Fam Pract 2000;17(2):192-6.CrossRefPubMed
go back to reference Campbell MK, Thomson S, Ramsay CR, et al. Sample size calculator for cluster randomized trials. Comp Biol Med 2004;34:113-25.CrossRef Campbell MK, Thomson S, Ramsay CR, et al. Sample size calculator for cluster randomized trials. Comp Biol Med 2004;34:113-25.CrossRef
go back to reference Campbell MK, Elbourne DR, Altman DG for the CONSORT group. CONSORT statement: extension to cluster randomized trials. BMJ 2004;702-8. Campbell MK, Elbourne DR, Altman DG for the CONSORT group. CONSORT statement: extension to cluster randomized trials. BMJ 2004;702-8.
go back to reference Campbell MK, Fayers PM, Grimshaw JM. Determinants of the intracluster correlation coefficient in cluster randomized trials: the case of implementation research. Clin Trials 2005;2:99-107.CrossRefPubMed Campbell MK, Fayers PM, Grimshaw JM. Determinants of the intracluster correlation coefficient in cluster randomized trials: the case of implementation research. Clin Trials 2005;2:99-107.CrossRefPubMed
go back to reference Cochran WG, Cox GM. Experimental design, 2 ed. New York: Wiley, 1957. Cochran WG, Cox GM. Experimental design, 2 ed. New York: Wiley, 1957.
go back to reference Cochrane AL. Effectiveness and efficiency: random reflections on health services. London: Nuffield Provincial Hospitals Trust, 1979. Cochrane AL. Effectiveness and efficiency: random reflections on health services. London: Nuffield Provincial Hospitals Trust, 1979.
go back to reference Cook TD, Campbell DT. Quasi-experimentation: design and analysis issues for field settings. Chicago: Rand McNally, 1979. Cook TD, Campbell DT. Quasi-experimentation: design and analysis issues for field settings. Chicago: Rand McNally, 1979.
go back to reference Craig P, Dieppe P, Macintyre S, et al. Developing and evaluating complex interventions: the new Medical research Council guidance. BMJ 2008;337:979-83.CrossRef Craig P, Dieppe P, Macintyre S, et al. Developing and evaluating complex interventions: the new Medical research Council guidance. BMJ 2008;337:979-83.CrossRef
go back to reference Diwan VK, Eriksson B, Sterky G, Tomson G. Randomization by group in the studying the effect of drug information in primary care. Int J Epidemiol 1992;21:124-30.CrossRefPubMed Diwan VK, Eriksson B, Sterky G, Tomson G. Randomization by group in the studying the effect of drug information in primary care. Int J Epidemiol 1992;21:124-30.CrossRefPubMed
go back to reference Donner A. Some aspects of the design and analysis of cluster randomization trials. Applied Statistics 1998;47:95-113. Donner A. Some aspects of the design and analysis of cluster randomization trials. Applied Statistics 1998;47:95-113.
go back to reference Donner A, Klar N. Design and analysis of cluster randomization trials in health research. London: Arnold, 2000. Donner A, Klar N. Design and analysis of cluster randomization trials in health research. London: Arnold, 2000.
go back to reference Donner A, Koval JJ. The estimation of intraclass correlation in the analysis of family data. Biometrics 1980;36:19-25.CrossRefPubMed Donner A, Koval JJ. The estimation of intraclass correlation in the analysis of family data. Biometrics 1980;36:19-25.CrossRefPubMed
go back to reference Eccles M, Grimshaw J, Steen N, et al. The design and analysis of a randomised controlled trial to evaluate computerised decision support in primary care: the COGENT Study. Fam Pract 2000;17:180-6.CrossRefPubMed Eccles M, Grimshaw J, Steen N, et al. The design and analysis of a randomised controlled trial to evaluate computerised decision support in primary care: the COGENT Study. Fam Pract 2000;17:180-6.CrossRefPubMed
go back to reference Eccles M, Grimshaw J, Campbell M, Ramsay C. Research designs for studies evaluating the effectiveness of change and improvement strategies. Qual Saf Health Care 2003;12:47-52.CrossRefPubMedPubMedCentral Eccles M, Grimshaw J, Campbell M, Ramsay C. Research designs for studies evaluating the effectiveness of change and improvement strategies. Qual Saf Health Care 2003;12:47-52.CrossRefPubMedPubMedCentral
go back to reference Eccles M, McColl E, Steen N, et al. Effect of computerised evidence based guidelines on management of asthma and angina in adults in primary care: cluster randomised controlled trial. BMJ 2002a;325(7370):941-4.CrossRefPubMedPubMedCentral Eccles M, McColl E, Steen N, et al. Effect of computerised evidence based guidelines on management of asthma and angina in adults in primary care: cluster randomised controlled trial. BMJ 2002a;325(7370):941-4.CrossRefPubMedPubMedCentral
go back to reference Eccles M, McColl E, Steen N, et al. An evaluation of computerised guidelines for the management of two chronic conditions. Newcastle: Centre for Health Services Research, 2002b. Eccles M, McColl E, Steen N, et al. An evaluation of computerised guidelines for the management of two chronic conditions. Newcastle: Centre for Health Services Research, 2002b.
go back to reference Eccles M, Steen N, Grimshaw J, et al. Effect of audit and feedback, and reminder messages on primary-care radiology referrals: a randomised trial. Lancet 2001;357:1406-9.CrossRefPubMed Eccles M, Steen N, Grimshaw J, et al. Effect of audit and feedback, and reminder messages on primary-care radiology referrals: a randomised trial. Lancet 2001;357:1406-9.CrossRefPubMed
go back to reference Eldridge S, Kery S, Torgerson DJ. Bias in identifying and recruiting participants in cluster randomized trials: what can be done? BMJ 2010;340:36-9. Eldridge S, Kery S, Torgerson DJ. Bias in identifying and recruiting participants in cluster randomized trials: what can be done? BMJ 2010;340:36-9.
go back to reference Faber E, Bierma-Zeinstra SMA, Burdorf A, et al. In a controlled trial training general practitioners and occupational physicians to collaborate did not influence sickleave of patients with low back pain. J Clin Epidemiol 2005;58:75-82.CrossRefPubMed Faber E, Bierma-Zeinstra SMA, Burdorf A, et al. In a controlled trial training general practitioners and occupational physicians to collaborate did not influence sickleave of patients with low back pain. J Clin Epidemiol 2005;58:75-82.CrossRefPubMed
go back to reference Flynn TN, Whitley E, Peters TJ. Recruitment strategies in a cluster randomised trial - cost implications. Statist Med 2002;21:397-405.CrossRef Flynn TN, Whitley E, Peters TJ. Recruitment strategies in a cluster randomised trial - cost implications. Statist Med 2002;21:397-405.CrossRef
go back to reference Grilli R, Ramsay CR, Minozi S. Mass media interventions: effects on health services utilisation (Cochrane Review) Update Software, Oxford, 2002. Grilli R, Ramsay CR, Minozi S. Mass media interventions: effects on health services utilisation (Cochrane Review) Update Software, Oxford, 2002.
go back to reference Grimshaw JM, Eccles M, Cambell M, Erbourne D. Clutser randomised trials of professional and organisational behaviour change interventions in heath care settings. Annals AM ACAD 2005;599:71-93.CrossRef Grimshaw JM, Eccles M, Cambell M, Erbourne D. Clutser randomised trials of professional and organisational behaviour change interventions in heath care settings. Annals AM ACAD 2005;599:71-93.CrossRef
go back to reference Koelewijn-van Loon MS, Weijden T van der, Steenkiste B van, et al. Involving patients in cardiovascular risk management using nurse-led clinics: a cluster-randomised controlled trial in primary care. CMAJ 2009;181(12): E267-74.CrossRefPubMedPubMedCentral Koelewijn-van Loon MS, Weijden T van der, Steenkiste B van, et al. Involving patients in cardiovascular risk management using nurse-led clinics: a cluster-randomised controlled trial in primary care. CMAJ 2009;181(12): E267-74.CrossRefPubMedPubMedCentral
go back to reference Lewin S, Glenton C, Oxman AD. Use of qualitative methods alongside randomised controlled trials of complex healthcare interventions: methodological study. BMJ 2009;339:732-4.CrossRef Lewin S, Glenton C, Oxman AD. Use of qualitative methods alongside randomised controlled trials of complex healthcare interventions: methodological study. BMJ 2009;339:732-4.CrossRef
go back to reference Lipsey MW, Wilson DB. The efficacy of psychological, educational, and behavioral treatment: confirmation from meta-analysis. Am Psychol 1993;48(12):1181-209.CrossRefPubMed Lipsey MW, Wilson DB. The efficacy of psychological, educational, and behavioral treatment: confirmation from meta-analysis. Am Psychol 1993;48(12):1181-209.CrossRefPubMed
go back to reference Lobo CM, Frijling BD, Hulscher MEJL, et al. Improving quality of organising cardiovascular preventive care in general practice by outreach visitors: a randomised controlled trial. Prev Med 2002;35:430-6.CrossRefPubMed Lobo CM, Frijling BD, Hulscher MEJL, et al. Improving quality of organising cardiovascular preventive care in general practice by outreach visitors: a randomised controlled trial. Prev Med 2002;35:430-6.CrossRefPubMed
go back to reference Matowe L, Ramsay C, Grimshaw JM, et al. Influence of the Royal College of Radiologists’ guidelines on referrals from general practice: A time series analysis. Clin Radiol 2002;57:575-8.CrossRefPubMed Matowe L, Ramsay C, Grimshaw JM, et al. Influence of the Royal College of Radiologists’ guidelines on referrals from general practice: A time series analysis. Clin Radiol 2002;57:575-8.CrossRefPubMed
go back to reference Mollison JA, Simpson JA, Campbell MK, Grimshaw JM. Comparison of analytical methods for cluster randomised trials: an example from a primary care setting. J Epidemiol Biostat 2000;5(6):339-48.PubMed Mollison JA, Simpson JA, Campbell MK, Grimshaw JM. Comparison of analytical methods for cluster randomised trials: an example from a primary care setting. J Epidemiol Biostat 2000;5(6):339-48.PubMed
go back to reference Morgan M, Studney DR, Barnett GO, Winickoff RN. Computerized concurrent review of prenatal care. QRB 1978;4:33-6. Morgan M, Studney DR, Barnett GO, Winickoff RN. Computerized concurrent review of prenatal care. QRB 1978;4:33-6.
go back to reference Murray DM. The design and analysis of group randomised trials. Oxford: Oxford University Press, 1998. Murray DM. The design and analysis of group randomised trials. Oxford: Oxford University Press, 1998.
go back to reference Ostrom CW. Time series analysis: regression techniques. London: Sage, 1990.CrossRef Ostrom CW. Time series analysis: regression techniques. London: Sage, 1990.CrossRef
go back to reference Pocock SJ. Clinical trials: a practical approach. New York: Wiley, 1983. Pocock SJ. Clinical trials: a practical approach. New York: Wiley, 1983.
go back to reference Ramsay CR, Eccles M, Grimshaw JM, Steen N. Assessing the long term effect of educational reminder messages on primary care radiology referrals. Clin Radiol 2003;58:319-21.CrossRefPubMed Ramsay CR, Eccles M, Grimshaw JM, Steen N. Assessing the long term effect of educational reminder messages on primary care radiology referrals. Clin Radiol 2003;58:319-21.CrossRefPubMed
go back to reference Ramsay CR, Matowe L, Grilli R, Grimshaw JM, Thomas RE. Interrupted time series designs in health technology assessment: lessons from two systematic reviews of behaviour change strategies. Int J Technol Ass Health Care 2003;19:613-23.CrossRef Ramsay CR, Matowe L, Grilli R, Grimshaw JM, Thomas RE. Interrupted time series designs in health technology assessment: lessons from two systematic reviews of behaviour change strategies. Int J Technol Ass Health Care 2003;19:613-23.CrossRef
go back to reference Russell IT. The evaluation of a computerised tomography: a review of research methods. In: Culyer AJ, Horisberger B, eds. Economic and medical evaluation of health care technologies. Berlin: Springer-Verlag, 1983. Russell IT. The evaluation of a computerised tomography: a review of research methods. In: Culyer AJ, Horisberger B, eds. Economic and medical evaluation of health care technologies. Berlin: Springer-Verlag, 1983.
go back to reference Scheel IB, Hagen KB, Herrin J, et al. Blind faith? The effects of promoting active sick leave for back pain patients: a cluster-randomized controlled trial. Spine 2002;27(23):2734-40.CrossRefPubMed Scheel IB, Hagen KB, Herrin J, et al. Blind faith? The effects of promoting active sick leave for back pain patients: a cluster-randomized controlled trial. Spine 2002;27(23):2734-40.CrossRefPubMed
go back to reference Schwartz D, Lellouch J. Explanatory and pragmatic attitudes in clinical trials. J Chron Diseases 1967;20(637):648. Schwartz D, Lellouch J. Explanatory and pragmatic attitudes in clinical trials. J Chron Diseases 1967;20(637):648.
go back to reference Shadish Cook & Campbell. Experimental and quasi-experimental designs for generalized causal inference. New York: Houghton Mifflin, 2002. Shadish Cook & Campbell. Experimental and quasi-experimental designs for generalized causal inference. New York: Houghton Mifflin, 2002.
go back to reference Thorpe KE, Zwarenstein M, Oxman AD, et al. A pragmatic-explanatory continuum indicator summary (PRECIS): a tool to help trial designers. J Clin Epidemiol 2009;62:464-75.CrossRefPubMed Thorpe KE, Zwarenstein M, Oxman AD, et al. A pragmatic-explanatory continuum indicator summary (PRECIS): a tool to help trial designers. J Clin Epidemiol 2009;62:464-75.CrossRefPubMed
go back to reference Turner MJ, Flannelly GM, Wingfield M, et al. The miscarriage clinic: an audit of the first year. Brit J Obstet Gynaec 1991;98:306-8.CrossRefPubMed Turner MJ, Flannelly GM, Wingfield M, et al. The miscarriage clinic: an audit of the first year. Brit J Obstet Gynaec 1991;98:306-8.CrossRefPubMed
go back to reference Verstappen W, Weijden T van der, Sijbrandij J, et al. Effect of a practice-based strategy on test ordering performance of primary care physicians. A randomized trial. JAMA 2003;289:2407-12.PubMed Verstappen W, Weijden T van der, Sijbrandij J, et al. Effect of a practice-based strategy on test ordering performance of primary care physicians. A randomized trial. JAMA 2003;289:2407-12.PubMed
go back to reference Verstappen WHJM, Weijden T van der, Dubois WI, et al. Improving test ordering in primary care: the added value of a small-group quality improvement strategy compared with classic feedback only. Ann Fam Med 2004;2:569-75.CrossRefPubMedPubMedCentral Verstappen WHJM, Weijden T van der, Dubois WI, et al. Improving test ordering in primary care: the added value of a small-group quality improvement strategy compared with classic feedback only. Ann Fam Med 2004;2:569-75.CrossRefPubMedPubMedCentral
go back to reference Verstappen WHJM, Weijden T van der, Riet G ter, et al. Block designs in quality improvement research enable control for the Hawthorne effect. J Clin Epidemiol 2004;57:1119-23.CrossRefPubMed Verstappen WHJM, Weijden T van der, Riet G ter, et al. Block designs in quality improvement research enable control for the Hawthorne effect. J Clin Epidemiol 2004;57:1119-23.CrossRefPubMed
go back to reference Zwarenstein M, Treweek S, Gagnier JJ, et al. Improving the reporting of pragmatic trials: an extension of the CONSORT statement. BMJ 2008;337:1-8.CrossRef Zwarenstein M, Treweek S, Gagnier JJ, et al. Improving the reporting of pragmatic trials: an extension of the CONSORT statement. BMJ 2008;337:1-8.CrossRef
Metagegevens
Titel
20 Effecten van implementatie: gecontroleerde evaluaties
Auteurs
prof.dr. Trudy van der Weijden
prof. Martin Eccles, MD, FMedSci, FRCP, FRCGP
prof.dr. Jeremy Grimshaw, MBCHb, FRCGP
prof.dr. Richard Grol
Copyright
2015
Uitgeverij
Bohn Stafleu van Loghum
DOI
https://doi.org/10.1007/978-90-368-1077-7_20