Skip to main content
Download PDF
  • Research article
  • Open access
  • Published:

Effectiveness of training in evidence-based medicine skills for healthcare professionals: a systematic review

BMC Medical Education volume 16, Article number: 103 (2016) Cite this article

Abstract

Background

Basic skills in evidence-based medicine (EbM) are indispensable for healthcare professionals to promote consumer-centred, evidence-based treatment. EbM training courses are complex interventions – a fact that has not been methodologically reflected by previous systematic reviews.

This review evaluates the effects of EbM training for healthcare professionals as well as the quality of reporting of such training interventions.

Methods

We searched PubMed, EMBASE, CINAHL, Cochrane Library, ERIC, Campbell Library and PsycINFO up to 9/2014. Randomised controlled trials, controlled clinical trials as well as before-after trials were included. Authors were contacted in order to obtain missing data. Two independent reviewers extracted data and assessed risk of bias.

Results

We reviewed 14.507 articles; n = 61 appeared potentially eligible; n = 13 involving 1,120 participants were included. EbM training shows some impact on knowledge and skills, whereas the impact on practical EbM application remains unclear. Risk of bias of included trials raises uncertainty about the effects. Description of complex interventions was poor.

Conclusions

EbM training has some positive effects on knowledge and skills of healthcare professionals. Appropriate methods for development, piloting, evaluation, reporting and implementation of the training should be applied.

Peer Review reports

Background

Evidence-based medicine (EbM) is a prerequisite for decision-making in healthcare. All over the world, healthcare institutes follow the principles of EbM when reviewing and assessing the evidence for healthcare decision-making [1, 2]. The paradigm shift towards EbM challenges the methodological skills and attitude of healthcare professionals. A consumer-centred, evidence-based treatment requires basic EbM skills and scientific literacy [3, 4].

The transfer of evidence into routine care is often not optimal [5]. Barriers that impede the implementation of EbM have been extensively researched. Lack of time to put EbM into practice, false beliefs about EbM, insufficient support in the clinical setting and limited critical appraisal skills are the barriers that healthcare professionals most often face [6, 7].

There is empirical evidence that EbM training activities improve knowledge and skills needed for the critical appraisal of scientific papers [8]. Traditionally, training and continuing education in EbM focus on physicians. An early systematic review by Shaneyfeld and colleagues identified 104 trials on EbM training courses; n = 91 addressed physicians [9]. However, during the last few years curricula and textbooks aiming to achieve EbM competencies for allied healthcare professionals have been developed. Training courses in EbM skills for nurses, diabetes educators and other professionals associated with health have been shown to be feasible and well appreciated [10, 11]. Organizations like the Joanna Briggs Institute or the Centre of Evidence-Based Physiotherapy, which provide a variety of EbM workshops and learning opportunities for nurses, physical therapists, midwives, medical and allied health researchers, have been established. EbM resources have been made accessible, for instance, a free database of randomised trials, systematic reviews and clinical practice guidelines in physiotherapy. To address the increasing teaching demand and the need to improve the effectiveness of EbM, train-the-trainer courses have been developed [12]. Training in EbM for patients and consumer representatives is offered by some organisations [13, 14].

A variety of different approaches exists for teaching and learning EbM, for instance, by attending courses, conferences, workshops or journal clubs [15]. Recent systematic reviews showed inconsistent effects regarding the effectiveness of different EbM teaching and learning methods. Coomarasamy and Khan evaluated the effects of stand-alone versus clinically integrated teaching in EbM on several outcomes in postgraduates [16]. Stand-alone teaching was defined as classroom teaching, either didactic, interactive, or mixed. A total of 23 randomised controlled, controlled clinical as well as twelve before-after trials were included in this systematic review. Knowledge was assessed in 17 trials, critical appraisal skills in nine trials, changes in attitudes in six, and behavioural change in 14 trials. None of the trials evaluated clinical health outcomes. Stand-alone teaching as well as integrated teaching was effective in improving EbM knowledge but only clinically integrated teaching improved skills, attitudes, and behaviour [16]. Outcomes were predominantly determined by self-assessment. In contrast, a recently published Cochrane review on the effectiveness of training conducted to increase the “critical appraisal” skills only included trials if the assessment of outcome measures was based upon standardised and reliable instruments (e.g. tests, questionnaires). Three randomised controlled trials with 272 participants fulfilled the inclusion criteria. While a statistically significant improvement in participants’ critical appraisal knowledge was seen in two of the three trials, none of the three trials evaluated the process of care or patient outcomes [17].

Former systematic reviews dealing with EbM training activities have not taken the complexity of educational interventions into account. Complex interventions typically comprise interacting elements that are also influenced by contextual factors [18]. Educational interventions are often heterogeneous in their underlying theory, the methods used, the format and intensity, and the target population. The development of educational interventions requires great investment in testing procedures for their feasibility and acceptability prior to large-scale evaluations. The process of implementation should ideally be carefully prepared and piloted and it is recommended to take the whole chain of complex intervention development and evaluation into account while reviewing complex interventions. Thus, a non-customary approach for evidence synthesis is needed. The UK Medical Research Council (MRC) has provided the framework for understanding and appraising complex interventions [18–21]. All relevant patient outcome parameters need to be assessed, interdependencies between active elements should be taken into account, and all trials referring to development, evaluation and implementation of the educational intervention should be considered. The theoretical basis and its influence on the education program should be analysed. Adequate reporting of the elements and interdependencies within complex interventions are the prerequisite to interpret the outcomes.

To the best of our knowledge, a systematic review on EbM training for healthcare professionals with respect to the complexity of the educational interventions has not been performed. Therefore, the objective of this review is to evaluate the effects and the quality of the reporting regarding development and implementation of EbM training for healthcare professionals.

Methods

The review protocol has been registered in PROSPERO International Prospective Register of Systematic Reviews (crd.york.ac.uk/prospero/index.asp Identifier CRD42014013579).

Types of trials

We included all individual and cluster-randomised controlled trials (RCTs), controlled clinical trials (CCTs) as well as before-after trials. Non-blinded trials were included in the review, since blinding of participating healthcare professionals seemed to be unrealistic. The publication language was restricted to English and German.

Types of participants

Healthcare professionals in any clinical or academic setting were included. Trials on EbM training solely for physicians, medical students, patients and patient representatives, managers or purchasers were excluded.

Types of interventions

This review focuses on educational interventions aimed at improving EbM knowledge, skills, attitudes and behaviour in healthcare professionals. The interventions might cover the following contents: Formulating questions that could be answered by a systematic literature search; performing a systematic literature search; critically appraising selected publications; communicating trial results to consumer and patients.

We excluded trials that investigated the effects of teaching solely biostatistics or search strategies, programs focusing on specific health problems, medical education in general (not EbM in particular), and trials testing the effectiveness of implementing evidence-based guidelines.

Types of outcome measures

  1. 1.

    Outcome measures were attitudes, knowledge, skills, and behaviour regarding EbM which were objectively assessed through validated instruments.

  2. 2.

    Impact of EbM training on the implementation of EbM in routine care and patient-relevant outcomes like mortality, morbidity, and quality of life were assessed.

Search methods for identification of trials

The literature search strategy followed the Cochrane Handbook for Systematic Reviews of Interventions, version 5.1.0. [22]. MEDLINE, EMBASE, CINAHL, Cochrane Library, ERIC, Campbell Library and PsycINFO were searched systematically in September 2014.

The following terms were used: “Health Personnel (MeSH term)”, “dietician”, “dietitian”, “diabetes educator”, “evidence-based medicine”, “evidence-based nursing”, “evidence-based practice”, “evidence-based”, “journal club”, “critical read*”, “critical appraisal”, “science literacy”, “health literacy”, “risk literacy”, “education (MeSH term)”, “train*”

Reference lists of published reviews and included articles were checked for additional trials. If the full text was not available, the authors of the trials were contacted.

Selection of trials

Two review authors (LH, SB) independently assessed titles and abstracts from the search. Eligible articles were assessed for inclusion. Disagreement was solved by consensus.

Data extraction and management

Based upon CReDECI [23] and the CONSORT statement [24], we developed a standardized data extraction form that included information on the development, evaluation and implementation of complex interventions:

  • Description of the intervention

  • Description of the intervention’s development (e.g. theoretical and/or evidence base)

  • Information on pilot testing

  • Delivery of the intervention (who, how often, how long?)

  • Description of the implementation strategy

  • Description of any material and method used

  • Method of assessing participants’ preferences/interests/experiences

  • Description of process evaluation

  • Information on costs/resources needed for the implementation of the intervention

  • Description of what has been offered in the control group.

Data were extracted by two independent reviewers (LH, SB) and checked for accuracy. In case of discrepancy, the third review author (GM) was called in to reach consensus. Quality criteria following the Cochrane Handbook for Systematic Reviews of Interventions Version 5.1.0 [22] were applied in order to assess the risk of bias of included trials. Critical appraisal of trials was carried out by two independent reviewers. In the case of unclear or missing information, the corresponding author of the trial was contacted.

Since we found pronounced methodological heterogeneity, the trial results are presented in a narrative form only.

Results

A total of 14.507 articles were identified, of which 61 were considered for inclusion. After screening the full text articles, a total of 13 trials were included: four randomised controlled trials [25–28], two controlled clinical trials [29, 30] and seven before-after trials [11, 31–36]. Sample sizes ranged from n = 30 [26] to n = 168 [29] with a total of 1,120 participants. The reasons for exclusion are reported in the flow diagram (Fig. 1). In seven trials, participants’ age was not reported [11, 27, 29–31, 33, 34]. In the remaining trials, the age ranged from 18 to 64 years.

Fig. 1
figure 1

Flow diagram

Full size image

Trials were conducted in the United States of America [27, 30, 32, 35], the United Kingdom [26], Australia [31, 33, 34], Canada [36], Germany [11], Taiwan [29], Philippines [28] and Iran [25].

Healthcare professionals involved in these trials were predominantly nurses or nursing students, nurse managers, occupational therapists, physiotherapists, speech pathologists, dieticians and diabetes nurses or diabetes instructors with or without academic background and varying job experience.

The total trial duration ranged from eight weeks [35] to 27 months [32]. The characteristics of the included trials are summarized in Table 1.

Table 1 Characteristics of included studies (n = 12)
Full size table

EbM training courses

The EbM training offered varied in duration from courses lasting five hours [26] up to courses with 48 h [34] of teaching.

Bennet et al. [31] and Yost et al. [36] included all five core elements of EbM training in their program: 1) ask a question that can be answered; 2) identify appropriate sources for searching relevant information and perform a systematic literature search; 3) critically appraise selected publications on key elements; 4) implement EbM in everyday clinical practice; 5) communicate trial results to patients and consumers. Meyer et al. [11], Dizon et al. [28], Lizarondo et al. [33], McCluskey et al. [34], Varnell et al. [35], Courey et al. [30] and Levin et al. [27] included the first four elements, while Stevenson et al. [26], Chen et al. [29] and Jalali-Nia et al. [25] included only the first three elements. The report by Kim et al. [32] did not provide a full description of the training’s elements.

Eight training programs [11, 25, 26, 29, 31, 33, 35, 36] offered classroom-based activities for teaching the principles of EbM. Five trials [27, 28, 30, 32, 34] included co-intervention in addition to classroom teaching, such as mentorship in participants’ homes or institutions, online support, email lists to facilitate communication or presentation of relevant literature in clinical settings.

A description of EbM training programs is provided in Table 2.

Table 2 Description of EbM training programs
Full size table

Risk of bias in included before-after trials

Details of risk of bias in the included before-after trials are displayed in Table 3.

Table 3 Risk of bias summary for the included before-after trials
Full size table

The trials by Meyer et al. [11], Varnell et al. [35] and Lizarondo et al. [33] had the lowest risk of bias, while Yost et al. [36], Kim et al. [32] and Bennet et al. [31] had the highest risk of bias.

Risk of bias in included controlled and randomised controlled trials

Details of risk of bias in the included controlled and randomised controlled trials are displayed in Table 4. From the included controlled trials, the trial by Courey et al. [30] had a higher risk of bias than the trial by Chen et al. [29]. From the included randomised controlled trials, the trials by Dizon et al. [28] and Levin et al. [27] had the lowest risk of bias, while the trial by Stevenson et al. [26] had the highest risk of bias.

Table 4 Risk of bias summary for the included controlled and randomized controlled trials
Full size table

Intervention effects

Details of intervention effects and applied assessment instruments are displayed in Additional file 1.

Impact on attitudes

Two before-after trials [31, 32] reported that attitudes towards evidence-based practice did not significantly improve after EbM training, while one trial [35] reported higher scores on the attitude scale at the end of the program. Lizarondo et al. [33] examined the impact of EbM training on the attitudes of different associated healthcare disciplines. A significant improvement in attitudes was seen only for physiotherapists, but not for speech pathologists, occupational therapists, social workers or dieticians/nutritionists.

The controlled clinical trial by Courey et al. [30] reported a decrease in positive attitude from pre- to post-test in the intervention group and no change in the control group.

In a randomised controlled trial, Jalali-Nia et al. [25] showed a statistically significant difference between the intervention and the control group with higher scores for positive attitudes in the intervention group. Dizon et al. [28] demonstrated significantly increased positive attitudes in the intervention group immediately post-training and three month post-training. The results obtained by Stevenson et al. [26] also demonstrated small effects on positive attitudes towards the EbM concept. However, the reporting in the original paper was somehow inconclusive and a request to the authors remained unsuccessful. The specific affected element remains unclear. In the randomised controlled trial by Levin et al. [27] a statistically significant improvement in the intervention group compared with the control group was seen twice: first after the 16-week educational and mentored intervention period and secondly (nine months later) after an evidence-based practice (EbP) implementation project.

Impact on knowledge and skills

Five before-after trials tested whether EbM training leads to an increase in EbM-related knowledge. Three trials additionally tested whether knowledge in EbM is influenced by training. Bennet et al. [31], Meyer et al. [11], and Lizarondo et al. [33] documented that participation in the course was associated with a significant increase in knowledge directly after the training. Meyer et al. [11] also observed increased skills in EbM. McCluskey et al. [34] collected data at baseline, post-training and eight months later. There was a significant increase in knowledge when baseline and post-workshop scores were compared. Improved knowledge scores were maintained after eight months. Yost et al. [36] collected data at baseline, post-training and six months later. Knowledge and skills increased significantly from baseline to post-training measurement and from baseline to six-month follow-up. The post-training measurement compared to that at six months follow-up showed a significant decrease in knowledge and skills. In their controlled clinical trial, Chen et al. [29] showed significantly increased scores for knowledge and skills in the intervention and in the control group. However, the mean score in the intervention group was significantly higher than the mean score of the control group. The randomised controlled trial by Dizon et al. [28] found significantly increased scores for knowledge and skills in the intervention group compared with a waitlist control group directly post-training and at three months follow up.

Impact on EbM implementation and patient-relevant outcomes

Three before-after trials and two randomised controlled trials tested whether EbM training leads to an increased EbM implementation. Lizarondo et al. [33] tested the impact of EbM training on different associated healthcare disciplines. Physical therapists, social workers and dieticians/nutritionists showed statistically significant, positive changes in EbM implementation scores but speech pathologists and occupational therapists did not. While Varnell et al. [35] also reported higher scores on EbM implementation scales at the end of the program, Yost et al. [36] found no significant increase in EbM implementation behaviours from baseline to six-month follow-up. Levin et al. [27] demonstrated in a randomised controlled design more EbM implementation behaviours in the intervention group than in the control group at the end of the training. In the randomised controlled trial by Dizon et al. [28] improved EbM implementation behaviours were seen in the intervention group but not in the control group.

None of the trials assessed patient-relevant outcomes.

Reporting quality with regard to the development and implementation of a complex intervention

A total of eleven trials described the elements of the applied training in detail. However, reporting quality varied regarding the description of the interventions’ development. Most of the trials provided insufficient information concerning piloting, description of the implementation strategy and the methods of assessing participants’ preferences, interests and experiences. Almost no information was provided on process evaluation and costs or resources needed for implementation. Details of the reporting quality are shown in Table 5. In summary, the trials by Dizon et al. [28], Levin et al. [27], Varnell et al. [35] and Meyer et al. [11] showed the highest quality of reporting, while Jalali-Nia et al. [25], Chen et al. [29] and Courey et al. [30] demonstrated poor reporting quality on the development and piloting of the complex intervention.

Table 5 Reporting quality with regard to the development and evaluation of a complex intervention
Full size table

Discussion

The results of this systematic review on the effectiveness of EbM training show some impact on the knowledge and skills of healthcare professionals. However, the improvement in knowledge and skills was often rather small. Three trials demonstrated significant higher scores on EbM implementation scales and one trial reported improved EbM implementation behaviours measured by activity diaries. However, improvement of EbM implementation was self-perceived; hence, the impact on the practical application of EbM remains unknown.

Adequate knowledge and skills are indispensable for successful implementation of EbM but are not the only prerequisite. Negative attitudes, low management priority and no willingness to change current practice models are well-described barriers of EbM implementation [37].

Conflicting results were seen regarding the impact of EbM training on attitudes towards EbM. While some trials reported improvement, other trials did not. One trial even reported a decrease in positive attitude from pre- to post-intervention in the EbM training group. The trial by Lizarondo et al. [33] demonstrates inconsistent outcomes across different disciplines of healthcare professionals following EbM training. Some disciplines showed statistically significant improvements in all outcomes; others did not. It is unclear whether the training programs evaluated in this review will be comparably effective across all branches of healthcare professionals. Current systematic reviews also conclude that teaching interventions may positively influence EbM-related knowledge, skills and attitudes in healthcare professionals [17, 38].

These reviews did not make any attempt to take the nature of complex interventions into account, neither did they refer even to suggested models like the UK MRC framework.

EbM training for healthcare professionals as complex interventions comprise different elements that act interdependently, e.g. train-the-trainer modules, number of sessions, curriculum, corresponding media and materials. There are also different contextual factors, such as setting and didactic strategies, as well as the educational and professional background of the participants that may influence the intervention effects.

The majority of the trials offered exclusively classroom-based EbM training, while some trials included co-intervention in addition to classroom teaching. There is much debate about what is the best type of educational activity to achieve a substantial increase in putting EbM into practice [39]. Empirical evidence exists in favour of clinically integrated EbM training over classroom-based teaching in relation to changing behaviour [8, 16, 40] which might be an indicator for successful implementation.

The process of developing a complex intervention has several phases. Not all research will need to begin at the beginning and work stepwise through an entire framework for example provided by the MRC. Sometimes evidence already exists; sometimes steps are more or less important [18]. However, complete reporting on the development and piloting of all components is most important in order to interpret the outcomes of a complex intervention. The trials included in our review provided insufficient reports on the development and implementation of the EbM training. Piloting was rarely reported by the randomised controlled trials. However, avoiding proper piloting might lead to non-effective interventions since no attempt was made to understand and reduce procedural, clinical, and methodological uncertainties in advance of the implementation of the intervention within the main trial. There was also insufficient information provided about participants’ preferences, interests and experiences. This might result in low acceptability of the intervention. Unfortunately, almost no information was provided about process evaluation and the costs or resources required. Thus, no insight was given into why an EbM training might have unexpected outcomes, why a successful training worked or how it might be optimized. Information about costs and resources is important for decision-makers.

Our review has several strengths. In order to increase the validity of the results only trials using validated assessment instruments have been included. Our review is the first taking the complexity of the included interventions into account. Therefore, we applied a specific criteria list on the quality of reporting of complex interventions [23]. Reporting a complex intervention trial according to the requirements of CReDECI might improve transparency and understanding of the intervention and might also have an impact on the value of future systematic reviews dealing with complex interventions

A full description of the EbM training and an understanding of its elements are crucial for the reproduction of the intervention’s evaluation, the adaption of EbM training to different settings, and for long-term implementation [41, 42].

Our review has some limitations. Of the seven contacted authors, only two replied to our request. Since we considered only English or German language publications for inclusion, a language bias could not be ruled out.

Conclusions

There is insufficient evidence that available EbM trainings for healthcare professionals are likely to result in a meaningful change in EbM behaviour. Future trials should not focus only on participants’ knowledge, attitudes and skills. EbM training is also supposed to foster healthcare professionals’ use of EbM. Relevant outcomes should be used to assess the effectiveness of EbM training and to investigate whether such courses lead to changes in care processes or patient-relevant outcomes.

In this review, conclusions about effective training elements cannot be made due to the poor reporting quality of the included trials. In order to generate formats suitable for long-term implementation, future EbM training should be carefully developed, theory-based, piloted and finally investigated in a robust, randomised controlled trial.

Abbreviations

EbM:

Evidence-based medicine

MRC:

Medical Research Council

RCTs:

Randomised controlled trials

CCTs:

Controlled clinical trials

MeSH:

Medical Subject Headings

CONSORT:

Consolidated Standards of Reporting Trials

CReDECI:

Criteria for Reporting the Development and Evaluation of Complex Interventions in healthcare

EbP:

Evidence-based practice

References

  1. The German Institute for Quality and Efficiency in Health Care (IQWiG). https://www.iqwig.de/download/IQWiG_Methoden_Version_4-2.pdf. Accessed 03 May 2015.

  2. The National Institute for Clinical Excellence (NICE). http://www.nice.org.uk/aboutnice/howwework/how_we_work.jsp. Accessed 03 May 2015.

  3. Mühlhauser I, Kasper J, Meyer G, Federation of European Nurses in Diabetes. Understanding of diabetes prevention studies: questionnaire survey of professionals in diabetes care. Diabetologia. 2006;49:1742–6.

    Article  Google Scholar 

  4. Mühlhauser I. Diabetes experts’ reasoning about diabetes prevention studies: a questionnaire survey. BMC Res Notes. 2008;1:90.

    Article  Google Scholar 

  5. Greenhalgh T. Is my practice evidence-based? BMJ. 1996;313:957–8.

    Article  Google Scholar 

  6. Zwolsman SE, Van Dijk N, Te Pas E, De Waard MW. Barriers to the use of evidence-based medicine:knowledge and skills, attitude, and external factors. Perspect Med Educ. 2013;2:4–13.

    Article  Google Scholar 

  7. Graue M, Bjarkøy R, Iversen MM, Haugstvedt A, Harris J. Integrating evidence-based practice into the diabetes nurse curriculum in Bergen Perceived barriers to finding, reading and using research in practice. Eur Diabetes Nursing. 2010;7(1):10–5.

    Article  Google Scholar 

  8. Khan KS, Coomarasamy A. A hierarchy of effective teaching and learning to acquire competence in evidenced-based medicine. BMC Med Educ. 2006;6:59.

    Article  Google Scholar 

  9. Shaneyfelt T, Baum KD, Bell D, Feldstein D, Houstin TK, Kaatz S, Whelan C, et al. Instruments for evaluating education in evidence-based practice. A systematic review. JAMA. 2006;1116:27.

    Google Scholar 

  10. Flores-Mateo G, Argimon JM. Evidence based practice in postgraduate healthcare education: A Systematic review. BMC Health Serv Res. 2007;7:119.

    Article  Google Scholar 

  11. Meyer G, Köpke S, Lenz M, Kasper J, Mühlhauser I. Evidence-based medicine for diabetes educators: a pilot study. Diabet Med. 2007;24:901–5.

    Article  Google Scholar 

  12. Walczak J, Kaleta A, Gabryś E, Kloc K, Thangaratinam S, Barnfield G, et al. How are “teaching the teachers” courses in evidence based medicine evaluated? A systematic review. BMC Med Educ. 2010;10:64.

    Article  Google Scholar 

  13. Cochrane Consumer Network. Cochrane consumer learning. http://consumers.cochrane.org/cochrane-consumer-learning (2012) Accessed 22 Apr 2015

  14. Berger B, Steckelberg A, Meyer G, Kasper J, Mühlhauser I. Training of patient and consumer representatives in the basic competencies of evidence-based medicine: a feasibility study. BMC Med Educ. 2010;10:16.

    Article  Google Scholar 

  15. Green ML. Evidence-based medicine training in graduate medical education: past, present and future. J Eval Clin Pract. 2000;6:121–38.

    Article  Google Scholar 

  16. Coomarasamy A, Khan KS. What is the evidence that postgraduate teaching in evidence based medicine changes anything? A systematic review. BMJ. 2004;329:1017.

    Article  Google Scholar 

  17. Horsley T, Hyde C, Santesso N, Parkes J, Milne R, Stewart R. Teaching critical appraisal skills in healthcare settings. Cochrane Database Syst Rev. 2011;11:CD001270.

    Google Scholar 

  18. Craig P, Dieppe P, Macintyre S, Michie S, Nazareth I, Petticrew M. Developing and evaluating complex interventions: new guidance: UK Medical Research Council. 2008. http://www.mrc.ac.uk/complexinterventionsguidance Accessed 20 Apr 2015.

  19. Mühlhauser I, Lenz M, Meyer G. Development, appraisal and synthesis of complex interventions – a methodological challenge. Z Evid Fortb Qual Gesundh wesen. 2011;105:751–61.

    Article  Google Scholar 

  20. Lenz M, Steckelberg A, Richter B, Mühlhauser I. Meta-analysis does not allow appraisal of complex interventions in diabetes and hypertension self-management. A methodological review. Diabetologia. 2007;50:1375–83.

    Article  Google Scholar 

  21. Lenz M, Steckelberg A, Mühlhauser I. Patient education programmes and decision aids - evaluation of complex interventions. Av Diabetol. 2008;24(6):443–52.

    Google Scholar 

  22. Higgins PT, Green S. Cochrane Handbook for Systematic Reviews of Interventions, version 5.1.0. 2011. http://handbook.cochrane.org/Accessed 01 Sep 2014.

  23. Möhler R, Köpke S, Meyer G. Criteria for Reporting the Development and Evaluation of Complex Interventions in healthcare: revised guideline (CReDECI 2). Trials. 2015;16:204.

    Article  Google Scholar 

  24. Schulz KF, Altman DG, Moher D, CONSORT Group. CONSORT 2010 statement: updated guidelines for reporting parallel group randomised trials. BMJ. 2010;340:c332.

    Article  Google Scholar 

  25. Jalali-Nia SF, Salsali M, Dehghan-Nayeri N, Ebadi A. Effect of evidence-based education on Iranian nursing students’ knowledge and attitude. Nurs Health Scie. 2011;12:221–7.

    Article  Google Scholar 

  26. Stevenson K, Lewis M, Hay E. Do physiotherapists’ attitudes towards evidence-based practice change as a result of an evidence-based educational programme? J Eval Clin Pract. 2004;10(2):207–17.

    Article  Google Scholar 

  27. Levin RF, Fineout-Overholt E, Melnyk BM, Barnes M, Vetter MJ. Fostering evidence-based practice to improve nurse and cost outcomes in a community health setting. Nurs Admin Q. 2011;35(1):21–33.

    Article  Google Scholar 

  28. Dizon JM, Grimmer-Sommers K, Kumar S. Effectiveness of the tailored Evidence Based Practice training program for Filipino physical therapists: a randomized controlled trial. BMC Med Educ. 2014;14:147.

    Article  Google Scholar 

  29. Chen FC, Lin MC. Effects of a nursing literature reading course on promoting critical thinking in two-year nursing program students. J Nurs Res. 2003;11(2):137–46.

    Article  Google Scholar 

  30. Courey T, Benson-Soros J, Deemer K, Zeller RA. Information literacy and evidence-based practice as a new challenge for nurse educators. Nurs Educ Perspect. 2006;27(6):320–3.

    Google Scholar 

  31. Bennett S, Hoffmann T, Arkins M. A multi‐professional evidence‐based practice course improved allied health students’ confidence and knowledge. J Eval Clin Pract. 2011;17(4):635–9.

    Article  Google Scholar 

  32. Kim SC, Brown CE, Ecoff L, Davidson JE, Gallo AM, Klimpel K, Wickline MA. Regional evidence-based practice fellowship-program: Impact on evidence-based practice implementation and barriers. Clin Nurs Res. 2013;22(1):51–69.

    Article  Google Scholar 

  33. Lizarondo LM, Grimmer-Somers K, Kumar S, Crockett A. Does journal club membership improve research evidence uptake in different allied health disciplines: a pre-post study. BMC Res Notes. 2012;5:588.

    Article  Google Scholar 

  34. McCluskey A, Lovarini M. Providing education on evidence-based practice improved knowledge but did not change behaviour: a before and after study. BMC Med Educ. 2005;5:40.

    Article  Google Scholar 

  35. Varnell G, Haas B, Duke G, Hudson K. Effect of an educational intervention on attitudes toward and implementation of evidence-based practice. Worldviews Evid-Based Nurs. 2008;5(4):172–81.

    Article  Google Scholar 

  36. Yost J, Ciliska D, Dobbins M. Evaluating the impact of an intensive education workshop on evidence-informed decision making knowledge, skills, and behaviours: a mixed methods study. BMC Med Educ. 2014;14:13.

    Article  Google Scholar 

  37. Sadeghi‐Bazargani H, Tabrizi JS, Azami‐Aghdash S. Barriers to evidence‐based medicine: a systematic review. J Eval Clin Pract. 2014;20(6):793–802.

    Article  Google Scholar 

  38. Dizon JMR, Grimmer‐Somers KA, Kumar S. Current evidence on evidence‐based practice training in allied health: a systematic review of the literature. Int J Evid‐Based Healthc. 2010;10(4):347–60.

    Article  Google Scholar 

  39. Dizon JMR, Grimmer-Somers KA. Complex interventions required to comprehensively educate allied health practitioners on evidence-based practice. Adv Med Educ Pract. 2011;2:105–8.

    Article  Google Scholar 

  40. Thomson O’Brien MA, Freemantle N, Oxman AD, Wolf F, Davis DA, Herrin J. Continuing education meetings and workshops: effects on professional practice and health care outcomes. Cochrane Database Syst Rev. 2001;2:CD003030.

    Google Scholar 

  41. Armstrong R, Waters E, Moore L, Riggs E, Cuervo LG, Lumbiganon P, Hawe P. Improving the reporting of public health intervention research: advancing TREND and CONSORT. J Public Health. 2008;30(1):103–39.

    Article  Google Scholar 

  42. Shepperd S, Lewin S, Straus S, Clarke M, Eccles MP, Fitzpatrick R, Wong G, Sheikh A. Can we systematically review studies that evaluate complex interventions? PLoS Med. 2009;6:e1000086.

    Article  Google Scholar 

References of excluded studies

  • Adams S, Titler MG. Strategies for promoting the development of evidence-based practice in an allied health profession. Annual in Therapeutic Recreation. 2007;15:1–11.

    Google Scholar 

  • Aiyer MK, Dorsch JL. The transformation of an EBM curriculum: A 10-year experience. Medical Teacher. 2008;30(4):377–83.

    Article  Google Scholar 

  • Allen ES, Connelly EN, Morris CD, Elmer PJ, Zwickey H. A train the trainer model for integrating evidence-based medicine into a complementary and alternative medicine training program. Explore: The Journal of Science & Healing. 2011;7(2):88–93.

    Article  Google Scholar 

  • Angel BF, Duffey M, Belyea M. An evidence-based project for evaluating strategies to improve knowledge acquisition and critical-thinking performance in nursing students. The Journal of nursing education. 2000;39(5):219–28.

    Google Scholar 

  • Antoni K, Knoppert D, Keim M, Woznuk S, Capewell V. Developing skills in critical appraisal. Canadian Nurse. 2003;99(6):24–7.

    Google Scholar 

  • Archambault ME. The Evidence-Based Medicine Advisor’s Challenge: Mentoring and Critiquing Students’ PubMed Search Methods. Journal of Physician Assistant Education. 2010;21(3):33–9.

    Article  Google Scholar 

  • Balakas K, Sparks L. Teaching research and evidence-based practice using a service-learning approach. Journal of Nursing Education. 2010;49(12):691–5.

    Article  Google Scholar 

  • Bannigan K, Birleson A. Getting to grips with evidence-based practice: The ten commandments. British Journal of Occupational Therapy. 2007;70(8):345–8.

    Article  Google Scholar 

  • Blake L, Balance D. Teaching evidence-based practice in the hospital and the library: two different groups, one course. Medical Reference Services Quarterly. 2013;32(1):100–10.

    Article  Google Scholar 

  • Brewer BB, Brewer MA, Schultz AA. A collaborative approach to building the capacity for research and evidence-based practice in community hospitals. Nursing Clinics of North America. 2009;44(1):11–25.

    Article  Google Scholar 

  • Brown CR, Johnson AS, Appling SE. A taste of nursing research: an interactive program introducing evidence-based practice and research to clinical nurses. Journal for Nurses in Staff Development - JNSD. 2011;27(6):E1–5.

    Article  Google Scholar 

  • Buchowski MS, Butts NL, Pichert JW. Dieticians’ changes following continuing education on nutrition management of hospitalized elderly. Journal of Nutrition for the Elderly. 2002;22(1):35–47.

    Article  Google Scholar 

  • Campbell L, Novak I. A KT intervention including the evidence alert system to improve clinician’s evidence-based practice behavior--a cluster randomized controlled trial. Implementation science. 2013;8:132.

    Article  Google Scholar 

  • Carrazzone D. Educational strategies for advancing evidence based practice: Providing best patient care. Dissertation Abstracts International: Section B: The Sciences and Engineering. 2009;70(5-B).

  • Chang S-C, Huang C-Y, Chen S-Y, Liao Y-C, Lin C-H, Wang H-H. Evaluation of a critical appraisal program for clinical nurses: a controlled before-and-after study. Journal of Continuing Education in Nursing. 2013;44(1):43–8.

    Article  Google Scholar 

  • Chappy S, Jambunathan J, Marnocha S. Evidence-based curricular strategies to enhance BSN graduates’ transition into practice. Nurse Educator. 2010;35(1):20–4.

    Article  Google Scholar 

  • Creedy DK, Horsfall J, Gamble J. Developing critical appraisal skills using a review of the evidence for postpartum debriefing. Australian journal of midwifery. 2002;15(4):3–9.

    Article  Google Scholar 

  • Curran CR, Roberts WD. Columbia University’s competency and evidence-based Acute Care Nurse Practitioner Program. Nursing Outlook. 2002;50(6):232–7.

    Article  Google Scholar 

  • Dawley K, Bloch JR, Suplee PD, McKeever A, Scherzer G. Using a pedagogical approach to integrate evidence-based teaching in an undergraduate women’s health course. Worldviews on evidence-based nursing/Sigma Theta Tau International, Honor Society of Nursing. 2011;8(2):116–23.

    Article  Google Scholar 

  • Fonteyn ME. Teaching advanced practice nursing students how to use the Internet to support an evidence-based clinical practice. AACN Clinical Issues. 2001;12(4):509–19.

    Article  Google Scholar 

  • Forrest JL, Miller SA. Integrating Evidence-based Decision Making into Allied Health Curricula. Journal of Allied Health. 2001;30(4):215–22.

    Google Scholar 

  • Goldgar C. Evidence-based medicine resources for physician assistant faculty: the turning research into practice (TRIP) database. Journal of Physician Assistant Education. 2008;19(3):37–41.

    Article  Google Scholar 

  • Goldsmith SC. Enhancing knowledge of evidence-based practice and integration into nursing practice through use of EBP workout sessions. Critical Care Nurse. 2009;29(2):e9-e.

  • Grant M, Hanson J, Johnson S, Idell C, Rutledge DN. Evidence-based practice for staff nurses. The Journal of Continuing Education in Nursing. 2012;43(3):117–24.

    Article  Google Scholar 

  • Green A, Jeffs D, et al. Increasing capacity for evidence-based practice through the evidence-based practice academy. Journal of continuing education in nursing. 2014;45(2):83–90.

    Article  Google Scholar 

  • Jacobs SK, Rosenfeld P, Haber J. Information literacy as the foundation for evidence-based practice in graduate nursing education: A curriculum-integrated approach. Journal of Professional Nursing. 2003;19(5):320–8.

    Article  Google Scholar 

  • Johnson E, Bartholomay M, Curran J, Finn S, Lyons H. An integrated education program to support evidence-based oncology nursing practice. Oncology Nursing Forum. 2008;35(3):539–40.

    Google Scholar 

  • Jones SC, Crookes PA, Johnson KM. Teaching critical appraisal skills for nursing research. Nurse Education in Practice. 2011;11(5):327–32.

    Article  Google Scholar 

  • Justham D, Timmons S. An evaluation of using a web-based statistics test to teach statistics to post-registration nursing students. Nurse Education Today. 2005;25(2):156–63.

    Article  Google Scholar 

  • Kamin C, Glicken A, Hall M, Quarantillo B, Merenstein G. Evaluation of electronic discussion groups as a teaching/learning strategy in the evidence-based medicine course: A pilot study. Education for Health. 2001;14(1):21–32.

    Article  Google Scholar 

  • Keahey D, Goldgar C. Evidence-based medicine resources for physician assistant faculty: DynaMed. Journal of Physician Assistant Education. 2008;19(1):43–6.

    Article  Google Scholar 

  • Killeen MB, Barnfather JS. A successful teaching strategy for applying evidence-based practice. Nurse Educator. 2005;30(3):127–32.

    Article  Google Scholar 

  • Kirshbaum M. Translation to practice: A randomised, controlled study of an evidence-based booklet for breast-care nurses in the United Kingdom. [References]. Worldviews on Evidence Based Nursing. 2008;5(2):60–74.

    Article  Google Scholar 

  • Koivunen M, Valimaki M, Jakobsson T, Pitkanen A. Developing an evidence-based curriculum designed to help psychiatric nurses learn to use computers and the Internet. Journal of Professional Nursing. 2008;24(5):302–14.

    Article  Google Scholar 

  • Kulier R, Khan KS, Gulmezoglu AM, Carroli G, Cecatti JG, Germar MJ, et al. A cluster randomized controlled trial to evaluate the effectiveness of the clinically integrated RHL evidence -based medicine course. Reproductive Health. 2010;7(1).

  • Larmon BH, Varner LW. The integration of evidence-based practice and research utilization in associate degree nursing curriculum: An approach at Mississippi University for Women. Teaching & Learning in Nursing. 2011;6(4):167–71.

    Article  Google Scholar 

  • Macedo CR, Macedo EC, et al. Evaluation of a national evidence-based health care course via teleconference in a developing country. Journal of Evaluation in Clinical Practice. 2013;19(4):713–9.

    Article  Google Scholar 

  • Mackert M, Ball J, Lopez N. Health literacy awareness training for healthcare workers: Improving knowledge and intentions to use clear communication techniques. Patient Education and Counseling. 2011;85(3):e225–e8.

    Article  Google Scholar 

  • Mary S, Julie J, et al. Teaching evidence based practice and research through blended learning to undergraduate midwifery students from a practice based perspective. Nurse Education in Practice. 2014;14(2):220–4.

    Article  Google Scholar 

  • Matter S. Empower nurses with evidence-based knowledge. Nursing Management. 2006;37(12):34–7.

    Google Scholar 

  • McCleary-Jones V. Assessing nursing students’ knowledge of health literacy. Nurse Educator. 2012;37(5):214–7.

    Article  Google Scholar 

  • Rosenfeld P, Salazar-Riera N, Vieira D. Piloting an information literacy program for staff nurses: lessons learned. CIN: Computers, Informatics, Nursing. 2002;20(6):236–41. quiz 42–3.

    Google Scholar 

  • Schmidt NA. Chapter 13. Evidence-based practice in the nursing curriculum: ponderings on design and implementation. Annual Review of Nursing Education. 2008;6:237–54.

    Google Scholar 

  • Sebastian JG, Christman NJ, Howard PB, Lock SE, Free TA, Chlebowy DO, et al. Evidence-based practice and the advanced practice nurse: a curriculum for the future. Seminars in Perioperative Nursing. 2000;9(3):143–8.

    Google Scholar 

  • Simpson E, Courtney M. Implementation and evaluation of critical thinking strategies to enhance critical thinking skills in Middle Eastern nurses. International Journal of Nursing Practice. 2008;14(6):449–54.

    Article  Google Scholar 

  • Smith-Strom H, Nortvedt MW. Evaluation of evidence-based methods used to teach nursing students to critically appraise evidence. Journal of Nursing Education. 2008;47(8):372–5.

    Article  Google Scholar 

  • Wang W. The application and evaluation of an evidence-based nursing education program to clinical practice: Sigma Theta Tau International; 2005. 1p p.

  • Weng YH, Kuo KN, et al. Effectiveness of national evidence-based medicine competition in Taiwan. BMC Medical Education. 2013;13:66.

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. University of Witten/Herdecke, Faculty of Health, School of Nursing Science, Witten/Herdeke, Germany

    Lars Hecht

  2. RED Institute for Medical Research and Education, Mühlenkamp 5, 23758, Oldenburg, Germany

    Lars Hecht

  3. University of Hamburg, Faculty of Mathematics, Informatics and Natural Sciences, Unit of Health Sciences and Education, Hamburg, Germany

    Susanne Buhse

  4. Martin Luther University Halle-Wittenberg, Medical Faculty, Institute for Health and Nursing Science, Halle, Germany

    Gabriele Meyer

Authors
  1. Lars Hecht
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Susanne Buhse
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Gabriele Meyer
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Lars Hecht.

Additional information

Competing interests

The authors declare that they have no competing interests.

Authors’ contributions

LH, SB, and GM have made substantial contribution to the conception of the systematic review and interpretation of data. LH and SB performed the literature search, the selection of trials and the data extraction. LH, SB, and GM were involved in drafting and reviewing the manuscript. All three authors read and approved the final manuscript.

Additional file

Additional file 1: Table S1.

Effects of the interventions. (PDF 449 kb)

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Hecht, L., Buhse, S. & Meyer, G. Effectiveness of training in evidence-based medicine skills for healthcare professionals: a systematic review. BMC Med Educ 16, 103 (2016). https://doi.org/10.1186/s12909-016-0616-2

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12909-016-0616-2

Keywords

BMC Medical Education

ISSN: 1472-6920

Contact us