Skip to main content
Top
Gepubliceerd in: Perspectives on Medical Education 6/2016

Open Access 01-12-2016 | PhD Report

Educating physicians in evidence based medicine: current practices and curricular strategies

Auteur: Lauren A. Maggio

Gepubliceerd in: Perspectives on Medical Education | Uitgave 6/2016

share
DELEN

Deel dit onderdeel of sectie (kopieer de link)

  • Optie A:
    Klik op de rechtermuisknop op de link en selecteer de optie “linkadres kopiëren”
  • Optie B:
    Deel de link per e-mail
insite
ZOEKEN

Abstract

Introduction

Evidence-based medicine (EBM) is an expectation of professional healthcare and a requisite component of medical school curricula. However, upon graduation medical students’ EBM skills have been found lacking suggesting a need to examine EBM training.

Methods

This PhD report presents two studies on EBM education. The first study is a literature review that describes and attempts to assess educational interventions for teaching medical students EBM. The second study presents a multi-institutional case study conducted in North America using interviews and curricular materials to identify EBM instructors’ perceptions of challenges that may impede medical students’ efforts to learn EBM.

Results

The literature review analyzed 20 learning interventions from 12 countries that were presented in classrooms (75 %) and clinics (25 %). The steps of EBM were addressed to varying degrees. It was not possible to draw conclusions about the efficacy of the interventions due to lack of detailed reporting. The qualitative study identified four learning challenges: sub-optimal role models, student lack of willingness to admit uncertainty, lack of clinical context, and difficulty mastering EBM skills. To meet these challenges, participants described interventions such as integrating EBM skills with other content/courses, incorporating clinical content into EBM teaching, providing faculty development, using whole-task EBM activities, and longitudinal integration of EBM across the curriculum.

Conclusion

This PhD report takes steps to describe and assess EBM learning interventions, presents student learning challenges and looks at approaches institutions take to meet them. Educators can use these findings to examine their curriculum and learning environments and, if desired, adopt them for their training.
Opmerkingen
Disclaimer: The views expressed in this article are those of the author and do not necessarily reflect the official policy or position of the Uniformed Services University of the Health Sciences, the Department of Defense, or the US Government.

Introduction

The practice of evidence-based medicine (EBM) ideally combines available research evidence, physician expertise, and the patient’s wishes [1]. The steps of EBM include clinicians recognizing a gap in their knowledge, articulating the gap as a clinical question, acquiring and appraising relevant evidence, applying the evidence to the patient’s care, and evaluating their practice in light of the evidence [2]. Since its introduction over 20 years ago, EBM has become the gold standard of clinical practice [3] and key component of most medical schools’ curricula [4].
Despite curricular integration of EBM, researchers have found clerkship-level medical students able to execute only half of the steps of EBM with difficulties especially in critically appraising the evidence found [5]. This deficiency suggests a need for future research to focus on the effectiveness of EBM interventions and educational approaches designed to overcome these challenges. Therefore, we performed four studies to explore how EBM is practised and taught to medical students. This PhD report focuses on two of these studies that describe educational interventions for learning EBM and EBM instructors’ perceptions of challenges that may impede medical students’ efforts to learn EBM.

Methods

We reviewed the literature on educational interventions to teach medical students EBM skills published between 2006–2011 by searching MEDLINE, Scopus, Evidence-Based Medicine Reviews, and ERIC using relevant medical subject headings and keywords [6]. Articles were excluded that did not include medical students, focused on a single EBM skill, or only examined existing EBM knowledge, skills, or attitudes. Relevant full-text articles were reviewed and data extracted to characterize educational settings, EBM skills covered, teaching methods used, learners and instructors. Using the Best Evidence in Medical Education collaboration’s modified four-level Kirkpatrick’s hierarchy, we attempted to evaluate the impact of the interventions on 1) learners’ views of the intervention, 2a) learners’ attitudes towards the intervention, 2b) learners’ modification of EBM knowledge or skills, 3) learners’ EBM behaviour changes, changes in organizational practice, or 4) benefits to patient care [7]. We utilized Khan’s hierarchy of EBM teaching and learning methods to rate learning activities based on its three levels. Level 1 activities are interactive, such as case discussions or role play scenarios, and clinically integrated in that they include clinical content or are implemented in clinical settings. Level 2(a) activities are interactive, but classroom-based. Level 2(b) includes didactic (lecture-based) but clinically integrated activities. Level 3, includes didactic, classroom-based activities [8].
We next conducted a multi-institutional case study to identify challenges that may impede students in learning EBM and the educational approaches employed to overcome them [9]. Using a semi-structured interview protocol, we interviewed 31 EBM instructors (17 clinicians, 11 librarians, 2 educationalists, and 1 epidemiologist) from 17 medical schools (13 in the United States; 4 in Canada) that were identified as graduating students confident in their EBM abilities based on the Association of American Medical Colleges Graduation Questionnaire (GQ). The GQ represents self-reported data from graduating medical students in North America related to their medical school experience. We elected to interview instructors instead of students because we felt they would be most knowledgeable about their institution’s EBM curriculum. Additionally, we believed that EBM instructors over time would have encountered multiple medical students and could speak of their varied student experiences with challenges and the institution’s curricular attempts to meet them. Thirteen participating institutions also supplied curricular materials for review. We inductively analyzed the interviews and created profiles of each institution’s EBM training. Based on these profiles, we identified, through rounds of discussion, EBM learning challenges and educational approaches used by the institutions to meet them.

Results

Our literature review identified 20 educational interventions from 12 countries that were presented in classrooms (75 %) and clinics (25 %). Twenty percent of interventions also included online components. Interventions addressed the steps of EBM to varying degrees (Table 1). We were unable to draw conclusions about the efficacy of interventions using Kirkpatrick’s hierarchy [8] due to lack of detailed reporting. Based on Khan’s three-level hierarchy, we determined that 40 % were level 1 (interactive and clinically integrated), 40 % were level 2a (interactive, but classroom based) or 2b (didactic, but clinically integrated), and 20 % level 3 (didactic, classroom-based).
Table 1
Coverage of evidence-based medicine steps in educational interventions
EBM Steps
Number of interventions including the step
Step 1: Recognizing a knowledge gap
4 (20 %)
Step 2: Articulating a clinical question
18 (90 %)
Step 3: Acquiring information
18 (90 %)
Step 4: Appraising information
17 (85 %)
Step 5: Applying evidence to patient care
13 (65 %)
Step 6: Evaluating practice
1 (5 %)
By analyzing EBM instructor interviews and curricular materials, we identified instructors’ perceptions of four student challenges or factors that may impede students’ ability to learn EBM: sub-optimal role models, student lack of willingness to admit uncertainty, lack of clinical context, and difficulty mastering EBM skills. The observation of sub-optimal role models was described with particular concern. Participants feared sub-optimal role models might discourage EBM practice by exhibiting poor attitudes towards EBM, demonstrating weak EBM skills, and failing to make explicit their use of EBM in clinical practice. Participants reported several approaches to overcome these challenges. Five of the approaches were most commonly applied, namely integrating EBM skills with other content/courses, incorporating clinical content into EBM teaching, providing faculty development, using whole-task EBM activities, and longitudinal integration of EBM across the curriculum. For example, institutions described faculty development efforts that trained instructors to be cognizant of their status as EBM role models and vocalize their uncertainty in conjunction with walking students through their execution of all EBM steps.

Discussion

Based on a review of the literature, this PhD report aims to describe how EBM is taught and to assess the effectiveness of the teaching approaches. Additionally, based on interviews with North American EBM instructors, it identifies challenges that impede students in learning EBM and potential approaches to overcoming them. Unfortunately, in our literature review, due to lack of reporting in the reviewed articles, we were unable to draw conclusions as to the efficacy of the interventions, which aligns with recent systematic reviews of EBM education [10, 11]. This lack of detail is a weakness, which hopefully will be remedied by recently published guidelines for reporting EBM educational interventions [12].
Based on our findings and experiences as EBM instructors and practitioners, we propose several recommendations for modifying EBM training. For example, we noted that the first (recognizing a knowledge gap) and last (evaluating practice) EBM steps are not well covered. Research suggesting that students struggle with critical appraisal skills [5] may indicate that these skills are more difficult for students to master and may explain why less attention is paid to the first and last steps. However, based on our finding that students lack willingness to admit uncertainty, which directly impacts their ability to recognize knowledge gaps, and medicine’s emphasis on continuous improvement we recommend EBM training take a more comprehensive approach to include all EBM steps. Future research should investigate the difficulty levels of all EBM steps to inform instructors in their approach to training. Additionally, most interventions targeted clinical-level students. However, research indicates that introducing preclinical students to EBM raises learners’ self-efficacy in practising EBM and the likelihood that they will continue to practise EBM [13]. Therefore, we suggest that EBM training be introduced in preclinical training. As a literature review, this study has limitations, including only capturing published interventions. It is possible institutions provide students robust EBM training, but their efforts are unpublished.
Our interviews with EBM instructors indicated that while the students at their institutions reported confidence in their EBM abilities, instructors felt that the challenges identified hindered students in learning EBM. The identification of these learning challenges adds to the EBM literature, which has previously focused on describing the barriers residents face when practising EBM [14]. These findings provide educators a window into the student experience of learning EBM and may inform future training. Related to the challenges, we identified five approaches to overcome them as described by the participating institutions. Although we have no empirical proof of their efficacy for EBM training or overcoming these challenges, we encourage EBM instructors to consider them in their design of EBM training, as they are consistent with learning theory. For example, the suggestion to integrate EBM training into clinical settings aligns with situated learning theory that encourages that learning be set in the context of the culture and place in which it naturally occurs [15].
While this study provides new insights into student learning challenges and educational approaches, it has limitations. Although participants described their approaches to meet the identified student challenges it was not possible for us to determine if they would be necessarily appropriate for other institutions. Additionally, we conducted interviews with only North American participants. While our findings may be relevant to EBM educators outside of North America, future researchers might seek to interview a more global sample of EBM educators to confirm and expand the identified challenges and approaches.

Conclusion

In this PhD report, we have described EBM learning interventions for medical students and noted an imbalance in the coverage of EBM steps, such that the first (recognizing a knowledge gap) and last (evaluating practice) steps are less well covered. Based on our finding that students lack willingness to admit uncertainty, which impacts their ability to recognize knowledge gaps, and medicine’s emphasis on continuous improvement, we recommend EBM training take a more comprehensive approach to include all the EBM steps. Based on interviews, we also identified student learning challenges, including a notable concern about suboptimal faculty role models, and the approaches that institutions take to meet them, such as faculty development. We hope our findings will inform EBM educators and inspire future EBM research.

Advice

Completing a PhD can be long and lonely endeavour. Early in the process find a writing partner that you can meet in-person or check-in with online. Your writing partner will help you stay focused and productive.

Acknowledgements

I would like to thank my promoters Drs. Olle ten Cate, David Irby and Bridget O’Brien for their ongoing support and generosity of time and mind. I am also thankful for the faculty members Drs. Patricia O’Sullivan, Christy Boscardin and Arianne Teherani and my cohort members Drs. Carrie Chen, Karen Hauer and John Young of our joint University of Utrecht and University of California, San Francisco doctoral program in Health Professions Education.

University Information

The defense took place at the University of Utrecht in the Netherlands on 10 September 2015. This doctorate was a joint program between the University of Utrecht and the University of California, San Francisco. The (co)promoters were Professor Olle ten Cate (University of Utrecht), Professor David Irby (University of California, San Francisco) and Dr. Bridget O’Brien (University of California, San Francisco). The thesis is available online via the university library: http://​dspace.​library.​uu.​nl/​handle/​1874/​317367.

Funding

Funding for Dr. Maggio’s doctoral studies were provided by Stanford University School of Medicine.

Conflict of interest

L. A. Maggio state that she has no competing interest.
Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://​creativecommons.​org/​licenses/​by/​4.​0/​), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.
share
DELEN

Deel dit onderdeel of sectie (kopieer de link)

  • Optie A:
    Klik op de rechtermuisknop op de link en selecteer de optie “linkadres kopiëren”
  • Optie B:
    Deel de link per e-mail
Literatuur
1.
go back to reference Evidence Based Medicine Working Group. Evidence-based medicine a new approach to teaching the practice of medicine. JAMA. 1992;268:2420–5.CrossRef Evidence Based Medicine Working Group. Evidence-based medicine a new approach to teaching the practice of medicine. JAMA. 1992;268:2420–5.CrossRef
2.
go back to reference Straus SE, Richardson WS, Glasziou P, Haynes RB. Evidence-based medicine: how to practice and teach EBM. Philadelphia: Elsevier; 2005. Straus SE, Richardson WS, Glasziou P, Haynes RB. Evidence-based medicine: how to practice and teach EBM. Philadelphia: Elsevier; 2005.
3.
go back to reference Charles C, Gafini A, Freeman E. The evidence-based medicine model of clinical practice: scientific teaching or belief-based preaching? J Eval Clin Pract. 2011;17:597–605.CrossRef Charles C, Gafini A, Freeman E. The evidence-based medicine model of clinical practice: scientific teaching or belief-based preaching? J Eval Clin Pract. 2011;17:597–605.CrossRef
4.
go back to reference Tilson JK, Kaplan SL, Harris JL, et al. Sicily statement on classification and development of evidence-based practice learning assessment tools. BMC Med Educ. 2011;11:78.CrossRef Tilson JK, Kaplan SL, Harris JL, et al. Sicily statement on classification and development of evidence-based practice learning assessment tools. BMC Med Educ. 2011;11:78.CrossRef
6.
go back to reference Maggio LA, Tannery NH, Chen HC, et al. Evidence-based medicine training in undergraduate medical education: a review and critique of the literature published 2006–2011. Acad Med. 2013;88:1022–8.CrossRef Maggio LA, Tannery NH, Chen HC, et al. Evidence-based medicine training in undergraduate medical education: a review and critique of the literature published 2006–2011. Acad Med. 2013;88:1022–8.CrossRef
8.
go back to reference Khan KS, Coomarasamy A. A hierarchy of effective teaching and learning to acquire competence in evidence-based medicine. BMC Med Educ. 2006;6:59.CrossRef Khan KS, Coomarasamy A. A hierarchy of effective teaching and learning to acquire competence in evidence-based medicine. BMC Med Educ. 2006;6:59.CrossRef
9.
go back to reference Maggio LA, ten Cate O, Chen HC, Irby DM, O’Brien BC. Challenges to learning evidence-based medicine and educational approaches to meet these challenges: a qualitative study of selected EBM curricula in US and Canadian medical schools. Acad Med. 2016;91:101–6.CrossRef Maggio LA, ten Cate O, Chen HC, Irby DM, O’Brien BC. Challenges to learning evidence-based medicine and educational approaches to meet these challenges: a qualitative study of selected EBM curricula in US and Canadian medical schools. Acad Med. 2016;91:101–6.CrossRef
10.
go back to reference Ahmadi SF, Baradaran HR, Ahmadi E. Effectiveness of teaching evidence-based medicine to undergraduate medical students: a BEME systematic review. Med Teach. 2015;37:21–30.CrossRef Ahmadi SF, Baradaran HR, Ahmadi E. Effectiveness of teaching evidence-based medicine to undergraduate medical students: a BEME systematic review. Med Teach. 2015;37:21–30.CrossRef
11.
go back to reference Ilic D, Maloney S. Methods of teaching medical trainees evidence-based medicine: a systematic review. Med Educ. 2014;48:124–35.CrossRef Ilic D, Maloney S. Methods of teaching medical trainees evidence-based medicine: a systematic review. Med Educ. 2014;48:124–35.CrossRef
12.
go back to reference Phillips AC, Lewis LK, McEvoy MP, et al. A Delphi survey to determine how educational interventions for evidence-based practice should be reported: Stage 2 of the development of a reporting guideline. BMC Med Educ. 2014;14(31):1. Phillips AC, Lewis LK, McEvoy MP, et al. A Delphi survey to determine how educational interventions for evidence-based practice should be reported: Stage 2 of the development of a reporting guideline. BMC Med Educ. 2014;14(31):1.
13.
go back to reference Nieman LZC, Foxhall LE. Teaching first-year medical students to apply evidence-based practices to patient care. Fam Med. 2009;41:332–6. Nieman LZC, Foxhall LE. Teaching first-year medical students to apply evidence-based practices to patient care. Fam Med. 2009;41:332–6.
14.
go back to reference van Dijk N, Hooft L, Wieringa-de Waard M. Wht are the barriers to residents’ practicing evidence-based medicine? A systematic review. Acad Med. 2010;85:1163–70.CrossRef van Dijk N, Hooft L, Wieringa-de Waard M. Wht are the barriers to residents’ practicing evidence-based medicine? A systematic review. Acad Med. 2010;85:1163–70.CrossRef
15.
go back to reference Lave J, Wenger E. Situated learning: Legitimate peripheral participation. Cambridge: Cambridge University Press; 1991.CrossRef Lave J, Wenger E. Situated learning: Legitimate peripheral participation. Cambridge: Cambridge University Press; 1991.CrossRef
Metagegevens
Titel
Educating physicians in evidence based medicine: current practices and curricular strategies
Auteur
Lauren A. Maggio
Publicatiedatum
01-12-2016
Uitgeverij
Bohn Stafleu van Loghum
Gepubliceerd in
Perspectives on Medical Education / Uitgave 6/2016
Print ISSN: 2212-2761
Elektronisch ISSN: 2212-277X
DOI
https://doi.org/10.1007/s40037-016-0301-5

Andere artikelen Uitgave 6/2016

Perspectives on Medical Education 6/2016 Naar de uitgave

Statistical Points and Pitfalls

Effect size – large, medium, and small