Swipe om te navigeren naar een ander artikel
The online version of this article (https://doi.org/10.1007/s40037-018-0449-2) contains supplementary material, which is available to authorized users.
To develop lifelong learning skills, students need feedback, access to performance data, and coaching. A new medical curriculum incorporated infrastructural supports based on self-regulated learning theory and the Master Adaptive Learner framework to engage students in reflection and learning planning. This study examines students’ experience with a performance dashboard, longitudinal coaching, and structured time for goal-setting.
Focus groups with first-year medical students explored performance dashboard usage, coaching and learning planning. We analyzed findings using thematic analysis. Results informed development of a 29-item survey rated strongly disagree (1) to strongly agree (5) to investigate experience with the dashboard, coaching and learning goals program. The survey was distributed to one first-year medical student class. We performed descriptive statistics and factor analysis.
In three focus groups with 21 participants, students endorsed using the dashboard to access performance information but had trouble interpreting and integrating information. They valued coaches as sources of advice but varied in their perceptions of the value of discussing learning planning. Of 152 students, 114 (75%) completed the survey. Exploratory factor analysis yielded 5 factors explaining 57% of the variance: learning goals development (α = 0.88; mean 3.25 (standard deviation 0.91)), dashboard usage (α = 0.82; 3.36 (0.64)), coaching (α = 0.71; 3.72 (0.64)), employment of learning strategies (α = 0.81; 3.67 (0.79)), and reflection (α = 0.63; 3.68 (0.64)).
The student performance dashboard provides efficient feedback access, yet students’ use of this information to guide learning is variable. These results can inform other programs seeking to foster lifelong learning skills.
Appendix 1. Focus Group Facilitator Script40037_2018_449_MOESM1_ESM.docx
Swing SR. The ACGME outcome project: retrospective and prospective. Med Teach. 2007;29:648–54. CrossRef
Royal College of Physicians and Surgeons of Canada. The CanMEDS framework. 2014. http://www.royalcollege.ca/portal/page/portal/rc/canmeds/framework. Accessed 23 Jan 2015.
Bokova I. UNESCO education strategy 2014–2021. Paris: United Nations Educational, Scientific, and Cultural Organization; 2014p. pp. 1–63.
Murdoch-Eaton D, Whittle S. Generic skills in medical education: developing the tools for successful lifelong learning. Med Educ. 2012;46:120–8. CrossRef
Grant H, Dweck CS. Clarifying achievement goals and their impact. J Pers Soc Psychol. 2003;85:541–53. CrossRef
Teunissen PW. Experience, trajectories, and reifications: an emerging framework of practice-based learning in healthcare workplaces. Adv Health Sci Educ Theory Pract. 2015;20:843–56. CrossRef
Cutrer WB, Miller B, Pusic MV, et al. Fostering the development of master adaptive learners: a conceptual model to guide skill acquisition in medical education. Acad Med. 2017;92:70–5. CrossRef
Zimmerman BJ. Self-regulated learning and academic achievement: an overview. Educ Psychol. 1990;25:3–17. CrossRef
Sargeant J, Armson H, Chesluk B, et al. The processes and dimensions of informed self-assessment: a conceptual model. Acad Med. 2010;85:1212–20. CrossRef
Srinivasan M, Hauer KE, Der-Martirosian C, Wilkes M, Gesundheit N. Does feedback matter? Practice-based learning for medical students after a multi-institutional clinical performance examination. Med Educ. 2007;41:857–65. CrossRef
Hawkins SC1, Osborne A, Schofield SJ, Pournaras DJ, Chester JF. Improving the accuracy of self assessment of practical clinical skills using video feedback – the importance of including benchmarks. Med Teach. 2012;34:279–84. CrossRef
Boscardin C, Fergus KB, Hellevig B, Hauer KE. Twelve tips to promote successful development of a learner performance dashboard within a medical education program. Med Teach. 2017; https://doi.org/10.1080/0142159x.2017.1396306. CrossRef
Sargeant J, Eva KW, Armson H, et al. Features of assessment learners use to make informed self-assessments of clinical performance. Med Educ. 2011;45:636–47. CrossRef
Creswell J, Clark V. Designing and conducting mixed methods research. 2nd ed. Thousand Oaks: SAGE; 2011.
Schifferdecker KE, Reed VA. Using mixed methods research in medical education: basic guidelines for researchers. Med Educ. 2009;43:637–44. CrossRef
MD Competencies | UCSF Medical Education | Medical Student Education [Internet]. [cited 2018 Jan 18]. Available from: https://meded.ucsf.edu/md-program/current-students/curriculum/md-competencies
Hauer KE, O’Sullivan PS, Fitzhenry K, Boscardin C. Translating theory into practice: implementing a program of assessment. Acad Med. 2018;93:444–50. CrossRef
Spickard A III, Ahmed T, Lomis K, Johnson K, Miller B. Changing medical school IT to support medical education transformation. Teach Learn Med. 2016;28:80–7. CrossRef
Mitchell. Developing and using dashboard indicators in student affairs assessment—new directions for student services—Wiley Online library. 2013. http://onlinelibrary.wiley.com/doi/10.1002/ss.20050/full. Accessed 29 Jan 2018.
Conzemius A, O’Neill J. The power of SMART goals: using goals to improve student learning. Bloomington: Solution Tree; 2009.
Dye JF, Schatz IM, Rosenberg BA, Coleman ST. Constant comparison method: a kaleidoscope of data. Qual Rep. 2000;4:1–9.
Barry CA, Britten N, Barber N, Bradley C, Stevenson F. Using reflexivity to optimize teamwork in qualitative research. Qual Health Res. 1999;9:26–44. CrossRef
Artino AR, La Rochelle JS, Dezee KJ, Gehlbach H. Developing questionnaires for educational research: AMEE guide no. 87. Med Teach. 2014;36:463–74. CrossRef
Bartholomew DJ, Knott M, Moustaki I. Latent variable models and factor analysis: a unified approach. Hoboken: John Wiley & Sons; 2011. CrossRef
Stevens J. Applied multivariate statistics for the social sciences. 3rd ed. Mahwah: Erlbaum; 1996.
Lockspeiser TM, Li S‑TT, Burke AE, et al. In pursuit of meaningful use of learning goals in residency: a qualitative study of pediatric residents. Acad Med. 2016;91:839–46. CrossRef
Murphy D, Aitchison P, Hernandez Santiago V, Davey P, Mires G, Nathwani D. Insightful practice: a robust measure of medical students’ professional response to feedback on their performance. BMC Med Educ. 2015;15:125. CrossRef
van der Leeuw RM, Teunissen PW, van der Vleuten CPM. Broadening the scope of feedback to promote its relevance to workplace learning. Acad Med. 2018; https://doi.org/10.1097/acm.0000000000001962. CrossRef
Davis DA, Mazmanian PE, Fordis M, Van Harrison R, Thorpe KE, Perrier L. Accuracy of physician self-assessment compared with observed measures of competence: a systematic review. JAMA. 2006;296:1094–102. CrossRef
Lovell B. What do we know about coaching in medical education? A literature review. Med Educ. 2018;52:376–90. CrossRef
Telio S, Ajjawi R, Regehr G. The “educational alliance” as a framework for reconceptualizing feedback in medical education. Acad Med. 2015;90:609–14. CrossRef
Dweck CS. Motivational processes affecting learning. Am Psychol. 1986;41(10):1040–8. CrossRef
Zimmerman BJ. Self-efficacy: an essential motive to learn. Contemp Educ Psychol. 2000;25:82–91. CrossRef
Durning SJ, Cleary TJ, Sandars J, Hemmer P, Kokotailo P, Artino AR. Perspective: viewing “strugglers” through a different lens: how a self-regulated learning perspective can help medical educators with assessment and remediation. Acad Med. 2011;86:488–95. CrossRef
- Fostering medical students’ lifelong learning skills with a dashboard, coaching and learning planning
Karen E. Hauer
- Bohn Stafleu van Loghum