Abstract
Medical school admissions interviews are used to assess applicants’ nonacademic characteristics as advocated by the Association of American Medical Colleges’ Advancing Holistic Review Initiative. The objective of this study is to determine whether academic metrics continue to significantly influence interviewers’ scores in holistic processes by blinding interviewers to applicants’ undergraduate grade point averages (uGPA) and Medical College Admission Test (MCAT). This study examines academic and demographic predictors of interview scores for two applicant cohorts at the University of Michigan Medical School. In 2012, interviewers were provided applicants’ uGPA and MCAT scores; in 2013, these academic metrics were withheld from interviewers’ files. Hierarchical regression analysis was conducted to examine the influence of academic and demographic variables on overall cohort interview scores. When interviewers were provided uGPA and MCAT scores, academic metrics explained more variation in interview scores (7.9%) than when interviewers were blinded to these metrics (4.1%). Further analysis showed a statistically significant interaction between cohort and uGPA, indicating that the association between uGPA and interview scores was significantly stronger for the 2012 unblinded cohort compared to the 2013 blinded cohort (β = .573, P < .05). By contrast, MCAT scores had no interactive effects on interviewer scores. While MCAT scores accounted for some variation in interview scores for both cohorts, only access to uGPA significantly influenced interviewers’ scores when looking at interaction effects. Withholding academic metrics from interviewers’ files may promote assessment of nonacademic characteristics independently from academic metrics.
Similar content being viewed by others
References
Albanese, M. A., Snow, M. H., Skochelak, S. E., Huggett, K. N., & Farrell, P. M. (2003). Assessing personal qualities in medical school admissions. Academic Medicine, 78, 313–321.
Association of American Medical Colleges. (2010). Roadmap to diversity: Integrating holistic review principles into medical school admission processes. Washington, DC: Association of American Medical Colleges. Retrieved January 10, 2016 from https://members.aamc.org/eweb/upload/Roadmap%20to%20Diversity%20Integrating%20Holistic%20Review.pdf.
Association of American Medical Colleges. (2011). Medical school admissions: More than grades and test scores. Analysis in Brief: Association of American Medical Colleges. Retrieved 5 January 2016 from https://www.aamc.org/download/261106/data/ aibvol11_no6.pdf.
Association of American Medical Colleges. (2013). Roadmap to excellence: Key concepts for evaluating the impact of medical school holistic admissions. Washington, DC: Association of American Medical Colleges. Retrieved January 6, 2016 from https://members.aamc.org/eweb/upload/holistic%20review%202013.pdf.
Association of American Medical Colleges. (2015). U.S. medical school applicants and students, Table B1: U.S. medical school applicants, matriculants, enrollment, and graduates. In: AAMC data book data book. https://www.aamc.org/download/280222/data/tableb1.pdf. Retrieved January 8, 2016.
Association of American Medical Colleges-Howard Hughes Medical Institute Joint Committee. (2009). Scientific foundations for future physicians. Washington, DC: Association of American Medical Colleges and Howard Hughes Medical Institute. Retrieved January 10, 2016 from https://www.aamc.org/download/271072/data/scientificfoundationsforfuturephysicians.pdf.
Clayton, O., Baird, A. C., & Levinson, R. M. (1984). Subjective decision making in medical school admissions: Potentials for discrimination. Sex Roles, 10, 527–532.
Donnon, T., Paolucci, E. O., & Violato, C. (2007). The predictive validity of the MCAT for medical school performance and medical board licensing examinations: A meta-analysis of the published research. Academic Medicine, 82, 100–106.
Edwards, J. C., Johnson, E. K., & Molidor, J. B. (1990). The interview in the admission process. Academic Medicine, 65, 167–177.
Edwards, J. C., Johnson, E. K., & Molidor, J. B. (1996). Admission to medical school: International perspectives. Advances in Health Sciences Education, 1, 3–16.
Elam, C. L., & Andrykowski, M. A. (1991). Admission interview ratings: Relationship to applicant academic and demographic variable and interviewer characteristics. Academic Medicine, 66, S13–S15.
Goho, J., & Blackman, A. (2006). The effectiveness of academic admission interviews: An exploratory meta-analysis. Medical Teacher, 28, 335–340.
Griffin, B. N., & Wilson, I. G. (2010). Interviewer bias in medical student selection. Medical Journal of Australia, 193, 343–346.
IBM Corp. (2013). IBM SPSS statistics for windows, Version 22.0. Armonk, NY: IBM Corp.
Jaccard, J., & Turrisi, R. (2003). Interaction effects in multiple regression (2nd ed.). Thousand Oaks, CA: SAGE.
Kirch, D. G. (2012). Transforming admissions: The gateway to medicine. Journal of American Medical Association, 308, 2250–2251.
Kreiter, C. D., & Kreiter, Y. (2007). A validity generalization perspective on the ability of undergraduate GPA and the medical college admission test to predict important outcomes. Teaching and Learning in Medicine, 19, 95–100.
Monroe, A., Quinn, E., Samuelson, W., Dunleavy, D. M., & Dowd, K. W. (2013). An overview of the medical school admission process and use of applicant data in decision making: What has changed since the 1980s? Academic Medicine, 88, 672–681.
Morris, J. G. (1999). The value and role of the interview in the student admissions process: A review. Medical Teacher, 21, 473–481.
Price, P. B., Lewis, E. G., Loughmiller, G. C., Nelson, D. E., Murray, S. L., & Taylor, C. W. (1971). Attributes of a good practising physician. Journal of Medical Education, 46, 229–237.
Salvatori, P. (2001). Reliability and validity of admissions tools used to select students for the health professions. Advances in Health Sciences Education, 6, 159–175.
Shaw, D. L., Martz, D. M., Lancaster, C. J., & Sade, R. M. (1995). Influence of medical school applicants’ demographic and cognitive characteristics on interviewers’ ratings of noncognitive traits. Academic Medicine, 70, 532–536.
Terregino, C. A., McConnell, M., & Reiter, H. I. (2015). The effect of differential weighting of academics, experiences, and competencies measured by multiple mini interview (MMI) on race and ethnicity of cohorts accepted to one medical school. Academic Medicine, 90, 1651–1657.
Witzburg, R. A., & Sondheimer, H. M. (2013). Holistic review—Shaping the medical profession one applicant at a time. New England Journal of Medicine, 368, 1565–1567.
Acknowledgements
The authors wish to thank Larry Gruppen, Ph.D. and Jim Cranford, Ph.D. for their contributions to this paper. The University of Michigan has an Acceleration Change in Medical Education grant from the American Medical Association.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Gay, S.E., Santen, S.A., Mangrulkar, R.S. et al. The influence of MCAT and GPA preadmission academic metrics on interview scores. Adv in Health Sci Educ 23, 151–158 (2018). https://doi.org/10.1007/s10459-017-9779-9
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10459-017-9779-9