Skip to main content
SpringerLink
Log in

Reliability and Validity of Admissions Tools Used to Select Students for the Health Professions

  • Published:
Advances in Health Sciences Education Aims and scope Submit manuscript

Abstract

The selection of students for the health professions is typically a very competitive multi-staged process that includes assessment of both cognitive abilities and personal qualities. The need for reliable and valid assessment measures is obvious. This review of the health professions literature examines the evidence to support the use of various selection tools. It is clear that pre-admission overall grade point average (GPA) is the best predictor of academic performance in all of the health professions; however, the relationship between pre-admission GPA and clinical performance is less clear. The Medical College Admission Test is a good predictor of performance of medical students in terms of in-course grades and licencing examination scores but a similar test does not exist in the other health professions. Controversy remains as to the value of personal interviews and written submissions as selection tools, although it is clear that training of assessors and explicit rating guidelines enhance their reliability and validity. Ongoing research is needed to find more reliable and valid ways of assessing non-cognitive characteristics of applicants.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  • Agho, A.O., Mosley, B.W. & Smith-Paul, B. (1998). Use of interview in selecting students for occupational therapy programs. American Journal of Occupational Therapy 52: 592-594.

    Google Scholar 

  • Alexander, J.E. & Brophy, G.H. (1997). A five-year study of graduates' performance on NCLEX-RN. Journal of Nursing Education 36: 443-445.

    Google Scholar 

  • Alichnie, M. & Bellucci, J. (1981). Prediction of freshman students' success in a baccalaureate nursing program. Nursing Research 30: 49-53.

    Google Scholar 

  • Altmaier, E.M., Smith,W.L., O'Halloran, C.M. & Franken, E.A., Jr. (1992). The predictive utility of behavior-based interviewing compared with traditional interviewing in the selection of radiology residents. Investigative Radiology 25: 385-389.

    Google Scholar 

  • Baker, J., Douphrate, D. & Ridley, D. (1996). The use of the Revised PSB-Health Occupations Aptitude Examination as a predictor of success in physical therapy students. Journal of Physical Therapy Education 10: 63-67.

    Google Scholar 

  • Balogun, J.A. (1987). Predictive validity of the Allied Health Professions Admissions Test. Physiotherapy Canada 39: 39-42.

    Google Scholar 

  • Balogun, J.A. (1988). Predictors of academic and clinical performance in a baccalaureate physical therapy program. Physical Therapy 68: 238-242.

    Google Scholar 

  • Balogun, J.A., Karacoloff, L.A. & Farina, N.T. (1986). Predictors of academic achievement in physical therapy. Physical Therapy 66: 976-980.

    Google Scholar 

  • Bauwens, E. & Gerhard, G. (1987). The use of the Watson Glaser Critical Thinking Appraisal to predict success in a baccalaureate nursing program. Journal of Nursing Education 26: 278-281.

    Google Scholar 

  • Berchulc, C.M., Wade, G.A. & Seider, K.K. (1987). Predicting academic achievement of undergraduate occupational therapy students: Preliminary results. Occupational Therapy Journal of Research 7: 245-248.

    Google Scholar 

  • Boyd, M.A., Graham, J.W., Teteruck, W.R. & Krupka, J. (1983). Development and implementation of a structured interview for dental admissions. Journal of the Canadian Dental Association 3: 181-185.

    Google Scholar 

  • Bridle, M.J. (1987). Student selection: a comparison of three methods. Canadian Journal of Occupational Therapy 54: 113-117.

    Google Scholar 

  • Brown, B., Carpio, B. & Roberts, J. (1991). The use of an autobiographical letter in the nursing admissions process: Initial reliability and validity. Canadian Journal of Nursing Research 23(2): 9-20.

    Google Scholar 

  • Campbell, A.R. & Dickson, C.J. (1996). Predicting student success: A 10-year review using integrative review and meta-analysis. Journal of Professional Nursing 12: 47-59.

    Article  Google Scholar 

  • Cariaga-Lo, L.D., Enarson, C.E., Crandall, S.J., Zaccaro, D.J. & Richards, B.E. (1997). Cognitive and noncognitive predictors of academic difficulty and attrition. Academic Medicine 72 (October Supplement): S69-S71.

    Google Scholar 

  • Carpio, B. & Brown, B. (1993). The admissions process of a bachelor of science in nursing program: Initial reliability and validity of the personal interview. Canadian Journal of Nursing Research 25(3): 41-52.

    Google Scholar 

  • Carpio, B., O'Mara, L. & Hezekiah, J. (1996). Predictors of success on the Canadian Nurses Association testing service (CNATS) examination. Canadian Journal of Nursing Research 28(4): 115-123.

    Google Scholar 

  • Devaul, R.A., Jervey, F., Chappell, J.A., Caver, P., Short, B. & O'Keefe, S. (1987). Medical school performance of initially rejected students. Journal of the American Medical Association 257: 47-51.

    Article  Google Scholar 

  • Dietrich, M.C. (1981). Putting objectivity in the allied health student selection process. Journal of Allied Health 10: 226-239.

    Google Scholar 

  • Dietrich, M.C. & Crowley, J.A. (1982). A national study of student selection practices in the allied health professions. Journal of Allied Health 11: 248-260.

    Google Scholar 

  • Dunbar, S.B. (1992). Review of the PSB-Health Occupations Aptitude Examination. In J.J. Kramer & J.C. Conoley (eds.), The Eleventh Mental Measurements Yearbook. The Buros Institute of Mental Measurements, pp. 716-718. Lincoln, NE: The University of Nebraska Press.

    Google Scholar 

  • Edwards, J.C., Johnson, E.K. & Molidar, J.B. (1990). The interview in the admission process. Academic Medicine 65: 176-177.

    Google Scholar 

  • Elam, C.L. & Andrykowski, M.A. (1991). Admission interview ratings: Relationship to applicant academic and demographic variables and interviewer characteristics. Academic Medicine 66 (September Supplement): S13-S15.

    Google Scholar 

  • Elam, C.L. & Johnson, M.M. (1997). An analysis of admission committee voting patterns. Academic Medicine 72 (October Supplement): S72-S75.

    Article  Google Scholar 

  • Elam, C.L., Johnson, M.M.S., Wiese, H.J., Studts, J.L. & Rosenbaum, M. (1994). Admission interview reports: A content analysis of interviewer comments. Academic Medicine 69 (October Supplement): S63-S65.

    Google Scholar 

  • Feil, D., Kristian, M. & Mitchell, N. (1998). Older students' performances at McGill University. Academic Medicine 73: 98-100.

    Article  Google Scholar 

  • Foti, I. & DeYoung, S. (1991). Predicting success on the National Council Licensure Examination-Registered Nurse: Another piece of the puzzle. Journal of Professional Nursing 7: 99-104.

    Article  Google Scholar 

  • Gabard, D.L., Porzio, R., Oxford, T. & Braun, R. (1997). Admission interviews: Questions of utility and cost in Masters of Physical Therapy programs in the United States. Physiotherapy Research International 2: 135-149.

    Article  Google Scholar 

  • Graham, J.W. & Boyd, M.A. (1982). A structured interview for dental school admissions. Journal of Dental Education 46: 78-82.

    Google Scholar 

  • Hansen, M.J. & Pozehl, B.J. (1995). The effectiveness of admission criteria in predicting achievement in a master's degree program in nursing. Journal of Nursing Education 34: 433-437.

    Google Scholar 

  • Harasym, P.H., Woloschuk, W., Mandin, H. & Brundin-Mather, R. (1996). Reliability and validity of interviewers' judgements of medical school candidates. Academic Medicine 71 (October Supplement): S40-S42.

    Google Scholar 

  • Heale, J.A., Blumberg, P., Wakefield, J. & McAuley, R. (1989). The relationship between admission selection scores and performance of family medicine residents. Hamilton, Ontario, Canada: Unpublished manuscript, McMaster University.

    Google Scholar 

  • Higgs, Z.R. (1984). Predicting success in nursing: from prototype to pragmatics. Western Journal of Nursing Research 6(8): 77-95.

    Google Scholar 

  • Holt, T.B.O. & Dunlevy, C.L. (1992). The use of pre-admission criteria to predict academic success in a 4-year respiratory care curriculum. Respiratory Care 37: 439-443.

    Google Scholar 

  • Hull, A.L., Glover, P.B., Acheson, L.S., Carter, J.R., Dick, T.E., Kirby, A.C., Lam, M. & Stevens, D.P. (1996). Medical school applicants' essays as predictors of primary care career choice. Academic Medicine 71 (January Supplement): S37-S39.

    Google Scholar 

  • Johnson, E.K. & Edwards, J.C. (1991). Current practices in admission interviews at U.S. medical schools. Academic Medicine 66: 408-412.

    Article  Google Scholar 

  • Katz, G.M. & Mosey, A.C. (1980). Fieldwork performance, academic grades, and pre-selection criteria of occupational therapy students. American Journal of Occupational Therapy 34: 794-800.

    Google Scholar 

  • Kirchner, G.L. & Holm, M.B. (1997). Prediction of academic and clinical performance of occupational therapy students in an entry-level master's program. American Journal of Occupational Therapy 51: 775-779.

    Google Scholar 

  • Koenig, J.A., Sireci, S.G. & Wiley, A. (1998). Evaluating the predictive validity of MCAT scores across diverse applicant groups. Academic Medicine 73: 1095-1106.

    Article  Google Scholar 

  • Kulatunga-Moruzi, C. (1998). Toward valid selection criteria for academic and professional excellence in medicine. Hamilton, Ontario, Canada: Unpublished master's thesis, McMaster University.

    Google Scholar 

  • Levine, S.B., Knecht, H.G. & Eisen, R.G. (1986). Selection of physical therapy students: interview methods and academic predictors. Journal of Allied Health 15: 143-151.

    Google Scholar 

  • Mann, W.C. (1979). Interviewer scoring differences in student selection interviews. American Journal of Occupational Therapy 33: 235-239.

    Google Scholar 

  • McGaghie, W.C. (1990). Qualitative variables in medical school admission. Academic Medicine 65: 145-149.

    Article  Google Scholar 

  • McClelland, E., Yang, J.C. & Glick, O.J. (1992). A statewide study of academic variables affecting performance of baccalaureate nursing graduates on licensure examination. Journal of Professional Nursing 8: 342-350.

    Article  Google Scholar 

  • Mitchell, K.J. (1990). Predictors of performance in medical school. Academic Medicine 65: 149-158.

    Google Scholar 

  • Mitchell, K., Haynes, R. & Koenig, J. (1994). Assessing the validity of the updated Medical College Admission Test. Academic Medicine 5: 394-401.

    Google Scholar 

  • Morris, J.G. (1999). The value and role of the interview in the student admissions process: A review. Medical Teacher 21: 473-481.

    Article  Google Scholar 

  • Murden, R., Galloway, G.M., Reid, J.C. & Colwill, J.M. (1978) Academic and personal predictors of clinical success in medical school. Journal of Medical Education 53: 711-719.

    Google Scholar 

  • Nayer, M. (1992). Admission criteria for entrance to physiotherapy schools: How to choose among many applicants. Physiotherapy Canada 44: 41-46.

    Google Scholar 

  • Neame, R.L.B., Powis, D.A. & Bristow, T. (1992). Should medical students be selected only from recent school-leavers who have studied science? Medical Education 26: 433-440.

    Article  Google Scholar 

  • Nowacek, G.A., Bailey, B.A. & Sturgill, B.C. (1996). Influence of the interview on the evaluation of applicants to medical school. Academic Medicine 71: 1093-1095.

    Article  Google Scholar 

  • Oliver, D.H. (1985). The relationship of selected admission criteria to the academic success of associate degree nursing students. Journal of Nursing Education 24: 197-206.

    Google Scholar 

  • Payton, O.D. (1997). A meta-analysis of the literature on admissions criteria as predictions of academic performance in physical therapy education in the United States and Canada: 1983 through 1994. Physiotherapy Canada 49: 97-102, 112.

    Google Scholar 

  • Peat, M., Woodbury, M.G. & Donner, A. (1982). Admission average as a predictor of undergraduate academic and clinical performance. Physiotherapy Canada 34: 211-214.

    Google Scholar 

  • Posthuma, B.W. & Sommerfreund, J. (1985). Examination of selection criteria for a program in occupational therapy. American Journal of Occupational Therapy 39: 441-445.

    Google Scholar 

  • Posthuma, B.W. & Noh, S. (1990). Interview scores and academic grades as selection criteria for admission to an occupational therapy program. Canadian Journal of Occupational Therapy 57: 255-291.

    Google Scholar 

  • Powis, D.A., Neame, R.L.B., Bristow, T. & Murphy, L.B. (1988). The objective structured interview for medical student selection. Medical Education 296: 765-768.

    Google Scholar 

  • Powis, D.A., Waring, T.C., Bristow, T. & O'Connell, D.L. (1992). The structured interview as a tool for predicting premature withdrawal from medical school. Australian and New Zealand Journal of Medicine 22: 692-698.

    Google Scholar 

  • Psychological Services Bureau (1998). Revised PSB-Health Occupations Aptitude Examination Technical Manual. St. Thomas, PA: Author.

    Google Scholar 

  • Richards, P., McManus, I.C. & Maitlis, S.A. (1988). Reliability of interviewing in medical student selection. British Medical Journal of Clinical Research 296: 1520-1521.

    Article  Google Scholar 

  • Rikard-Bell, G., Marshall, E. & Chekaluk, E. (1991). Academic performance of mature-age and other students in a physiotherapy program. Journal of Allied Health 20: 107-117.

    Google Scholar 

  • Roehrig, S. (1990). Prediction of student problems in a baccalaureate physical therapy program. Journal of Physical Therapy Education 4: 26-30.

    Google Scholar 

  • Rolfe, I.E., Pearson, S., Powis, D.A. & Smith, A.J. (1995). Time for a review of admission to medical school. Lancet 346: 1329-1333.

    Article  Google Scholar 

  • Ross, C.A. & Leichner, P. (1984). Criteria for selecting residents: A reassessment. Canadian Journal of Psychiatry 29: 681-686.

    Google Scholar 

  • Roth, K.S., Riley, W.T., Brandt, R.B. & Seibel, H.R. (1996). Prediction of students' USMLE Step 2 performances based on premedical credentials related to verbal skills. Academic Medicine 71: 176-180.

    Google Scholar 

  • Rudner, L.M. (1992). Review of the PSB-Health Occupations Aptitude Examination. In J.J. Kramer & J.C. Conoley (eds.), The Eleventh Mental Measurements Yearbook. The Buros Institute of Mental Measurements, pp. 718-719. Lincoln, NE: The University of Nebraska Press.

    Google Scholar 

  • Schmalz, G.M., Rahr, R.R. & Allen, R.M. (1990). The use of pre-admission data to predict levels of success in selected allied health students. Occupational Therapy Journal of Research 10: 367-375.

    Google Scholar 

  • Scott, A.H., Chase L.M., Lefkowitz, R., Morton-Rias, D., Chambers, C., Joe, J., Holmes, G. & Bloomberg, S. (1995). A national survey of admissions criteria and processes in selected allied health professions. Journal of Allied Health 24: 95-106.

    Google Scholar 

  • Scott, J.N. & Markert, R.J. (1994). Relationship between critical thinking skills and success in preclinical courses. Academic Medicine 11: 920-924.

    Google Scholar 

  • Seither, F. (1980). Prediction of achievement in baccalaureate nursing education. Journal of Nursing Education 19: 28-36.

    Google Scholar 

  • Sharp, T.G. (1984). An analysis of the relationship of seven selected variables to State Board test pool examination performance of the University of Tennessee, Knoxville, College of Nursing. Journal of Nursing Education 23: 57-63.

    Google Scholar 

  • Shaw, D.L., Martz, D.M., Lancaster, C.J. & Sade, R.M. (1995). Influence of medical school applicants' demographic and cognitive characteristic on interviewers' ratings of noncognitive traits. Academic Medicine 6: 532-536.

    Google Scholar 

  • Standridge, J., Boggs, K.J. & Mugan, K.A. (1997). Evaluation of the Health Occupations Aptitude Examination. Respiratory Care 42: 868-872.

    Google Scholar 

  • Templeton, M.S., Burcham, A. & Franck, L. (1994). Predictive study of physical therapy admission variables. Journal of Allied Health 23: 79-87.

    Google Scholar 

  • Tompkins, L.S. & Harkins, C.J. (1990). Predicting academic success in a nontraditional program. Journal of Allied Health 19: 15-24.

    Google Scholar 

  • Tousignant, M. & Trottier, L. (1998). Admission to the bilingual physiotherapy program of the University of Ottawa: A comparison study of admission criteria used in candidate selection and academic success at the end of the first year of study. Physiotherapy Canada 50: 25-29.

    Google Scholar 

  • Vargo, J.W., Madill, H.M. & Davidson, P.R. (1986). The pre-admission interview as a predictor of academic grades and fieldwork performance. Canadian Journal of Occupational Therapy 53: 211-215.

    Google Scholar 

  • Vojir, C.P. & Bronstein, R.A. (1983). Applicant selection procedures: a mor objective approach to the interview process. Journal of Allied Health 12: 95-102.

    Google Scholar 

  • Walker, J.D., Killip, D.E. & Fuller, J.L. (1985). The significance of the admission interview in predicting students' performance in dental school. Journal of Medical Education 60: 569-571.

    Google Scholar 

  • Wilding, J. & Rheault, W. (1998). Interrater reliability of an admission interview scale. Journal of Physical Therapy Education 12: 26-29.

    Google Scholar 

  • Williams, A.K. (1984). Predicting academic achievement in a physical therapy program. Physical Therapy 64: 727.

    Google Scholar 

  • Woodward, C.A. & McAuley, R.G. (1983). Can the academic background of medical graduates be detected during internship? Canadian Medical Association Journal 129: 567-569.

    Google Scholar 

  • Youdas, J.W., Hallman, H.O., Carey, J.R., Bogard, C.L. & Garrett, T.R. (1992). Reliability and validity of judgments of applicant essays as a predictor of academic success in an entry-level physical therapy education program. Journal of Physical Therapy Education 6: 15-18.

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. School of Rehabilitation Science, Faculty of Health Sciences, McMaster University, Hamilton, Ontario, Canada

    Penny Salvatori (Associate Professor)

Authors
  1. Penny Salvatori
    View author publications

    You can also search for this author in PubMed Google Scholar

Rights and permissions

Reprints and permissions

About this article

Cite this article

Salvatori, P. Reliability and Validity of Admissions Tools Used to Select Students for the Health Professions. Adv Health Sci Educ Theory Pract 6, 159–175 (2001). https://doi.org/10.1023/A:1011489618208

Download citation

  • Issue Date:

  • DOI: https://doi.org/10.1023/A:1011489618208

Search

Navigation