Advances in Health Sciences Education

, Volume 6, Issue 2, pp 159–175 | Cite as

Reliability and Validity of Admissions Tools Used to Select Students for the Health Professions

  • Penny Salvatori
Article

Abstract

The selection of students for the health professions is typically a very competitive multi-staged process that includes assessment of both cognitive abilities and personal qualities. The need for reliable and valid assessment measures is obvious. This review of the health professions literature examines the evidence to support the use of various selection tools. It is clear that pre-admission overall grade point average (GPA) is the best predictor of academic performance in all of the health professions; however, the relationship between pre-admission GPA and clinical performance is less clear. The Medical College Admission Test is a good predictor of performance of medical students in terms of in-course grades and licencing examination scores but a similar test does not exist in the other health professions. Controversy remains as to the value of personal interviews and written submissions as selection tools, although it is clear that training of assessors and explicit rating guidelines enhance their reliability and validity. Ongoing research is needed to find more reliable and valid ways of assessing non-cognitive characteristics of applicants.

education health professions literature review school admission criteria 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Agho, A.O., Mosley, B.W. & Smith-Paul, B. (1998). Use of interview in selecting students for occupational therapy programs. American Journal of Occupational Therapy 52: 592-594.Google Scholar
  2. Alexander, J.E. & Brophy, G.H. (1997). A five-year study of graduates' performance on NCLEX-RN. Journal of Nursing Education 36: 443-445.Google Scholar
  3. Alichnie, M. & Bellucci, J. (1981). Prediction of freshman students' success in a baccalaureate nursing program. Nursing Research 30: 49-53.Google Scholar
  4. Altmaier, E.M., Smith,W.L., O'Halloran, C.M. & Franken, E.A., Jr. (1992). The predictive utility of behavior-based interviewing compared with traditional interviewing in the selection of radiology residents. Investigative Radiology 25: 385-389.Google Scholar
  5. Baker, J., Douphrate, D. & Ridley, D. (1996). The use of the Revised PSB-Health Occupations Aptitude Examination as a predictor of success in physical therapy students. Journal of Physical Therapy Education 10: 63-67.Google Scholar
  6. Balogun, J.A. (1987). Predictive validity of the Allied Health Professions Admissions Test. Physiotherapy Canada 39: 39-42.Google Scholar
  7. Balogun, J.A. (1988). Predictors of academic and clinical performance in a baccalaureate physical therapy program. Physical Therapy 68: 238-242.Google Scholar
  8. Balogun, J.A., Karacoloff, L.A. & Farina, N.T. (1986). Predictors of academic achievement in physical therapy. Physical Therapy 66: 976-980.Google Scholar
  9. Bauwens, E. & Gerhard, G. (1987). The use of the Watson Glaser Critical Thinking Appraisal to predict success in a baccalaureate nursing program. Journal of Nursing Education 26: 278-281.Google Scholar
  10. Berchulc, C.M., Wade, G.A. & Seider, K.K. (1987). Predicting academic achievement of undergraduate occupational therapy students: Preliminary results. Occupational Therapy Journal of Research 7: 245-248.Google Scholar
  11. Boyd, M.A., Graham, J.W., Teteruck, W.R. & Krupka, J. (1983). Development and implementation of a structured interview for dental admissions. Journal of the Canadian Dental Association 3: 181-185.Google Scholar
  12. Bridle, M.J. (1987). Student selection: a comparison of three methods. Canadian Journal of Occupational Therapy 54: 113-117.Google Scholar
  13. Brown, B., Carpio, B. & Roberts, J. (1991). The use of an autobiographical letter in the nursing admissions process: Initial reliability and validity. Canadian Journal of Nursing Research 23(2): 9-20.Google Scholar
  14. Campbell, A.R. & Dickson, C.J. (1996). Predicting student success: A 10-year review using integrative review and meta-analysis. Journal of Professional Nursing 12: 47-59.CrossRefGoogle Scholar
  15. Cariaga-Lo, L.D., Enarson, C.E., Crandall, S.J., Zaccaro, D.J. & Richards, B.E. (1997). Cognitive and noncognitive predictors of academic difficulty and attrition. Academic Medicine 72 (October Supplement): S69-S71.Google Scholar
  16. Carpio, B. & Brown, B. (1993). The admissions process of a bachelor of science in nursing program: Initial reliability and validity of the personal interview. Canadian Journal of Nursing Research 25(3): 41-52.Google Scholar
  17. Carpio, B., O'Mara, L. & Hezekiah, J. (1996). Predictors of success on the Canadian Nurses Association testing service (CNATS) examination. Canadian Journal of Nursing Research 28(4): 115-123.Google Scholar
  18. Devaul, R.A., Jervey, F., Chappell, J.A., Caver, P., Short, B. & O'Keefe, S. (1987). Medical school performance of initially rejected students. Journal of the American Medical Association 257: 47-51.CrossRefGoogle Scholar
  19. Dietrich, M.C. (1981). Putting objectivity in the allied health student selection process. Journal of Allied Health 10: 226-239.Google Scholar
  20. Dietrich, M.C. & Crowley, J.A. (1982). A national study of student selection practices in the allied health professions. Journal of Allied Health 11: 248-260.Google Scholar
  21. Dunbar, S.B. (1992). Review of the PSB-Health Occupations Aptitude Examination. In J.J. Kramer & J.C. Conoley (eds.), The Eleventh Mental Measurements Yearbook. The Buros Institute of Mental Measurements, pp. 716-718. Lincoln, NE: The University of Nebraska Press.Google Scholar
  22. Edwards, J.C., Johnson, E.K. & Molidar, J.B. (1990). The interview in the admission process. Academic Medicine 65: 176-177.Google Scholar
  23. Elam, C.L. & Andrykowski, M.A. (1991). Admission interview ratings: Relationship to applicant academic and demographic variables and interviewer characteristics. Academic Medicine 66 (September Supplement): S13-S15.Google Scholar
  24. Elam, C.L. & Johnson, M.M. (1997). An analysis of admission committee voting patterns. Academic Medicine 72 (October Supplement): S72-S75.CrossRefGoogle Scholar
  25. Elam, C.L., Johnson, M.M.S., Wiese, H.J., Studts, J.L. & Rosenbaum, M. (1994). Admission interview reports: A content analysis of interviewer comments. Academic Medicine 69 (October Supplement): S63-S65.Google Scholar
  26. Feil, D., Kristian, M. & Mitchell, N. (1998). Older students' performances at McGill University. Academic Medicine 73: 98-100.CrossRefGoogle Scholar
  27. Foti, I. & DeYoung, S. (1991). Predicting success on the National Council Licensure Examination-Registered Nurse: Another piece of the puzzle. Journal of Professional Nursing 7: 99-104.CrossRefGoogle Scholar
  28. Gabard, D.L., Porzio, R., Oxford, T. & Braun, R. (1997). Admission interviews: Questions of utility and cost in Masters of Physical Therapy programs in the United States. Physiotherapy Research International 2: 135-149.CrossRefGoogle Scholar
  29. Graham, J.W. & Boyd, M.A. (1982). A structured interview for dental school admissions. Journal of Dental Education 46: 78-82.Google Scholar
  30. Hansen, M.J. & Pozehl, B.J. (1995). The effectiveness of admission criteria in predicting achievement in a master's degree program in nursing. Journal of Nursing Education 34: 433-437.Google Scholar
  31. Harasym, P.H., Woloschuk, W., Mandin, H. & Brundin-Mather, R. (1996). Reliability and validity of interviewers' judgements of medical school candidates. Academic Medicine 71 (October Supplement): S40-S42.Google Scholar
  32. Heale, J.A., Blumberg, P., Wakefield, J. & McAuley, R. (1989). The relationship between admission selection scores and performance of family medicine residents. Hamilton, Ontario, Canada: Unpublished manuscript, McMaster University.Google Scholar
  33. Higgs, Z.R. (1984). Predicting success in nursing: from prototype to pragmatics. Western Journal of Nursing Research 6(8): 77-95.Google Scholar
  34. Holt, T.B.O. & Dunlevy, C.L. (1992). The use of pre-admission criteria to predict academic success in a 4-year respiratory care curriculum. Respiratory Care 37: 439-443.Google Scholar
  35. Hull, A.L., Glover, P.B., Acheson, L.S., Carter, J.R., Dick, T.E., Kirby, A.C., Lam, M. & Stevens, D.P. (1996). Medical school applicants' essays as predictors of primary care career choice. Academic Medicine 71 (January Supplement): S37-S39.Google Scholar
  36. Johnson, E.K. & Edwards, J.C. (1991). Current practices in admission interviews at U.S. medical schools. Academic Medicine 66: 408-412.CrossRefGoogle Scholar
  37. Katz, G.M. & Mosey, A.C. (1980). Fieldwork performance, academic grades, and pre-selection criteria of occupational therapy students. American Journal of Occupational Therapy 34: 794-800.Google Scholar
  38. Kirchner, G.L. & Holm, M.B. (1997). Prediction of academic and clinical performance of occupational therapy students in an entry-level master's program. American Journal of Occupational Therapy 51: 775-779.Google Scholar
  39. Koenig, J.A., Sireci, S.G. & Wiley, A. (1998). Evaluating the predictive validity of MCAT scores across diverse applicant groups. Academic Medicine 73: 1095-1106.CrossRefGoogle Scholar
  40. Kulatunga-Moruzi, C. (1998). Toward valid selection criteria for academic and professional excellence in medicine. Hamilton, Ontario, Canada: Unpublished master's thesis, McMaster University.Google Scholar
  41. Levine, S.B., Knecht, H.G. & Eisen, R.G. (1986). Selection of physical therapy students: interview methods and academic predictors. Journal of Allied Health 15: 143-151.Google Scholar
  42. Mann, W.C. (1979). Interviewer scoring differences in student selection interviews. American Journal of Occupational Therapy 33: 235-239.Google Scholar
  43. McGaghie, W.C. (1990). Qualitative variables in medical school admission. Academic Medicine 65: 145-149.CrossRefGoogle Scholar
  44. McClelland, E., Yang, J.C. & Glick, O.J. (1992). A statewide study of academic variables affecting performance of baccalaureate nursing graduates on licensure examination. Journal of Professional Nursing 8: 342-350.CrossRefGoogle Scholar
  45. Mitchell, K.J. (1990). Predictors of performance in medical school. Academic Medicine 65: 149-158.Google Scholar
  46. Mitchell, K., Haynes, R. & Koenig, J. (1994). Assessing the validity of the updated Medical College Admission Test. Academic Medicine 5: 394-401.Google Scholar
  47. Morris, J.G. (1999). The value and role of the interview in the student admissions process: A review. Medical Teacher 21: 473-481.CrossRefGoogle Scholar
  48. Murden, R., Galloway, G.M., Reid, J.C. & Colwill, J.M. (1978) Academic and personal predictors of clinical success in medical school. Journal of Medical Education 53: 711-719.Google Scholar
  49. Nayer, M. (1992). Admission criteria for entrance to physiotherapy schools: How to choose among many applicants. Physiotherapy Canada 44: 41-46.Google Scholar
  50. Neame, R.L.B., Powis, D.A. & Bristow, T. (1992). Should medical students be selected only from recent school-leavers who have studied science? Medical Education 26: 433-440.CrossRefGoogle Scholar
  51. Nowacek, G.A., Bailey, B.A. & Sturgill, B.C. (1996). Influence of the interview on the evaluation of applicants to medical school. Academic Medicine 71: 1093-1095.CrossRefGoogle Scholar
  52. Oliver, D.H. (1985). The relationship of selected admission criteria to the academic success of associate degree nursing students. Journal of Nursing Education 24: 197-206.Google Scholar
  53. Payton, O.D. (1997). A meta-analysis of the literature on admissions criteria as predictions of academic performance in physical therapy education in the United States and Canada: 1983 through 1994. Physiotherapy Canada 49: 97-102, 112.Google Scholar
  54. Peat, M., Woodbury, M.G. & Donner, A. (1982). Admission average as a predictor of undergraduate academic and clinical performance. Physiotherapy Canada 34: 211-214.Google Scholar
  55. Posthuma, B.W. & Sommerfreund, J. (1985). Examination of selection criteria for a program in occupational therapy. American Journal of Occupational Therapy 39: 441-445.Google Scholar
  56. Posthuma, B.W. & Noh, S. (1990). Interview scores and academic grades as selection criteria for admission to an occupational therapy program. Canadian Journal of Occupational Therapy 57: 255-291.Google Scholar
  57. Powis, D.A., Neame, R.L.B., Bristow, T. & Murphy, L.B. (1988). The objective structured interview for medical student selection. Medical Education 296: 765-768.Google Scholar
  58. Powis, D.A., Waring, T.C., Bristow, T. & O'Connell, D.L. (1992). The structured interview as a tool for predicting premature withdrawal from medical school. Australian and New Zealand Journal of Medicine 22: 692-698.Google Scholar
  59. Psychological Services Bureau (1998). Revised PSB-Health Occupations Aptitude Examination Technical Manual. St. Thomas, PA: Author.Google Scholar
  60. Richards, P., McManus, I.C. & Maitlis, S.A. (1988). Reliability of interviewing in medical student selection. British Medical Journal of Clinical Research 296: 1520-1521.CrossRefGoogle Scholar
  61. Rikard-Bell, G., Marshall, E. & Chekaluk, E. (1991). Academic performance of mature-age and other students in a physiotherapy program. Journal of Allied Health 20: 107-117.Google Scholar
  62. Roehrig, S. (1990). Prediction of student problems in a baccalaureate physical therapy program. Journal of Physical Therapy Education 4: 26-30.Google Scholar
  63. Rolfe, I.E., Pearson, S., Powis, D.A. & Smith, A.J. (1995). Time for a review of admission to medical school. Lancet 346: 1329-1333.CrossRefGoogle Scholar
  64. Ross, C.A. & Leichner, P. (1984). Criteria for selecting residents: A reassessment. Canadian Journal of Psychiatry 29: 681-686.Google Scholar
  65. Roth, K.S., Riley, W.T., Brandt, R.B. & Seibel, H.R. (1996). Prediction of students' USMLE Step 2 performances based on premedical credentials related to verbal skills. Academic Medicine 71: 176-180.Google Scholar
  66. Rudner, L.M. (1992). Review of the PSB-Health Occupations Aptitude Examination. In J.J. Kramer & J.C. Conoley (eds.), The Eleventh Mental Measurements Yearbook. The Buros Institute of Mental Measurements, pp. 718-719. Lincoln, NE: The University of Nebraska Press.Google Scholar
  67. Schmalz, G.M., Rahr, R.R. & Allen, R.M. (1990). The use of pre-admission data to predict levels of success in selected allied health students. Occupational Therapy Journal of Research 10: 367-375.Google Scholar
  68. Scott, A.H., Chase L.M., Lefkowitz, R., Morton-Rias, D., Chambers, C., Joe, J., Holmes, G. & Bloomberg, S. (1995). A national survey of admissions criteria and processes in selected allied health professions. Journal of Allied Health 24: 95-106.Google Scholar
  69. Scott, J.N. & Markert, R.J. (1994). Relationship between critical thinking skills and success in preclinical courses. Academic Medicine 11: 920-924.Google Scholar
  70. Seither, F. (1980). Prediction of achievement in baccalaureate nursing education. Journal of Nursing Education 19: 28-36.Google Scholar
  71. Sharp, T.G. (1984). An analysis of the relationship of seven selected variables to State Board test pool examination performance of the University of Tennessee, Knoxville, College of Nursing. Journal of Nursing Education 23: 57-63.Google Scholar
  72. Shaw, D.L., Martz, D.M., Lancaster, C.J. & Sade, R.M. (1995). Influence of medical school applicants' demographic and cognitive characteristic on interviewers' ratings of noncognitive traits. Academic Medicine 6: 532-536.Google Scholar
  73. Standridge, J., Boggs, K.J. & Mugan, K.A. (1997). Evaluation of the Health Occupations Aptitude Examination. Respiratory Care 42: 868-872.Google Scholar
  74. Templeton, M.S., Burcham, A. & Franck, L. (1994). Predictive study of physical therapy admission variables. Journal of Allied Health 23: 79-87.Google Scholar
  75. Tompkins, L.S. & Harkins, C.J. (1990). Predicting academic success in a nontraditional program. Journal of Allied Health 19: 15-24.Google Scholar
  76. Tousignant, M. & Trottier, L. (1998). Admission to the bilingual physiotherapy program of the University of Ottawa: A comparison study of admission criteria used in candidate selection and academic success at the end of the first year of study. Physiotherapy Canada 50: 25-29.Google Scholar
  77. Vargo, J.W., Madill, H.M. & Davidson, P.R. (1986). The pre-admission interview as a predictor of academic grades and fieldwork performance. Canadian Journal of Occupational Therapy 53: 211-215.Google Scholar
  78. Vojir, C.P. & Bronstein, R.A. (1983). Applicant selection procedures: a mor objective approach to the interview process. Journal of Allied Health 12: 95-102.Google Scholar
  79. Walker, J.D., Killip, D.E. & Fuller, J.L. (1985). The significance of the admission interview in predicting students' performance in dental school. Journal of Medical Education 60: 569-571.Google Scholar
  80. Wilding, J. & Rheault, W. (1998). Interrater reliability of an admission interview scale. Journal of Physical Therapy Education 12: 26-29.Google Scholar
  81. Williams, A.K. (1984). Predicting academic achievement in a physical therapy program. Physical Therapy 64: 727.Google Scholar
  82. Woodward, C.A. & McAuley, R.G. (1983). Can the academic background of medical graduates be detected during internship? Canadian Medical Association Journal 129: 567-569.Google Scholar
  83. Youdas, J.W., Hallman, H.O., Carey, J.R., Bogard, C.L. & Garrett, T.R. (1992). Reliability and validity of judgments of applicant essays as a predictor of academic success in an entry-level physical therapy education program. Journal of Physical Therapy Education 6: 15-18.Google Scholar

Copyright information

© Kluwer Academic Publishers 2001

Authors and Affiliations

  • Penny Salvatori
    • 1
  1. 1.School of Rehabilitation Science, Faculty of Health SciencesMcMaster UniversityHamiltonCanada

Personalised recommendations