Abstract
Objective:To determine whether the results of the Internal Medicine In-Training Examination (ITE) can predict subsequent performance on the American Board of Internal Medicine certifying examination (ABIMCE).
Design:Retrospective data review.
Setting:A mixture of six community hospital and university-based internal medicine training programs in the Eastern United States.
Subjects:109 residents who first took the ABIMCE in 1988 or 1989, and who had also taken at least one ITE.
Measurements:Scores for the composite and subspecialty sections of the ITE were compared with those for the ABIMCE. An R 2 was obtained to relate the scores on the two examinations. A cutoff score was derived to maximize the ability of the ITE to discriminate between residents who were likely to pass and those who were likely to fail the ABIMCE.
Main results:ABIMCE scores were available for 109 residents who had also taken the ITE during PGY-2 (19), PGY-3 (50), or both years (40). Composite scores on the ABIMCE were highly correlated with those on the ITE-PGY-2 (R 2=0.593) and the ITE-PGY-3 (R2=0.677) (p<0.0001 for each).Most of the subspecialty sections on the two examinations were significantly correlated, although less strongly (range of R 2=0.041 to 0.32)than were the composite scores. An empirically derived cutoff score of the 35th percentile on the ITE-PGY-2 had a positive predictive value of 89% (probability of passing ABIMCE) and a negative predictive value of 83% (probability of failing ABIMCE).
Conclusions:Performance on the ITE can accurately predict and is highly correlated with performance on the ABIMCE. ITE results may therefore be useful in counseling residents about their educational needs in preparation for the ABIMCE.
Similar content being viewed by others
References
Ramsey PG, Carline JD, Inui TS, Larson EB, LoGerfo JP, Wenrich MD. Predictive validity of certification by the American Board of Internal Medicine. Ann Intern Med. 1989;110:719–26.
Leigh TM, Johnson TP, Pisacano NJ. Predictive validity of the American Board of Family Practice In-Training Examination. Acad Med. 1990;65:454–7.
Garvin PJ, Kaminski DL. Significance of the in-training examination in a surgical residency program. Surgery. 1984;96:109–12.
Grosse ME, Cruft GE, Blaisdell W. The American Board of Surgery in-training examination. Arch Surg. 1980;115:654–7.
Rubin ML. The ophthalmology resident in-training examination. Am J Ophthalmol. 1969;67:70–9.
Buchwalter JA, Schumacher R, Albright JP, Cooper RR. The validity of orthopedic in-training examination scores. J Bone Joint Surg. 1981;63-A:1001–6.
Donnelly JE, Yankaskas B, Gjerde C, Wright JC, Longnecker DP. An in-training assessment examination in family medicine: report of a pilot project. J Fam Pract. 1977;5:987–9.
SPSS-X user’s guide. Chicago: SPSS Inc., 1988.
Norcini JJ, Maihoff NA, Day SC, Benson JA. Trends in medical knowledge as assessed by the certifying examination in internal medicine. JAMA. 1989;262:2402–4.
Ferguson GA. Statistical analysis in psychology and education. New York: McGraw Hill, 1976.
Performance interpretation guidelines: 1988 Internal Medicine In-Training Examination. Philadelphia: American College of Physicians, 1988.
Performance interpretation guidelines: 1989 Internal Medicine In-Training Examination. Philadelphia: American College of Physicians, 1989.
Shetler PL. Observations on the American Board of Surgery in-training examination, board results, and conference attendance. Am J Surg. 1982;144:292–4.
Norcini JJ, Grosso LJ, Shea JA, Webster GD. The relationship between features of residency training and ABIM certifying examination performance. J Gen Intern Med. 1987;2:330–6.
Norcini JJ, Webster GD, Grosso LJ, Blank LL, Benson JA. Ratings of residents’ clinical competence and performance on certification examination. J Med Educ. 1987;62:457–62.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Grossman, R.S., Fincher, RM.E., Layne, R.D. et al. Validity of the in-training examination for predicting american board of internal medicine certifying examination scores. J Gen Intern Med 7, 63–67 (1992). https://doi.org/10.1007/BF02599105
Issue Date:
DOI: https://doi.org/10.1007/BF02599105