Faculty Collaboration Database

The relationship between internal medicine residency graduate performance on the ABIM certifying examination, yearly in-service training examinations, and the USMLE Step 1 examination. Acad Med 2015 Jan;90(1):100-4

Date

10/02/2014

Pubmed ID

25271892

DOI

10.1097/ACM.0000000000000500

Scopus ID

2-s2.0-84920857612 (requires institutional sign-in at Scopus site)   54 Citations

Abstract

PURPOSE: To explore the relationship between United States Medical Licensing Examination (USMLE) Step 1 scores, yearly in-service training exam (ITE) scores, and passing the American Board of Internal Medicine certifying examination (ABIM-CE).

METHOD: The authors conducted a retrospective database review of internal medicine residents from the Medical College of Wisconsin from 2004 through 2012. Residents' USMLE Step 1, ITE, and ABIM-CE scores were extracted. Pearson rho, chi-square, and logistic regression were used to determine whether relationships existed between the scores and if Step 1 and ITE scores correlate with passing the ABIM-CE.

RESULTS: There were 241 residents, who participated in 728 annual ITEs. There were Step 1 scores for 195 (81%) residents and ABIM-CE scores for 183 (76%). Step 1 and ABIM-CE scores had a modest correlation (rho: 0.59), as did ITE and ABIM-CE scores (rho: 0.48-0.67). Failing Step 1 or being in the bottom ITE quartile during any year of testing markedly increased likelihood of failing the boards (Step 1: relative risk [RR]: 2.4; 95% CI: 1.0-5.9; first-year residents' RR: 1.3; 95% CI: 1.0-1.6; second-year residents' RR: 1.3; 95% CI: 1.1-1.5; third-year residents' RR: 1.3; 95% CI: 1.1-1.5).

CONCLUSIONS: USMLE Step 1 and ITE scores have a modest correlation with board scores. Failing Step 1 or scoring in the bottom quartile of the ITE increased the risk of failing the boards. What effective intervention, if any, program directors may use with at-risk residents is a question deserving further research.

Author List

Kay C, Jackson JL, Frank M

Authors

Michael O. Frank MD Chief, Professor in the Medicine department at Medical College of Wisconsin
Jeffrey L. Jackson MD Professor in the Medicine department at Medical College of Wisconsin
Cynthia Kay MD Associate Professor in the Medicine department at Medical College of Wisconsin

MESH terms used to index this publication - Major topics in bold

Adult
Certification
Databases, Factual
Educational Measurement
Female
Humans
Internal Medicine
Internship and Residency
Licensure, Medical
Male
Middle Aged
Retrospective Studies
Specialty Boards
United States
Young Adult