Perceptions of the Emergency Medicine Resident Selection Process by Program Directors Following the Transition to a Pass/Fail USMLE Step 1
Kevin Bray,1 Kaitlin Burge,1 Om Patel,1 Ishant Yadav,1 William Haynes,1 Nicholas Van Wagoner,2 Charles A Khoury3 1Heersink School of Medicine, University of Alabama at Birmingham, Birmingham, AL, USA; 2Division of Infectious Diseases, University of Alabama at Birmingham, Birmingham, AL, USA; 3Depart...
| Main Authors: | , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Dove Medical Press
2023-01-01
|
| Series: | Open Access Emergency Medicine |
| Subjects: | |
| Online Access: | https://www.dovepress.com/perceptions-of-the-emergency-medicine-resident-selection-process-by-pr-peer-reviewed-fulltext-article-OAEM |
| _version_ | 1797954416006922240 |
|---|---|
| author | Bray K Burge K Patel O Yadav I Haynes W Van Wagoner N Khoury CA |
| author_facet | Bray K Burge K Patel O Yadav I Haynes W Van Wagoner N Khoury CA |
| author_sort | Bray K |
| collection | DOAJ |
| description | Kevin Bray,1 Kaitlin Burge,1 Om Patel,1 Ishant Yadav,1 William Haynes,1 Nicholas Van Wagoner,2 Charles A Khoury3 1Heersink School of Medicine, University of Alabama at Birmingham, Birmingham, AL, USA; 2Division of Infectious Diseases, University of Alabama at Birmingham, Birmingham, AL, USA; 3Department of Emergency Medicine, University of Alabama at Birmingham, Birmingham, AL, USACorrespondence: Kevin Bray, Email kevbray@uab.eduBackground: Beginning January 26th, 2022, the National Board of Medical Examiners transitioned scoring of the United States Medical Licensing Examination (USMLE) Step 1 from a 3-digit score to pass/fail. In the past, the Step 1 score has been weighted heavily by program directors (PDs) as one of the most important metrics when assessing medical student’s competitiveness.Objective: The objective of this study was to evaluate the perceptions of emergency medicine (EM) PDs on the transition to a pass/fail USMLE Step 1 exam, and to elicit the opinions of EM PDs on the USMLE examinations’ ability to predict resident performance.Methods: A survey consisting of ranking and multiple-choice questions was sent to EM PDs. The multiple-choice questions were asked to determine EM PDs level of confidence in the ability of Step 1 and Step 2 Clinical Knowledge (CK) to predict a student’s ability to succeed in residency. The ranking questions focused on assessing each program’s current resident selection practices in comparison to expected selection criteria changes following a transition to pass/fail Step 1. R studio and MATLAB were used for statistical analysis, and a P value < 0.05 was considered significant.Results: The survey was completed by 57 (20.21%) EM PDs. When asked if Step 1 and Step 2 CK are accurate predictors of a resident’s ability to perform clinically within EM, only 10.5% of PDs answered ‘yes’ to Step 1 being predictive, compared to 31.6% for Step 2 CK. Regarding selection criteria, the top quartile of attributes (standardized letters of evaluation [1st], away rotations [2nd], clerkship grades [3rd] and Step 2 CK score [4th]) remained the same following the transition.Conclusion: Our results indicate that the top quartile of attributes might remain the same, despite most PDs agreeing that Step 2 CK is a better predictor of a resident’s performance.Keywords: USMLE, NBME, Step 1, Step 2, emergency medicine, residency, program director, medical student |
| first_indexed | 2024-04-10T23:18:12Z |
| format | Article |
| id | doaj.art-e639c86bcc414d90aa6863fa81d15508 |
| institution | Directory Open Access Journal |
| issn | 1179-1500 |
| language | English |
| last_indexed | 2024-04-10T23:18:12Z |
| publishDate | 2023-01-01 |
| publisher | Dove Medical Press |
| record_format | Article |
| series | Open Access Emergency Medicine |
| spelling | doaj.art-e639c86bcc414d90aa6863fa81d155082023-01-12T18:03:06ZengDove Medical PressOpen Access Emergency Medicine1179-15002023-01-01Volume 15152080943Perceptions of the Emergency Medicine Resident Selection Process by Program Directors Following the Transition to a Pass/Fail USMLE Step 1Bray KBurge KPatel OYadav IHaynes WVan Wagoner NKhoury CAKevin Bray,1 Kaitlin Burge,1 Om Patel,1 Ishant Yadav,1 William Haynes,1 Nicholas Van Wagoner,2 Charles A Khoury3 1Heersink School of Medicine, University of Alabama at Birmingham, Birmingham, AL, USA; 2Division of Infectious Diseases, University of Alabama at Birmingham, Birmingham, AL, USA; 3Department of Emergency Medicine, University of Alabama at Birmingham, Birmingham, AL, USACorrespondence: Kevin Bray, Email kevbray@uab.eduBackground: Beginning January 26th, 2022, the National Board of Medical Examiners transitioned scoring of the United States Medical Licensing Examination (USMLE) Step 1 from a 3-digit score to pass/fail. In the past, the Step 1 score has been weighted heavily by program directors (PDs) as one of the most important metrics when assessing medical student’s competitiveness.Objective: The objective of this study was to evaluate the perceptions of emergency medicine (EM) PDs on the transition to a pass/fail USMLE Step 1 exam, and to elicit the opinions of EM PDs on the USMLE examinations’ ability to predict resident performance.Methods: A survey consisting of ranking and multiple-choice questions was sent to EM PDs. The multiple-choice questions were asked to determine EM PDs level of confidence in the ability of Step 1 and Step 2 Clinical Knowledge (CK) to predict a student’s ability to succeed in residency. The ranking questions focused on assessing each program’s current resident selection practices in comparison to expected selection criteria changes following a transition to pass/fail Step 1. R studio and MATLAB were used for statistical analysis, and a P value < 0.05 was considered significant.Results: The survey was completed by 57 (20.21%) EM PDs. When asked if Step 1 and Step 2 CK are accurate predictors of a resident’s ability to perform clinically within EM, only 10.5% of PDs answered ‘yes’ to Step 1 being predictive, compared to 31.6% for Step 2 CK. Regarding selection criteria, the top quartile of attributes (standardized letters of evaluation [1st], away rotations [2nd], clerkship grades [3rd] and Step 2 CK score [4th]) remained the same following the transition.Conclusion: Our results indicate that the top quartile of attributes might remain the same, despite most PDs agreeing that Step 2 CK is a better predictor of a resident’s performance.Keywords: USMLE, NBME, Step 1, Step 2, emergency medicine, residency, program director, medical studenthttps://www.dovepress.com/perceptions-of-the-emergency-medicine-resident-selection-process-by-pr-peer-reviewed-fulltext-article-OAEMusmleresidencyemergency medicineprogram directornbmestep 1step 2medical student |
| spellingShingle | Bray K Burge K Patel O Yadav I Haynes W Van Wagoner N Khoury CA Perceptions of the Emergency Medicine Resident Selection Process by Program Directors Following the Transition to a Pass/Fail USMLE Step 1 Open Access Emergency Medicine usmle residency emergency medicine program director nbme step 1 step 2 medical student |
| title | Perceptions of the Emergency Medicine Resident Selection Process by Program Directors Following the Transition to a Pass/Fail USMLE Step 1 |
| title_full | Perceptions of the Emergency Medicine Resident Selection Process by Program Directors Following the Transition to a Pass/Fail USMLE Step 1 |
| title_fullStr | Perceptions of the Emergency Medicine Resident Selection Process by Program Directors Following the Transition to a Pass/Fail USMLE Step 1 |
| title_full_unstemmed | Perceptions of the Emergency Medicine Resident Selection Process by Program Directors Following the Transition to a Pass/Fail USMLE Step 1 |
| title_short | Perceptions of the Emergency Medicine Resident Selection Process by Program Directors Following the Transition to a Pass/Fail USMLE Step 1 |
| title_sort | perceptions of the emergency medicine resident selection process by program directors following the transition to a pass fail usmle step 1 |
| topic | usmle residency emergency medicine program director nbme step 1 step 2 medical student |
| url | https://www.dovepress.com/perceptions-of-the-emergency-medicine-resident-selection-process-by-pr-peer-reviewed-fulltext-article-OAEM |
| work_keys_str_mv | AT brayk perceptionsoftheemergencymedicineresidentselectionprocessbyprogramdirectorsfollowingthetransitiontoapassfailusmlestep1 AT burgek perceptionsoftheemergencymedicineresidentselectionprocessbyprogramdirectorsfollowingthetransitiontoapassfailusmlestep1 AT patelo perceptionsoftheemergencymedicineresidentselectionprocessbyprogramdirectorsfollowingthetransitiontoapassfailusmlestep1 AT yadavi perceptionsoftheemergencymedicineresidentselectionprocessbyprogramdirectorsfollowingthetransitiontoapassfailusmlestep1 AT haynesw perceptionsoftheemergencymedicineresidentselectionprocessbyprogramdirectorsfollowingthetransitiontoapassfailusmlestep1 AT vanwagonern perceptionsoftheemergencymedicineresidentselectionprocessbyprogramdirectorsfollowingthetransitiontoapassfailusmlestep1 AT khouryca perceptionsoftheemergencymedicineresidentselectionprocessbyprogramdirectorsfollowingthetransitiontoapassfailusmlestep1 |