Early Emergency Medicine Milestone Assessment for Predicting First-Year Resident Performance
Introduction The Accreditation Council for Graduate Medical Education (ACGME) requires emergency medicine (EM) residency training programs to monitor residents' progress using standardized milestones. The first assessment of PGY 1 resident milestones occurs midway through the first year and cou...
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Association of American Medical Colleges
2024-03-01
|
| Series: | MedEdPORTAL |
| Subjects: | |
| Online Access: | http://www.mededportal.org/doi/10.15766/mep_2374-8265.11386 |
| _version_ | 1827320385570340864 |
|---|---|
| author | Rochelle L. Versalle Brett R. Todd Nai-Wei Chen Danielle E. Turner-Lawrence |
| author_facet | Rochelle L. Versalle Brett R. Todd Nai-Wei Chen Danielle E. Turner-Lawrence |
| author_sort | Rochelle L. Versalle |
| collection | DOAJ |
| description | Introduction The Accreditation Council for Graduate Medical Education (ACGME) requires emergency medicine (EM) residency training programs to monitor residents' progress using standardized milestones. The first assessment of PGY 1 resident milestones occurs midway through the first year and could miss initial deficiencies. Early assessment of PGY 1 EM resident milestones has potential to identify at-risk residents prior to standard midyear evaluations. We developed an orientation syllabus for PGY 1 residents followed by a milestone assessment. Assessment scores helped predict future milestone scores and American Board of Emergency Medicine (ABEM) In-Training Examination (ITE) scores for PGY 1 residents. Methods From 2013 to 2020, we developed and implemented Milestone Evaluation Day (MED), a simulation-based day and written exam assessing PGY 1 EM residents during their first month on the 23 ACGME 1.0 milestones. MED stations included a history and physical with verbal presentation, patient simulation, vascular access, wound management, and airway management. MED, Clinical Competency Committee-generated (CCC-generated) milestone, and ABEM ITE scores were averaged and compared utilizing Pearson's correlation coefficient. Results Of 112 PGY 1 EM residents, 110 (98%) were analyzed over an 8-year period. We observed a moderate positive correlation of MED and CCC-generated milestone scores (r = .34, p < .001). There was a nonstatistically significant weak positive correlation of MED and ABEM ITE scores (r = .13, p = .17). Discussion An early assessment of EM milestones in the PGY 1 year can assist in the prediction of CCC-generated milestone scores for PGY 1 residents. |
| first_indexed | 2024-04-25T00:44:57Z |
| format | Article |
| id | doaj.art-2b5ddc35d4ba48c9b484f729f1e3127c |
| institution | Directory Open Access Journal |
| issn | 2374-8265 |
| language | English |
| last_indexed | 2024-04-25T00:44:57Z |
| publishDate | 2024-03-01 |
| publisher | Association of American Medical Colleges |
| record_format | Article |
| series | MedEdPORTAL |
| spelling | doaj.art-2b5ddc35d4ba48c9b484f729f1e3127c2024-03-12T05:00:11ZengAssociation of American Medical CollegesMedEdPORTAL2374-82652024-03-012010.15766/mep_2374-8265.11386Early Emergency Medicine Milestone Assessment for Predicting First-Year Resident PerformanceRochelle L. Versalle0Brett R. Todd1Nai-Wei Chen2Danielle E. Turner-Lawrence3Third-Year Resident, Department of Emergency Medicine, Oakland University William Beaumont School of MedicineAssociate Professor, Department of Emergency Medicine, Oakland University William Beaumont School of MedicineStatistician, Division of Informatics and Biostatistics, Beaumont InstituteAssociate Professor, Department of Emergency Medicine, Oakland University William Beaumont School of MedicineIntroduction The Accreditation Council for Graduate Medical Education (ACGME) requires emergency medicine (EM) residency training programs to monitor residents' progress using standardized milestones. The first assessment of PGY 1 resident milestones occurs midway through the first year and could miss initial deficiencies. Early assessment of PGY 1 EM resident milestones has potential to identify at-risk residents prior to standard midyear evaluations. We developed an orientation syllabus for PGY 1 residents followed by a milestone assessment. Assessment scores helped predict future milestone scores and American Board of Emergency Medicine (ABEM) In-Training Examination (ITE) scores for PGY 1 residents. Methods From 2013 to 2020, we developed and implemented Milestone Evaluation Day (MED), a simulation-based day and written exam assessing PGY 1 EM residents during their first month on the 23 ACGME 1.0 milestones. MED stations included a history and physical with verbal presentation, patient simulation, vascular access, wound management, and airway management. MED, Clinical Competency Committee-generated (CCC-generated) milestone, and ABEM ITE scores were averaged and compared utilizing Pearson's correlation coefficient. Results Of 112 PGY 1 EM residents, 110 (98%) were analyzed over an 8-year period. We observed a moderate positive correlation of MED and CCC-generated milestone scores (r = .34, p < .001). There was a nonstatistically significant weak positive correlation of MED and ABEM ITE scores (r = .13, p = .17). Discussion An early assessment of EM milestones in the PGY 1 year can assist in the prediction of CCC-generated milestone scores for PGY 1 residents.http://www.mededportal.org/doi/10.15766/mep_2374-8265.11386MilestonesAssessmentClinical Skills Assessment/OSCEsClinical/Procedural Skills TrainingCompetency-Based Medical Education (Competencies, Milestones, EPAs)Emergency Medicine |
| spellingShingle | Rochelle L. Versalle Brett R. Todd Nai-Wei Chen Danielle E. Turner-Lawrence Early Emergency Medicine Milestone Assessment for Predicting First-Year Resident Performance MedEdPORTAL Milestones Assessment Clinical Skills Assessment/OSCEs Clinical/Procedural Skills Training Competency-Based Medical Education (Competencies, Milestones, EPAs) Emergency Medicine |
| title | Early Emergency Medicine Milestone Assessment for Predicting First-Year Resident Performance |
| title_full | Early Emergency Medicine Milestone Assessment for Predicting First-Year Resident Performance |
| title_fullStr | Early Emergency Medicine Milestone Assessment for Predicting First-Year Resident Performance |
| title_full_unstemmed | Early Emergency Medicine Milestone Assessment for Predicting First-Year Resident Performance |
| title_short | Early Emergency Medicine Milestone Assessment for Predicting First-Year Resident Performance |
| title_sort | early emergency medicine milestone assessment for predicting first year resident performance |
| topic | Milestones Assessment Clinical Skills Assessment/OSCEs Clinical/Procedural Skills Training Competency-Based Medical Education (Competencies, Milestones, EPAs) Emergency Medicine |
| url | http://www.mededportal.org/doi/10.15766/mep_2374-8265.11386 |
| work_keys_str_mv | AT rochellelversalle earlyemergencymedicinemilestoneassessmentforpredictingfirstyearresidentperformance AT brettrtodd earlyemergencymedicinemilestoneassessmentforpredictingfirstyearresidentperformance AT naiweichen earlyemergencymedicinemilestoneassessmentforpredictingfirstyearresidentperformance AT danielleeturnerlawrence earlyemergencymedicinemilestoneassessmentforpredictingfirstyearresidentperformance |