Milestones-based direct observation tools in internal medicine resident continuity clinic
Abstract Background With milestones-based assessment, there is an increased need for tools to facilitate direct observation of clinical trainees. This study was designed to compare a Mini-CEX tool to new direct observation tools (DOTs) linked to internal medicine milestones. Methods A web based surv...
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
BMC
2017-12-01
|
| Series: | BMC Medical Education |
| Online Access: | http://link.springer.com/article/10.1186/s12909-017-1077-y |
| _version_ | 1819038112868728832 |
|---|---|
| author | Jonathan P. B. Berz Teresa Cheng Lisa M. Quintiliani |
| author_facet | Jonathan P. B. Berz Teresa Cheng Lisa M. Quintiliani |
| author_sort | Jonathan P. B. Berz |
| collection | DOAJ |
| description | Abstract Background With milestones-based assessment, there is an increased need for tools to facilitate direct observation of clinical trainees. This study was designed to compare a Mini-CEX tool to new direct observation tools (DOTs) linked to internal medicine milestones. Methods A web based survey was used to examine satisfaction and usefulness of DOTs compared to the Mini-CEX. Residents and preceptors were surveyed three times over 6 months with half serving as control (using mini-CEX) compared to those using the DOTs. Likert scale quantitative answers and qualitative comments were analyzed using generalized estimating equations. Results Out of 94 residents and 32 faculty 81 and 90% completed the survey for at least one time point. In adjusted models, there was no significant change in resident evaluation comparing the tools on a number of questions including overall satisfaction and resident perception of receiving high quality feedback. By contrast, faculty preceptors reported increased ratings on many of the questions evaluating their use of the new tools including ability to provide higher quality feedback and overall satisfaction. A number of challenges and benefits of the new tools were identified in qualitative feedback by both residents and preceptors. Conclusions All parties recognized the value and limitations of direct observation. Overall these new office based DOTs were perceived similarly to the mini-CEX by residents while faculty reported higher satisfaction. The DOTs are a useful addition to the tool box available for the assessment of clinical skills of medical trainees, especially from the viewpoint of faculty preceptors. |
| first_indexed | 2024-12-21T08:32:08Z |
| format | Article |
| id | doaj.art-856ad56fbcf84888b35dddf8553c1e8a |
| institution | Directory Open Access Journal |
| issn | 1472-6920 |
| language | English |
| last_indexed | 2024-12-21T08:32:08Z |
| publishDate | 2017-12-01 |
| publisher | BMC |
| record_format | Article |
| series | BMC Medical Education |
| spelling | doaj.art-856ad56fbcf84888b35dddf8553c1e8a2022-12-21T19:10:11ZengBMCBMC Medical Education1472-69202017-12-011711710.1186/s12909-017-1077-yMilestones-based direct observation tools in internal medicine resident continuity clinicJonathan P. B. Berz0Teresa Cheng1Lisa M. Quintiliani2Boston University School of Medicine/Boston Medical CenterBoston University School of Medicine/Boston Medical CenterBoston University School of Medicine/Boston Medical CenterAbstract Background With milestones-based assessment, there is an increased need for tools to facilitate direct observation of clinical trainees. This study was designed to compare a Mini-CEX tool to new direct observation tools (DOTs) linked to internal medicine milestones. Methods A web based survey was used to examine satisfaction and usefulness of DOTs compared to the Mini-CEX. Residents and preceptors were surveyed three times over 6 months with half serving as control (using mini-CEX) compared to those using the DOTs. Likert scale quantitative answers and qualitative comments were analyzed using generalized estimating equations. Results Out of 94 residents and 32 faculty 81 and 90% completed the survey for at least one time point. In adjusted models, there was no significant change in resident evaluation comparing the tools on a number of questions including overall satisfaction and resident perception of receiving high quality feedback. By contrast, faculty preceptors reported increased ratings on many of the questions evaluating their use of the new tools including ability to provide higher quality feedback and overall satisfaction. A number of challenges and benefits of the new tools were identified in qualitative feedback by both residents and preceptors. Conclusions All parties recognized the value and limitations of direct observation. Overall these new office based DOTs were perceived similarly to the mini-CEX by residents while faculty reported higher satisfaction. The DOTs are a useful addition to the tool box available for the assessment of clinical skills of medical trainees, especially from the viewpoint of faculty preceptors.http://link.springer.com/article/10.1186/s12909-017-1077-y |
| spellingShingle | Jonathan P. B. Berz Teresa Cheng Lisa M. Quintiliani Milestones-based direct observation tools in internal medicine resident continuity clinic BMC Medical Education |
| title | Milestones-based direct observation tools in internal medicine resident continuity clinic |
| title_full | Milestones-based direct observation tools in internal medicine resident continuity clinic |
| title_fullStr | Milestones-based direct observation tools in internal medicine resident continuity clinic |
| title_full_unstemmed | Milestones-based direct observation tools in internal medicine resident continuity clinic |
| title_short | Milestones-based direct observation tools in internal medicine resident continuity clinic |
| title_sort | milestones based direct observation tools in internal medicine resident continuity clinic |
| url | http://link.springer.com/article/10.1186/s12909-017-1077-y |
| work_keys_str_mv | AT jonathanpbberz milestonesbaseddirectobservationtoolsininternalmedicineresidentcontinuityclinic AT teresacheng milestonesbaseddirectobservationtoolsininternalmedicineresidentcontinuityclinic AT lisamquintiliani milestonesbaseddirectobservationtoolsininternalmedicineresidentcontinuityclinic |