Aligning Institutional OSCEs with Clinical Learning Environment Review Focus Areas and Competencies
Abstract Introduction The Accreditation Council of Graduate Medical Education's Next Accreditation System's focus on outcomes presents unique challenges and opportunities to institutions and residency programs. Programs must review how well current measures address the new requirements and...
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Association of American Medical Colleges
2015-03-01
|
| Series: | MedEdPORTAL |
| Subjects: | |
| Online Access: | http://www.mededportal.org/doi/10.15766/mep_2374-8265.10025 |
| _version_ | 1798035696335716352 |
|---|---|
| author | Lisa Dillon Tsveti Markova Simone Brennan Maria Kokas |
| author_facet | Lisa Dillon Tsveti Markova Simone Brennan Maria Kokas |
| author_sort | Lisa Dillon |
| collection | DOAJ |
| description | Abstract Introduction The Accreditation Council of Graduate Medical Education's Next Accreditation System's focus on outcomes presents unique challenges and opportunities to institutions and residency programs. Programs must review how well current measures address the new requirements and develop ways to capture missing elements through direct observation tools such as the objective structured clinical examination (OSCE). As a means to ensure standardized assessment of a communication and interpersonal skills curricula a series of OSCE cases were developed for residents at all levels of training. Methods For 2 years, the five nonspecialty-specific OSCEs were conducted at a simulation center to formatively assess residents' interpersonal and communication skills (IPC): delivering bad news, error disclosure, informed consent, surgical health care disparity, and medical health care disparity. Each patient encounter lasted 8 minutes, after which standardized patients (SPs) were given 3 minutes to score a given resident's IPC using the adapted form of the Kalamazoo Essential Elements Communication Checklist (KEECC-A), while the resident completed a self-evaluation. After that, SPs had 5 minutes to provide verbal feedback to the residents, who then attended a short group debriefing session. Fourteen SPs received structured training for this OSCE in both role portrayal and rating resident performance utilizing the KEECC-A. A handout aligning KEECC-A with CLER focus areas and competencies was provided to faculty in the second year. Results In the 2012-2013 year, 104 residents participated in the OSCE, and in the 2013-2014 year 112 residents participated. When comparing KEECC-A average scores between the 2 years, the 2013-2014 participating residents showed an improvement for the Bad News (t(196) = 3.13, p < .001) and Informed Consent (t(196) = 2.06, p < .05) cases. Feedback from the 2012-2013 year indicated that faculty did not deem the selected cases as ubiquitously relevant across programs, which was reflected in low faculty engagement. Resident feedback also showed a decrease in perceived utility of the OSCE as PGY level increased. After implementation of the handout aligning the KEECC-A with CLER focus areas and competencies, surveys from residents and program directors indicated more favorable attitudes toward the OSCE. Discussion The inclusion and recognition of department faculty champions was critical. In addition to reviewing data with residents, they also recommended how trends could be addressed at the program and institutional level. In addition, the debriefing materials for each case was essential; faculty remarked that little preparation and orientation was needed and helped them discuss the cases with residents. |
| first_indexed | 2024-04-11T21:01:46Z |
| format | Article |
| id | doaj.art-50ed29b64cac45909f7bd35555560b72 |
| institution | Directory Open Access Journal |
| issn | 2374-8265 |
| language | English |
| last_indexed | 2024-04-11T21:01:46Z |
| publishDate | 2015-03-01 |
| publisher | Association of American Medical Colleges |
| record_format | Article |
| series | MedEdPORTAL |
| spelling | doaj.art-50ed29b64cac45909f7bd35555560b722022-12-22T04:03:28ZengAssociation of American Medical CollegesMedEdPORTAL2374-82652015-03-011110.15766/mep_2374-8265.10025Aligning Institutional OSCEs with Clinical Learning Environment Review Focus Areas and CompetenciesLisa Dillon0Tsveti Markova1Simone Brennan2Maria Kokas31 Wayne State University School of Medicine2 Wayne State University School of Medicine3 Wayne State University School of Medicine4 Henry Ford Health SystemAbstract Introduction The Accreditation Council of Graduate Medical Education's Next Accreditation System's focus on outcomes presents unique challenges and opportunities to institutions and residency programs. Programs must review how well current measures address the new requirements and develop ways to capture missing elements through direct observation tools such as the objective structured clinical examination (OSCE). As a means to ensure standardized assessment of a communication and interpersonal skills curricula a series of OSCE cases were developed for residents at all levels of training. Methods For 2 years, the five nonspecialty-specific OSCEs were conducted at a simulation center to formatively assess residents' interpersonal and communication skills (IPC): delivering bad news, error disclosure, informed consent, surgical health care disparity, and medical health care disparity. Each patient encounter lasted 8 minutes, after which standardized patients (SPs) were given 3 minutes to score a given resident's IPC using the adapted form of the Kalamazoo Essential Elements Communication Checklist (KEECC-A), while the resident completed a self-evaluation. After that, SPs had 5 minutes to provide verbal feedback to the residents, who then attended a short group debriefing session. Fourteen SPs received structured training for this OSCE in both role portrayal and rating resident performance utilizing the KEECC-A. A handout aligning KEECC-A with CLER focus areas and competencies was provided to faculty in the second year. Results In the 2012-2013 year, 104 residents participated in the OSCE, and in the 2013-2014 year 112 residents participated. When comparing KEECC-A average scores between the 2 years, the 2013-2014 participating residents showed an improvement for the Bad News (t(196) = 3.13, p < .001) and Informed Consent (t(196) = 2.06, p < .05) cases. Feedback from the 2012-2013 year indicated that faculty did not deem the selected cases as ubiquitously relevant across programs, which was reflected in low faculty engagement. Resident feedback also showed a decrease in perceived utility of the OSCE as PGY level increased. After implementation of the handout aligning the KEECC-A with CLER focus areas and competencies, surveys from residents and program directors indicated more favorable attitudes toward the OSCE. Discussion The inclusion and recognition of department faculty champions was critical. In addition to reviewing data with residents, they also recommended how trends could be addressed at the program and institutional level. In addition, the debriefing materials for each case was essential; faculty remarked that little preparation and orientation was needed and helped them discuss the cases with residents.http://www.mededportal.org/doi/10.15766/mep_2374-8265.10025OSCEProfessionalismCompetenciesSystems-Based PracticeCLERPractice-Based Learning |
| spellingShingle | Lisa Dillon Tsveti Markova Simone Brennan Maria Kokas Aligning Institutional OSCEs with Clinical Learning Environment Review Focus Areas and Competencies MedEdPORTAL OSCE Professionalism Competencies Systems-Based Practice CLER Practice-Based Learning |
| title | Aligning Institutional OSCEs with Clinical Learning Environment Review Focus Areas and Competencies |
| title_full | Aligning Institutional OSCEs with Clinical Learning Environment Review Focus Areas and Competencies |
| title_fullStr | Aligning Institutional OSCEs with Clinical Learning Environment Review Focus Areas and Competencies |
| title_full_unstemmed | Aligning Institutional OSCEs with Clinical Learning Environment Review Focus Areas and Competencies |
| title_short | Aligning Institutional OSCEs with Clinical Learning Environment Review Focus Areas and Competencies |
| title_sort | aligning institutional osces with clinical learning environment review focus areas and competencies |
| topic | OSCE Professionalism Competencies Systems-Based Practice CLER Practice-Based Learning |
| url | http://www.mededportal.org/doi/10.15766/mep_2374-8265.10025 |
| work_keys_str_mv | AT lisadillon aligninginstitutionalosceswithclinicallearningenvironmentreviewfocusareasandcompetencies AT tsvetimarkova aligninginstitutionalosceswithclinicallearningenvironmentreviewfocusareasandcompetencies AT simonebrennan aligninginstitutionalosceswithclinicallearningenvironmentreviewfocusareasandcompetencies AT mariakokas aligninginstitutionalosceswithclinicallearningenvironmentreviewfocusareasandcompetencies |