Workplace-based assessment for anesthesia residents: efficacy and competence issues
Background. Workplace-based assessment (WPBA) is a new technology for evaluating medical residents that is believed to be more effective than traditional multiple-choice tests or exam-based assessment methods. The aim of the study was to investigate the WPBA efficacy in final-year medical residents:...
| Main Authors: | , , , , , , , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Zaslavsky O.Yu.
2023-09-01
|
| Series: | Медицина неотложных состояний |
| Subjects: | |
| Online Access: | https://emergency.zaslavsky.com.ua/index.php/journal/article/view/1611 |
| _version_ | 1797337989529993216 |
|---|---|
| author | K. Bielka I. Kuchyn H. Fomina S. Tarasenko B. Savchenko L. Skolska O. Khomenko M. Omelchuk I. Lisnyy S. Yaroslavska V. Maznichenko O. Naumenko V. Kovalenko |
| author_facet | K. Bielka I. Kuchyn H. Fomina S. Tarasenko B. Savchenko L. Skolska O. Khomenko M. Omelchuk I. Lisnyy S. Yaroslavska V. Maznichenko O. Naumenko V. Kovalenko |
| author_sort | K. Bielka |
| collection | DOAJ |
| description | Background. Workplace-based assessment (WPBA) is a new technology for evaluating medical residents that is believed to be more effective than traditional multiple-choice tests or exam-based assessment methods. The aim of the study was to investigate the WPBA efficacy in final-year medical residents: multi-source feedback (360°) assessment, direct procedure assessment (Anaesthesia-Clinical Evaluation Exercise (A-CEX)) and clinical case-based assessment, and to identify difficult competencies, which graduate residents acquire the least successfully. Materials and methods. From April 1 to June 15, 2023, 36 residents were evaluated at the workplace: the multi-source feedback 360°-evaluation form was filled out by three representatives of the medical team where the resident worked during the on-site part of the residency (1 anesthesiologist, 1 nurse and 1 other specialist); the form of direct procedure assessment was filled out by the teacher on face-to-face bases directly during the resident’s performance of the general anesthesia in low-risk patients (American Society of Anesthesiologists (ASA) I or II), preoperative examination of low-risk patients (ASA I or II) and neuraxial anesthesia in low-risk patients (ASA I or II) with the following feedback; assessment based on a clinical case was carried out by teachers during the conference of residents, where each of them presented a clinical case of anesthetic management or treatment of a critically ill patient. Results. According to the results of the multi-source feedback (360°) evaluation, most of the residents have received 7 or more points out of 10 possible. Communication with the medical team (odds ratio (OR) 1.9 [1.05–3.5], p = 0.048) and management in a critical situation (OR 2 [1.14–3.83], p = 0.024) were most difficult competencies during the multi-source feedback (360°) assessment. During direct procedure of general anesthesia, the most difficult competencies were: 1) management in a critical situation — knowledge/recognition of risks and how to avoid and treat them (OR 5.29 [1.9–14.4], p = 0.001 compared to documentation); 2) solving problems, making decisions (OR 12.6 [1.5–10,4], p = 0.007 compared to documentation); 3) interaction in the team (OR 2.7 [1.1–6.5], p = 0.049). No problematic competencies were identified during the assessment of neuraxial anesthesia competencies and preoperative examination. Conclusions. WPBA techniques such as multi-source feedback (360°) assessment, direct procedure evaluation (A-CEX) and clinical case-based assessment are effective in final year residents, improving their communication skills, readiness to work independently, help identify skill deficiencies. Communication with the medical team and management in a critical situation were difficult competencies during the multi-source feedback (360°) evaluation. Difficult competences during the direct evaluation of general anesthesia turned out to be the management in a critical situation; solving problems, making decisions; interaction in the team. No problematic competencies were identified during the assessment of neuraxial anesthesia competencies and preoperative examination. |
| first_indexed | 2024-03-08T09:24:35Z |
| format | Article |
| id | doaj.art-00d32351e96d43708075b37c707bdf49 |
| institution | Directory Open Access Journal |
| issn | 2224-0586 2307-1230 |
| language | English |
| last_indexed | 2024-03-08T09:24:35Z |
| publishDate | 2023-09-01 |
| publisher | Zaslavsky O.Yu. |
| record_format | Article |
| series | Медицина неотложных состояний |
| spelling | doaj.art-00d32351e96d43708075b37c707bdf492024-01-31T10:18:26ZengZaslavsky O.Yu.Медицина неотложных состояний2224-05862307-12302023-09-0119535236010.22141/2224-0586.19.5.2023.16111611Workplace-based assessment for anesthesia residents: efficacy and competence issuesK. Bielka0https://orcid.org/0000-0003-1185-6835I. Kuchyn1https://orcid.org/0000-0002-9667-1911H. Fomina2https://orcid.org/0000-0003-0778-0778S. Tarasenko3https://orcid.org/0000-0001-9970-4574B. Savchenko4https://orcid.org/0009-0000-3190-6188L. Skolska5https://orcid.org/0000-0001-5519-8227O. Khomenko6https://orcid.org/0000-0002-5017-6384M. Omelchuk7https://orcid.org/0000-0001-8094-165XI. Lisnyy8https://orcid.org/0009-0009-3364-0876S. Yaroslavska9https://orcid.org/0000-0003-2659-5762V. Maznichenko10https://orcid.org/0009-0003-2860-6039O. Naumenko11https://orcid.org/0009-0007-7113-7361V. Kovalenko12https://orcid.org/0009-0005-1157-7547Bogomolets National Medical University, Kyiv, UkraineBogomolets National Medical University, Kyiv, UkraineBogomolets National Medical University, Kyiv, UkraineBogomolets National Medical University, Kyiv, Ukraine; EMC Hospital st. Anna, Piaseczno, PolandBogomolets National Medical University, Kyiv, UkraineBogomolets National Medical University, Kyiv, UkraineBogomolets National Medical University, Kyiv, UkraineBogomolets National Medical University, Kyiv, UkraineBogomolets National Medical University, Kyiv, UkraineBogomolets National Medical University, Kyiv, UkraineBogomolets National Medical University, Kyiv, Ukraine; State Institution “Institute of Urology named after Academician O.F. Vozianov of the National Academy of Medical Sciences of Ukraine”, Kyiv, UkraineBogomolets National Medical University, Kyiv, UkraineBogomolets National Medical University, Kyiv, UkraineBackground. Workplace-based assessment (WPBA) is a new technology for evaluating medical residents that is believed to be more effective than traditional multiple-choice tests or exam-based assessment methods. The aim of the study was to investigate the WPBA efficacy in final-year medical residents: multi-source feedback (360°) assessment, direct procedure assessment (Anaesthesia-Clinical Evaluation Exercise (A-CEX)) and clinical case-based assessment, and to identify difficult competencies, which graduate residents acquire the least successfully. Materials and methods. From April 1 to June 15, 2023, 36 residents were evaluated at the workplace: the multi-source feedback 360°-evaluation form was filled out by three representatives of the medical team where the resident worked during the on-site part of the residency (1 anesthesiologist, 1 nurse and 1 other specialist); the form of direct procedure assessment was filled out by the teacher on face-to-face bases directly during the resident’s performance of the general anesthesia in low-risk patients (American Society of Anesthesiologists (ASA) I or II), preoperative examination of low-risk patients (ASA I or II) and neuraxial anesthesia in low-risk patients (ASA I or II) with the following feedback; assessment based on a clinical case was carried out by teachers during the conference of residents, where each of them presented a clinical case of anesthetic management or treatment of a critically ill patient. Results. According to the results of the multi-source feedback (360°) evaluation, most of the residents have received 7 or more points out of 10 possible. Communication with the medical team (odds ratio (OR) 1.9 [1.05–3.5], p = 0.048) and management in a critical situation (OR 2 [1.14–3.83], p = 0.024) were most difficult competencies during the multi-source feedback (360°) assessment. During direct procedure of general anesthesia, the most difficult competencies were: 1) management in a critical situation — knowledge/recognition of risks and how to avoid and treat them (OR 5.29 [1.9–14.4], p = 0.001 compared to documentation); 2) solving problems, making decisions (OR 12.6 [1.5–10,4], p = 0.007 compared to documentation); 3) interaction in the team (OR 2.7 [1.1–6.5], p = 0.049). No problematic competencies were identified during the assessment of neuraxial anesthesia competencies and preoperative examination. Conclusions. WPBA techniques such as multi-source feedback (360°) assessment, direct procedure evaluation (A-CEX) and clinical case-based assessment are effective in final year residents, improving their communication skills, readiness to work independently, help identify skill deficiencies. Communication with the medical team and management in a critical situation were difficult competencies during the multi-source feedback (360°) evaluation. Difficult competences during the direct evaluation of general anesthesia turned out to be the management in a critical situation; solving problems, making decisions; interaction in the team. No problematic competencies were identified during the assessment of neuraxial anesthesia competencies and preoperative examination.https://emergency.zaslavsky.com.ua/index.php/journal/article/view/1611anesthesiologyresidencycompetency-based educationworkplace-based assessment |
| spellingShingle | K. Bielka I. Kuchyn H. Fomina S. Tarasenko B. Savchenko L. Skolska O. Khomenko M. Omelchuk I. Lisnyy S. Yaroslavska V. Maznichenko O. Naumenko V. Kovalenko Workplace-based assessment for anesthesia residents: efficacy and competence issues Медицина неотложных состояний anesthesiology residency competency-based education workplace-based assessment |
| title | Workplace-based assessment for anesthesia residents: efficacy and competence issues |
| title_full | Workplace-based assessment for anesthesia residents: efficacy and competence issues |
| title_fullStr | Workplace-based assessment for anesthesia residents: efficacy and competence issues |
| title_full_unstemmed | Workplace-based assessment for anesthesia residents: efficacy and competence issues |
| title_short | Workplace-based assessment for anesthesia residents: efficacy and competence issues |
| title_sort | workplace based assessment for anesthesia residents efficacy and competence issues |
| topic | anesthesiology residency competency-based education workplace-based assessment |
| url | https://emergency.zaslavsky.com.ua/index.php/journal/article/view/1611 |
| work_keys_str_mv | AT kbielka workplacebasedassessmentforanesthesiaresidentsefficacyandcompetenceissues AT ikuchyn workplacebasedassessmentforanesthesiaresidentsefficacyandcompetenceissues AT hfomina workplacebasedassessmentforanesthesiaresidentsefficacyandcompetenceissues AT starasenko workplacebasedassessmentforanesthesiaresidentsefficacyandcompetenceissues AT bsavchenko workplacebasedassessmentforanesthesiaresidentsefficacyandcompetenceissues AT lskolska workplacebasedassessmentforanesthesiaresidentsefficacyandcompetenceissues AT okhomenko workplacebasedassessmentforanesthesiaresidentsefficacyandcompetenceissues AT momelchuk workplacebasedassessmentforanesthesiaresidentsefficacyandcompetenceissues AT ilisnyy workplacebasedassessmentforanesthesiaresidentsefficacyandcompetenceissues AT syaroslavska workplacebasedassessmentforanesthesiaresidentsefficacyandcompetenceissues AT vmaznichenko workplacebasedassessmentforanesthesiaresidentsefficacyandcompetenceissues AT onaumenko workplacebasedassessmentforanesthesiaresidentsefficacyandcompetenceissues AT vkovalenko workplacebasedassessmentforanesthesiaresidentsefficacyandcompetenceissues |