Assessment of esophagogastroduodenoscopy skills on simulators before real-life performance
Background and study aims Operator competency is essential for esophagogastroduodenoscopy (EGD) quality, which makes appropriate training with a final test important. The aims of this study were to develop a test for assessing skills in performing EGD, gather validity evidence for the test, and esta...
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Georg Thieme Verlag KG
2022-06-01
|
| Series: | Endoscopy International Open |
| Online Access: | http://www.thieme-connect.de/DOI/DOI?10.1055/a-1814-9747 |
| _version_ | 1798037802389078016 |
|---|---|
| author | Anders Bo Nielsen Finn Møller Pedersen Christian B. Laursen Lars Konge Stig Laursen |
| author_facet | Anders Bo Nielsen Finn Møller Pedersen Christian B. Laursen Lars Konge Stig Laursen |
| author_sort | Anders Bo Nielsen |
| collection | DOAJ |
| description | Background and study aims Operator competency is essential for esophagogastroduodenoscopy (EGD) quality, which makes appropriate training with a final test important. The aims of this study were to develop a test for assessing skills in performing EGD, gather validity evidence for the test, and establish a credible pass/fail score.
Methods An expert panel developed a practical test using the Simbionix GI Mentor II simulator (3 D Systems) and an EGD phantom (OGI 4, CLA Medical) with a diagnostic (DP) and a technical skills part (TSP) for a prospective validation study. During the test a supervisor measured: 1) total time; 2) degree of mucosal visualization; and 3) landmarks and pathology identification. The contrasting groups standard setting method was used to establish a pass/fail score.
Results We included 15 novices (N), 10 intermediates (I), and 10 experienced endoscopists (E). The internal structure was high with a Cronbach’s alpha of 0.76 for TSP time consumption and 0.74 for the identification of landmarks. Mean total times, in minutes, for the DP were N 15.7, I 11.3, and E 7.0, and for TSP., they were N 7.9, I 8.9, and E 2.9. The total numbers of identified landmarks were N 26, I 41, and E 48. Mean visualization percentages were N 80, I 71, and E 71. A pass/fail standard was established requiring identification of all landmarks and performance of the TSP in < 5 minutes. All experienced endoscopists passed, while none of the endoscopists in the other categories did.
Conclusions We established a test that can distinguish between participants with different competencies. This enables an objective and evidence-based approach to assessment of competencies in EGD. |
| first_indexed | 2024-04-11T21:31:32Z |
| format | Article |
| id | doaj.art-c2fe5789e3bc4a5a96225fe83b346f88 |
| institution | Directory Open Access Journal |
| issn | 2364-3722 2196-9736 |
| language | English |
| last_indexed | 2024-04-11T21:31:32Z |
| publishDate | 2022-06-01 |
| publisher | Georg Thieme Verlag KG |
| record_format | Article |
| series | Endoscopy International Open |
| spelling | doaj.art-c2fe5789e3bc4a5a96225fe83b346f882022-12-22T04:01:59ZengGeorg Thieme Verlag KGEndoscopy International Open2364-37222196-97362022-06-011006E815E82310.1055/a-1814-9747Assessment of esophagogastroduodenoscopy skills on simulators before real-life performanceAnders Bo Nielsen0Finn Møller Pedersen1Christian B. Laursen2Lars Konge3Stig Laursen4Odense University Hospital, SimC – Simulation Center, Odense, DenmarkOdense University Hospital, Department of Medical Gastroenterology, Odense, DenmarkOdense University Hospital, Department of Respiratory Medicine, Odense, DenmarkCapital Region of Denmark – Copenhagen Academy for Medical Education and Simulation, Copenhagen, DenmarkOdense University Hospital, Department of Medical Gastroenterology, Odense, DenmarkBackground and study aims Operator competency is essential for esophagogastroduodenoscopy (EGD) quality, which makes appropriate training with a final test important. The aims of this study were to develop a test for assessing skills in performing EGD, gather validity evidence for the test, and establish a credible pass/fail score. Methods An expert panel developed a practical test using the Simbionix GI Mentor II simulator (3 D Systems) and an EGD phantom (OGI 4, CLA Medical) with a diagnostic (DP) and a technical skills part (TSP) for a prospective validation study. During the test a supervisor measured: 1) total time; 2) degree of mucosal visualization; and 3) landmarks and pathology identification. The contrasting groups standard setting method was used to establish a pass/fail score. Results We included 15 novices (N), 10 intermediates (I), and 10 experienced endoscopists (E). The internal structure was high with a Cronbach’s alpha of 0.76 for TSP time consumption and 0.74 for the identification of landmarks. Mean total times, in minutes, for the DP were N 15.7, I 11.3, and E 7.0, and for TSP., they were N 7.9, I 8.9, and E 2.9. The total numbers of identified landmarks were N 26, I 41, and E 48. Mean visualization percentages were N 80, I 71, and E 71. A pass/fail standard was established requiring identification of all landmarks and performance of the TSP in < 5 minutes. All experienced endoscopists passed, while none of the endoscopists in the other categories did. Conclusions We established a test that can distinguish between participants with different competencies. This enables an objective and evidence-based approach to assessment of competencies in EGD.http://www.thieme-connect.de/DOI/DOI?10.1055/a-1814-9747 |
| spellingShingle | Anders Bo Nielsen Finn Møller Pedersen Christian B. Laursen Lars Konge Stig Laursen Assessment of esophagogastroduodenoscopy skills on simulators before real-life performance Endoscopy International Open |
| title | Assessment of esophagogastroduodenoscopy skills on simulators before real-life performance |
| title_full | Assessment of esophagogastroduodenoscopy skills on simulators before real-life performance |
| title_fullStr | Assessment of esophagogastroduodenoscopy skills on simulators before real-life performance |
| title_full_unstemmed | Assessment of esophagogastroduodenoscopy skills on simulators before real-life performance |
| title_short | Assessment of esophagogastroduodenoscopy skills on simulators before real-life performance |
| title_sort | assessment of esophagogastroduodenoscopy skills on simulators before real life performance |
| url | http://www.thieme-connect.de/DOI/DOI?10.1055/a-1814-9747 |
| work_keys_str_mv | AT andersbonielsen assessmentofesophagogastroduodenoscopyskillsonsimulatorsbeforereallifeperformance AT finnmøllerpedersen assessmentofesophagogastroduodenoscopyskillsonsimulatorsbeforereallifeperformance AT christianblaursen assessmentofesophagogastroduodenoscopyskillsonsimulatorsbeforereallifeperformance AT larskonge assessmentofesophagogastroduodenoscopyskillsonsimulatorsbeforereallifeperformance AT stiglaursen assessmentofesophagogastroduodenoscopyskillsonsimulatorsbeforereallifeperformance |