The Teamwork Assessment Scale: A Novel Instrument to Assess Quality of Undergraduate Medical Students' Teamwork Using the Example of Simulation-based Ward-Rounds
Background: Simulation-based teamwork trainings are considered a powerful training method to advance teamwork, which becomes more relevant in medical education. The measurement of teamwork is of high importance and several instruments have been developed for various medical domains to meet this need...
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | deu |
| Published: |
German Medical Science GMS Publishing House
2015-05-01
|
| Series: | GMS Zeitschrift für Medizinische Ausbildung |
| Subjects: | |
| Online Access: | http://www.egms.de/static/en/journals/zma/2015-32/zma000961.shtml |
| _version_ | 1818147071306235904 |
|---|---|
| author | Kiesewetter, Jan Fischer, Martin R. |
| author_facet | Kiesewetter, Jan Fischer, Martin R. |
| author_sort | Kiesewetter, Jan |
| collection | DOAJ |
| description | Background: Simulation-based teamwork trainings are considered a powerful training method to advance teamwork, which becomes more relevant in medical education. The measurement of teamwork is of high importance and several instruments have been developed for various medical domains to meet this need. To our knowledge, no theoretically-based and easy-to-use measurement instrument has been published nor developed specifically for simulation-based teamwork trainings of medical students. Internist ward-rounds function as an important example of teamwork in medicine.Purposes: The purpose of this study was to provide a validated, theoretically-based instrument that is easy-to-use. Furthermore, this study aimed to identify if and when rater scores relate to performance.Methods: Based on a theoretical framework for teamwork behaviour, items regarding four teamwork components () were developed. In study one, three ward-round scenarios, simulated by 69 students, were videotaped and rated independently by four trained raters. The instrument was tested for the embedded psychometric properties and factorial structure. In study two, the instrument was tested for construct validity with an external criterion with a second set of 100 students and four raters. Results: In study one, the factorial structure matched the theoretical components but was unable to separate Information Exchange and Team Cooperation. The preliminary version showed adequate psychometric properties (Cronbach’s α=.75). In study two, the instrument showed physician rater scores were more reliable in measurement than those of student raters. Furthermore, a close correlation between the scale and clinical performance as an external criteria was shown (r=.64) and the sufficient psychometric properties were replicated (Cronbach’s α=.78).Conclusions: The validation allows for use of the simulated teamwork assessment scale in undergraduate medical ward-round trainings to reliably measure teamwork by physicians. Further studies are needed to verify the applicability of the instrument. |
| first_indexed | 2024-12-11T12:29:25Z |
| format | Article |
| id | doaj.art-8088729a0d9c40e1bb663ea1c365d699 |
| institution | Directory Open Access Journal |
| issn | 1860-3572 |
| language | deu |
| last_indexed | 2024-12-11T12:29:25Z |
| publishDate | 2015-05-01 |
| publisher | German Medical Science GMS Publishing House |
| record_format | Article |
| series | GMS Zeitschrift für Medizinische Ausbildung |
| spelling | doaj.art-8088729a0d9c40e1bb663ea1c365d6992022-12-22T01:07:17ZdeuGerman Medical Science GMS Publishing HouseGMS Zeitschrift für Medizinische Ausbildung1860-35722015-05-01322Doc1910.3205/zma000961The Teamwork Assessment Scale: A Novel Instrument to Assess Quality of Undergraduate Medical Students' Teamwork Using the Example of Simulation-based Ward-RoundsKiesewetter, Jan0Fischer, Martin R.1Klinikum der LMU München, Institut für Didaktik und Ausbildungsforschung in der Medizin, München, GermanyKlinikum der LMU München, Institut für Didaktik und Ausbildungsforschung in der Medizin, München, GermanyBackground: Simulation-based teamwork trainings are considered a powerful training method to advance teamwork, which becomes more relevant in medical education. The measurement of teamwork is of high importance and several instruments have been developed for various medical domains to meet this need. To our knowledge, no theoretically-based and easy-to-use measurement instrument has been published nor developed specifically for simulation-based teamwork trainings of medical students. Internist ward-rounds function as an important example of teamwork in medicine.Purposes: The purpose of this study was to provide a validated, theoretically-based instrument that is easy-to-use. Furthermore, this study aimed to identify if and when rater scores relate to performance.Methods: Based on a theoretical framework for teamwork behaviour, items regarding four teamwork components () were developed. In study one, three ward-round scenarios, simulated by 69 students, were videotaped and rated independently by four trained raters. The instrument was tested for the embedded psychometric properties and factorial structure. In study two, the instrument was tested for construct validity with an external criterion with a second set of 100 students and four raters. Results: In study one, the factorial structure matched the theoretical components but was unable to separate Information Exchange and Team Cooperation. The preliminary version showed adequate psychometric properties (Cronbach’s α=.75). In study two, the instrument showed physician rater scores were more reliable in measurement than those of student raters. Furthermore, a close correlation between the scale and clinical performance as an external criteria was shown (r=.64) and the sufficient psychometric properties were replicated (Cronbach’s α=.78).Conclusions: The validation allows for use of the simulated teamwork assessment scale in undergraduate medical ward-round trainings to reliably measure teamwork by physicians. Further studies are needed to verify the applicability of the instrument.http://www.egms.de/static/en/journals/zma/2015-32/zma000961.shtmlsimulation-based trainingteam trainingteam performance measurementmedical educationteaching and learning |
| spellingShingle | Kiesewetter, Jan Fischer, Martin R. The Teamwork Assessment Scale: A Novel Instrument to Assess Quality of Undergraduate Medical Students' Teamwork Using the Example of Simulation-based Ward-Rounds GMS Zeitschrift für Medizinische Ausbildung simulation-based training team training team performance measurement medical education teaching and learning |
| title | The Teamwork Assessment Scale: A Novel Instrument to Assess Quality of Undergraduate Medical Students' Teamwork Using the Example of Simulation-based Ward-Rounds |
| title_full | The Teamwork Assessment Scale: A Novel Instrument to Assess Quality of Undergraduate Medical Students' Teamwork Using the Example of Simulation-based Ward-Rounds |
| title_fullStr | The Teamwork Assessment Scale: A Novel Instrument to Assess Quality of Undergraduate Medical Students' Teamwork Using the Example of Simulation-based Ward-Rounds |
| title_full_unstemmed | The Teamwork Assessment Scale: A Novel Instrument to Assess Quality of Undergraduate Medical Students' Teamwork Using the Example of Simulation-based Ward-Rounds |
| title_short | The Teamwork Assessment Scale: A Novel Instrument to Assess Quality of Undergraduate Medical Students' Teamwork Using the Example of Simulation-based Ward-Rounds |
| title_sort | teamwork assessment scale a novel instrument to assess quality of undergraduate medical students teamwork using the example of simulation based ward rounds |
| topic | simulation-based training team training team performance measurement medical education teaching and learning |
| url | http://www.egms.de/static/en/journals/zma/2015-32/zma000961.shtml |
| work_keys_str_mv | AT kiesewetterjan theteamworkassessmentscaleanovelinstrumenttoassessqualityofundergraduatemedicalstudentsteamworkusingtheexampleofsimulationbasedwardrounds AT fischermartinr theteamworkassessmentscaleanovelinstrumenttoassessqualityofundergraduatemedicalstudentsteamworkusingtheexampleofsimulationbasedwardrounds AT kiesewetterjan teamworkassessmentscaleanovelinstrumenttoassessqualityofundergraduatemedicalstudentsteamworkusingtheexampleofsimulationbasedwardrounds AT fischermartinr teamworkassessmentscaleanovelinstrumenttoassessqualityofundergraduatemedicalstudentsteamworkusingtheexampleofsimulationbasedwardrounds |