Reliability and validity testing of team emergency assessment measure in a distributed team context
Medical multi-professional teams are increasingly collaborating via telemedicine. In distributed team settings, members are geographically separated and collaborate through technology. Developing improved training strategies for distributed teams and finding appropriate instruments to assess team pe...
| Main Authors: | , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Frontiers Media S.A.
2023-04-01
|
| Series: | Frontiers in Psychology |
| Subjects: | |
| Online Access: | https://www.frontiersin.org/articles/10.3389/fpsyg.2023.1110306/full |
| _version_ | 1827964203482218496 |
|---|---|
| author | Hanna Morian Maria Härgestam Magnus Hultin Håkan Jonsson Karin Jonsson Torben Nordahl Amorøe Torben Nordahl Amorøe Johan Creutzfeldt Johan Creutzfeldt |
| author_facet | Hanna Morian Maria Härgestam Magnus Hultin Håkan Jonsson Karin Jonsson Torben Nordahl Amorøe Torben Nordahl Amorøe Johan Creutzfeldt Johan Creutzfeldt |
| author_sort | Hanna Morian |
| collection | DOAJ |
| description | Medical multi-professional teams are increasingly collaborating via telemedicine. In distributed team settings, members are geographically separated and collaborate through technology. Developing improved training strategies for distributed teams and finding appropriate instruments to assess team performance is necessary. The Team Emergency Assessment Measure (TEAM), an instrument validated in traditional collocated acute-care settings, was tested for validity and reliability in this study when used for distributed teams. Three raters assessed video recordings of simulated team training scenarios (n = 18) among teams with varying levels of proficiency working with a remotely located physician via telemedicine. Inter-rater reliability, determined by intraclass correlation, was 0.74–0.92 on the TEAM instrument’s three domains of leadership, teamwork, and task management. Internal consistency (Cronbach’s alpha) ranged between 0.89–0.97 for the various domains. Predictive validity was established by comparing scores with proficiency levels. Finally, concurrent validity was established by high correlations, >0.92, between scores in the three TEAM domains and the teams’ overall performance. Our results indicate that TEAM can be used in distributed acute-care team settings and consequently applied in future-directed learning and research on distributed healthcare teams. |
| first_indexed | 2024-04-09T17:12:01Z |
| format | Article |
| id | doaj.art-e4595fd3b228434a85675bb9335713a6 |
| institution | Directory Open Access Journal |
| issn | 1664-1078 |
| language | English |
| last_indexed | 2024-04-09T17:12:01Z |
| publishDate | 2023-04-01 |
| publisher | Frontiers Media S.A. |
| record_format | Article |
| series | Frontiers in Psychology |
| spelling | doaj.art-e4595fd3b228434a85675bb9335713a62023-04-20T05:54:45ZengFrontiers Media S.A.Frontiers in Psychology1664-10782023-04-011410.3389/fpsyg.2023.11103061110306Reliability and validity testing of team emergency assessment measure in a distributed team contextHanna Morian0Maria Härgestam1Magnus Hultin2Håkan Jonsson3Karin Jonsson4Torben Nordahl Amorøe5Torben Nordahl Amorøe6Johan Creutzfeldt7Johan Creutzfeldt8Department of Nursing, Umeå University, Umeå, SwedenDepartment of Nursing, Umeå University, Umeå, SwedenDepartment of Surgical and Perioperative Sciences, Anesthesia and Critical Care Medicine, Umeå University, Umeå, SwedenDepartment of Epidemiology and Global Health, Umeå University, Umeå, SwedenDepartment of Nursing, Umeå University, Umeå, SwedenDepartment of Molecular and Clinical Medicine, Institute of Medicine, Sahlgrenska Academy, University of Gothenburg, Gothenburg, SwedenSimulation Center West, Department of Research, Education, and Development, Region Västra Götaland, Sahlgrenska University Hospital, Gothenburg, SwedenDepartment of Clinical Science, Intervention, and Technology, Karolinska Institute, Stockholm, SwedenCenter for Advanced Medical Simulation and Training, Karolinska University Hospital, Stockholm, SwedenMedical multi-professional teams are increasingly collaborating via telemedicine. In distributed team settings, members are geographically separated and collaborate through technology. Developing improved training strategies for distributed teams and finding appropriate instruments to assess team performance is necessary. The Team Emergency Assessment Measure (TEAM), an instrument validated in traditional collocated acute-care settings, was tested for validity and reliability in this study when used for distributed teams. Three raters assessed video recordings of simulated team training scenarios (n = 18) among teams with varying levels of proficiency working with a remotely located physician via telemedicine. Inter-rater reliability, determined by intraclass correlation, was 0.74–0.92 on the TEAM instrument’s three domains of leadership, teamwork, and task management. Internal consistency (Cronbach’s alpha) ranged between 0.89–0.97 for the various domains. Predictive validity was established by comparing scores with proficiency levels. Finally, concurrent validity was established by high correlations, >0.92, between scores in the three TEAM domains and the teams’ overall performance. Our results indicate that TEAM can be used in distributed acute-care team settings and consequently applied in future-directed learning and research on distributed healthcare teams.https://www.frontiersin.org/articles/10.3389/fpsyg.2023.1110306/fullinterprofessional teamsteam performanceteamworkdistributed teamtelemedicineinstrument |
| spellingShingle | Hanna Morian Maria Härgestam Magnus Hultin Håkan Jonsson Karin Jonsson Torben Nordahl Amorøe Torben Nordahl Amorøe Johan Creutzfeldt Johan Creutzfeldt Reliability and validity testing of team emergency assessment measure in a distributed team context Frontiers in Psychology interprofessional teams team performance teamwork distributed team telemedicine instrument |
| title | Reliability and validity testing of team emergency assessment measure in a distributed team context |
| title_full | Reliability and validity testing of team emergency assessment measure in a distributed team context |
| title_fullStr | Reliability and validity testing of team emergency assessment measure in a distributed team context |
| title_full_unstemmed | Reliability and validity testing of team emergency assessment measure in a distributed team context |
| title_short | Reliability and validity testing of team emergency assessment measure in a distributed team context |
| title_sort | reliability and validity testing of team emergency assessment measure in a distributed team context |
| topic | interprofessional teams team performance teamwork distributed team telemedicine instrument |
| url | https://www.frontiersin.org/articles/10.3389/fpsyg.2023.1110306/full |
| work_keys_str_mv | AT hannamorian reliabilityandvaliditytestingofteamemergencyassessmentmeasureinadistributedteamcontext AT mariahargestam reliabilityandvaliditytestingofteamemergencyassessmentmeasureinadistributedteamcontext AT magnushultin reliabilityandvaliditytestingofteamemergencyassessmentmeasureinadistributedteamcontext AT hakanjonsson reliabilityandvaliditytestingofteamemergencyassessmentmeasureinadistributedteamcontext AT karinjonsson reliabilityandvaliditytestingofteamemergencyassessmentmeasureinadistributedteamcontext AT torbennordahlamorøe reliabilityandvaliditytestingofteamemergencyassessmentmeasureinadistributedteamcontext AT torbennordahlamorøe reliabilityandvaliditytestingofteamemergencyassessmentmeasureinadistributedteamcontext AT johancreutzfeldt reliabilityandvaliditytestingofteamemergencyassessmentmeasureinadistributedteamcontext AT johancreutzfeldt reliabilityandvaliditytestingofteamemergencyassessmentmeasureinadistributedteamcontext |