Measuring teamwork for training in healthcare using eye tracking and pose estimation
Teamwork is critical for safe patient care. Healthcare teams typically train teamwork in simulated clinical situations, which require the ability to measure teamwork via behavior observation. However, the required observations are prone to human biases and include significant cognitive load even for...
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Frontiers Media S.A.
2023-05-01
|
| Series: | Frontiers in Psychology |
| Subjects: | |
| Online Access: | https://www.frontiersin.org/articles/10.3389/fpsyg.2023.1169940/full |
| _version_ | 1827937971555270656 |
|---|---|
| author | Kerrin Elisabeth Weiss Michaela Kolbe Quentin Lohmeyer Mirko Meboldt |
| author_facet | Kerrin Elisabeth Weiss Michaela Kolbe Quentin Lohmeyer Mirko Meboldt |
| author_sort | Kerrin Elisabeth Weiss |
| collection | DOAJ |
| description | Teamwork is critical for safe patient care. Healthcare teams typically train teamwork in simulated clinical situations, which require the ability to measure teamwork via behavior observation. However, the required observations are prone to human biases and include significant cognitive load even for trained instructors. In this observational study we explored how eye tracking and pose estimation as two minimal invasive video-based technologies may measure teamwork during simulation-based teamwork training in healthcare. Mobile eye tracking, measuring where participants look, and multi-person pose estimation, measuring 3D human body and joint position, were used to record 64 third-year medical students who completed a simulated handover case in teams of four. On one hand, we processed the recorded data into the eye contact metric, based on eye tracking and relevant for situational awareness and communication patterns. On the other hand, the distance to patient metric was processed, based on multi-person pose estimation and relevant for team positioning and coordination. After successful data recording, we successfully processed the raw videos to specific teamwork metrics. The average eye contact time was 6.46 s [min 0 s – max 28.01 s], while the average distance to the patient resulted in 1.01 m [min 0.32 m – max 1.6 m]. Both metrics varied significantly between teams and simulated roles of participants (p < 0.001). With the objective, continuous, and reliable metrics we created visualizations illustrating the teams’ interactions. Future research is necessary to generalize our findings and how they may complement existing methods, support instructors, and contribute to the quality of teamwork training in healthcare. |
| first_indexed | 2024-03-13T08:33:09Z |
| format | Article |
| id | doaj.art-bd65fab990714cd6a8e639404e82c7c0 |
| institution | Directory Open Access Journal |
| issn | 1664-1078 |
| language | English |
| last_indexed | 2024-03-13T08:33:09Z |
| publishDate | 2023-05-01 |
| publisher | Frontiers Media S.A. |
| record_format | Article |
| series | Frontiers in Psychology |
| spelling | doaj.art-bd65fab990714cd6a8e639404e82c7c02023-05-31T04:19:30ZengFrontiers Media S.A.Frontiers in Psychology1664-10782023-05-011410.3389/fpsyg.2023.11699401169940Measuring teamwork for training in healthcare using eye tracking and pose estimationKerrin Elisabeth Weiss0Michaela Kolbe1Quentin Lohmeyer2Mirko Meboldt3Product Development Group Zurich, ETH Zurich, Zurich, SwitzerlandSimulation Center, University Hospital Zurich, Zurich, SwitzerlandProduct Development Group Zurich, ETH Zurich, Zurich, SwitzerlandProduct Development Group Zurich, ETH Zurich, Zurich, SwitzerlandTeamwork is critical for safe patient care. Healthcare teams typically train teamwork in simulated clinical situations, which require the ability to measure teamwork via behavior observation. However, the required observations are prone to human biases and include significant cognitive load even for trained instructors. In this observational study we explored how eye tracking and pose estimation as two minimal invasive video-based technologies may measure teamwork during simulation-based teamwork training in healthcare. Mobile eye tracking, measuring where participants look, and multi-person pose estimation, measuring 3D human body and joint position, were used to record 64 third-year medical students who completed a simulated handover case in teams of four. On one hand, we processed the recorded data into the eye contact metric, based on eye tracking and relevant for situational awareness and communication patterns. On the other hand, the distance to patient metric was processed, based on multi-person pose estimation and relevant for team positioning and coordination. After successful data recording, we successfully processed the raw videos to specific teamwork metrics. The average eye contact time was 6.46 s [min 0 s – max 28.01 s], while the average distance to the patient resulted in 1.01 m [min 0.32 m – max 1.6 m]. Both metrics varied significantly between teams and simulated roles of participants (p < 0.001). With the objective, continuous, and reliable metrics we created visualizations illustrating the teams’ interactions. Future research is necessary to generalize our findings and how they may complement existing methods, support instructors, and contribute to the quality of teamwork training in healthcare.https://www.frontiersin.org/articles/10.3389/fpsyg.2023.1169940/fullteamworktrainingeye trackingpose estimationsimulationfeedback |
| spellingShingle | Kerrin Elisabeth Weiss Michaela Kolbe Quentin Lohmeyer Mirko Meboldt Measuring teamwork for training in healthcare using eye tracking and pose estimation Frontiers in Psychology teamwork training eye tracking pose estimation simulation feedback |
| title | Measuring teamwork for training in healthcare using eye tracking and pose estimation |
| title_full | Measuring teamwork for training in healthcare using eye tracking and pose estimation |
| title_fullStr | Measuring teamwork for training in healthcare using eye tracking and pose estimation |
| title_full_unstemmed | Measuring teamwork for training in healthcare using eye tracking and pose estimation |
| title_short | Measuring teamwork for training in healthcare using eye tracking and pose estimation |
| title_sort | measuring teamwork for training in healthcare using eye tracking and pose estimation |
| topic | teamwork training eye tracking pose estimation simulation feedback |
| url | https://www.frontiersin.org/articles/10.3389/fpsyg.2023.1169940/full |
| work_keys_str_mv | AT kerrinelisabethweiss measuringteamworkfortraininginhealthcareusingeyetrackingandposeestimation AT michaelakolbe measuringteamworkfortraininginhealthcareusingeyetrackingandposeestimation AT quentinlohmeyer measuringteamworkfortraininginhealthcareusingeyetrackingandposeestimation AT mirkomeboldt measuringteamworkfortraininginhealthcareusingeyetrackingandposeestimation |