Analysis of Communication, Team Situational Awareness, and Feedback in a Three-Person Intelligent Team Tutoring System
This research assessed how the performance and team skills of three-person teams working with an Intelligent Team Tutoring System (ITTS) on a virtual military surveillance task were affected by feedback privacy, participant role, task experience, prior team experience, and teammate familiarity. Prev...
| Main Authors: | , , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Frontiers Media S.A.
2021-03-01
|
| Series: | Frontiers in Psychology |
| Subjects: | |
| Online Access: | https://www.frontiersin.org/articles/10.3389/fpsyg.2021.553015/full |
| _version_ | 1818416960274169856 |
|---|---|
| author | Kaitlyn M. Ouverson Alec G. Ostrander Jamiahus Walton Adam Kohl Stephen B. Gilbert Michael C. Dorneich Eliot Winer Anne M. Sinatra |
| author_facet | Kaitlyn M. Ouverson Alec G. Ostrander Jamiahus Walton Adam Kohl Stephen B. Gilbert Michael C. Dorneich Eliot Winer Anne M. Sinatra |
| author_sort | Kaitlyn M. Ouverson |
| collection | DOAJ |
| description | This research assessed how the performance and team skills of three-person teams working with an Intelligent Team Tutoring System (ITTS) on a virtual military surveillance task were affected by feedback privacy, participant role, task experience, prior team experience, and teammate familiarity. Previous work in Intelligent Tutoring Systems (ITSs) has focused on outcomes for task skill training for individual learners. As research extends into intelligent tutoring for teams, both task skills and team skills are necessary for good team performance. This work includes a brief review of previous research on ITTSs, feedback, teams, and teamwork, including the recounting of two categories of a framework of teamwork performance, Communication and Cognition, which are relevant to the present study. This research examines the effects of an intelligent agent, as well as features of the team, its members, and the task being undertaken, on team communication (measured by relevant key-presses) and team situation awareness (as measured by scores on a quiz). Thirty-seven teams of three participants, each at their own computer running a multiplayer surveillance simulation, were given just-in-time private (individually delivered) or public (team-delivered) performance feedback during four 5-min trials. In the fourth trial, two of the three participants switched roles. Feedback type, teamwork experience, and teammate familiarity had no statistically significant effect on communication or team situation awareness. However, higher levels of role experience and task experience showed significant and medium-sized effects on communication performance. Results, based on performance data and structured interview responses, also revealed areas of improvement in future feedback design and a potential benchmark for feedback frequency in an action-oriented serious game-based ITTS. Among the conclusions are six design objectives for future ITTSs, establishing a foundation for future research on designing effective ITTSs that train interpersonal skills to nascent teams. |
| first_indexed | 2024-12-14T11:59:11Z |
| format | Article |
| id | doaj.art-11f65915005e4764bca0a725b87d9f97 |
| institution | Directory Open Access Journal |
| issn | 1664-1078 |
| language | English |
| last_indexed | 2024-12-14T11:59:11Z |
| publishDate | 2021-03-01 |
| publisher | Frontiers Media S.A. |
| record_format | Article |
| series | Frontiers in Psychology |
| spelling | doaj.art-11f65915005e4764bca0a725b87d9f972022-12-21T23:02:01ZengFrontiers Media S.A.Frontiers in Psychology1664-10782021-03-011210.3389/fpsyg.2021.553015553015Analysis of Communication, Team Situational Awareness, and Feedback in a Three-Person Intelligent Team Tutoring SystemKaitlyn M. Ouverson0Alec G. Ostrander1Jamiahus Walton2Adam Kohl3Stephen B. Gilbert4Michael C. Dorneich5Eliot Winer6Anne M. Sinatra7Virtual Reality Applications Center, Iowa State University, Ames, IA, United StatesVirtual Reality Applications Center, Iowa State University, Ames, IA, United StatesVirtual Reality Applications Center, Iowa State University, Ames, IA, United StatesVirtual Reality Applications Center, Iowa State University, Ames, IA, United StatesVirtual Reality Applications Center, Iowa State University, Ames, IA, United StatesVirtual Reality Applications Center, Iowa State University, Ames, IA, United StatesVirtual Reality Applications Center, Iowa State University, Ames, IA, United StatesU.S. Army Combat Capabilities Development Command Soldier Center, Natick, MA, United StatesThis research assessed how the performance and team skills of three-person teams working with an Intelligent Team Tutoring System (ITTS) on a virtual military surveillance task were affected by feedback privacy, participant role, task experience, prior team experience, and teammate familiarity. Previous work in Intelligent Tutoring Systems (ITSs) has focused on outcomes for task skill training for individual learners. As research extends into intelligent tutoring for teams, both task skills and team skills are necessary for good team performance. This work includes a brief review of previous research on ITTSs, feedback, teams, and teamwork, including the recounting of two categories of a framework of teamwork performance, Communication and Cognition, which are relevant to the present study. This research examines the effects of an intelligent agent, as well as features of the team, its members, and the task being undertaken, on team communication (measured by relevant key-presses) and team situation awareness (as measured by scores on a quiz). Thirty-seven teams of three participants, each at their own computer running a multiplayer surveillance simulation, were given just-in-time private (individually delivered) or public (team-delivered) performance feedback during four 5-min trials. In the fourth trial, two of the three participants switched roles. Feedback type, teamwork experience, and teammate familiarity had no statistically significant effect on communication or team situation awareness. However, higher levels of role experience and task experience showed significant and medium-sized effects on communication performance. Results, based on performance data and structured interview responses, also revealed areas of improvement in future feedback design and a potential benchmark for feedback frequency in an action-oriented serious game-based ITTS. Among the conclusions are six design objectives for future ITTSs, establishing a foundation for future research on designing effective ITTSs that train interpersonal skills to nascent teams.https://www.frontiersin.org/articles/10.3389/fpsyg.2021.553015/fullsituation awarenessteam cognitionteam communicationteam trainingintelligent team tutoring systemsmall group dynamics |
| spellingShingle | Kaitlyn M. Ouverson Alec G. Ostrander Jamiahus Walton Adam Kohl Stephen B. Gilbert Michael C. Dorneich Eliot Winer Anne M. Sinatra Analysis of Communication, Team Situational Awareness, and Feedback in a Three-Person Intelligent Team Tutoring System Frontiers in Psychology situation awareness team cognition team communication team training intelligent team tutoring system small group dynamics |
| title | Analysis of Communication, Team Situational Awareness, and Feedback in a Three-Person Intelligent Team Tutoring System |
| title_full | Analysis of Communication, Team Situational Awareness, and Feedback in a Three-Person Intelligent Team Tutoring System |
| title_fullStr | Analysis of Communication, Team Situational Awareness, and Feedback in a Three-Person Intelligent Team Tutoring System |
| title_full_unstemmed | Analysis of Communication, Team Situational Awareness, and Feedback in a Three-Person Intelligent Team Tutoring System |
| title_short | Analysis of Communication, Team Situational Awareness, and Feedback in a Three-Person Intelligent Team Tutoring System |
| title_sort | analysis of communication team situational awareness and feedback in a three person intelligent team tutoring system |
| topic | situation awareness team cognition team communication team training intelligent team tutoring system small group dynamics |
| url | https://www.frontiersin.org/articles/10.3389/fpsyg.2021.553015/full |
| work_keys_str_mv | AT kaitlynmouverson analysisofcommunicationteamsituationalawarenessandfeedbackinathreepersonintelligentteamtutoringsystem AT alecgostrander analysisofcommunicationteamsituationalawarenessandfeedbackinathreepersonintelligentteamtutoringsystem AT jamiahuswalton analysisofcommunicationteamsituationalawarenessandfeedbackinathreepersonintelligentteamtutoringsystem AT adamkohl analysisofcommunicationteamsituationalawarenessandfeedbackinathreepersonintelligentteamtutoringsystem AT stephenbgilbert analysisofcommunicationteamsituationalawarenessandfeedbackinathreepersonintelligentteamtutoringsystem AT michaelcdorneich analysisofcommunicationteamsituationalawarenessandfeedbackinathreepersonintelligentteamtutoringsystem AT eliotwiner analysisofcommunicationteamsituationalawarenessandfeedbackinathreepersonintelligentteamtutoringsystem AT annemsinatra analysisofcommunicationteamsituationalawarenessandfeedbackinathreepersonintelligentteamtutoringsystem |