Shared Avatar for Hand Movement Imitation: Subjective and Behavioral Analyses
Virtual co-embodiment enables sharing avatars with others in virtual environments and can be applied for training motor skills by allowing teachers to share movements with learners in first-person perspective. We conducted a task where participants were asked to imitate pre-recorded hand movements o...
| Main Authors: | , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
IEEE
2023-01-01
|
| Series: | IEEE Access |
| Subjects: | |
| Online Access: | https://ieeexplore.ieee.org/document/10239382/ |
| _version_ | 1797687968509460480 |
|---|---|
| author | Yasunobu Katsumata Yasuyuki Inoue Satoshi Toriumi Hiroki Ishimoto Harin Hapuarachchi Michiteru Kitazaki |
| author_facet | Yasunobu Katsumata Yasuyuki Inoue Satoshi Toriumi Hiroki Ishimoto Harin Hapuarachchi Michiteru Kitazaki |
| author_sort | Yasunobu Katsumata |
| collection | DOAJ |
| description | Virtual co-embodiment enables sharing avatars with others in virtual environments and can be applied for training motor skills by allowing teachers to share movements with learners in first-person perspective. We conducted a task where participants were asked to imitate pre-recorded hand movements of a teacher as accurately as possible. The participant’s virtual hand movements were averaged in real-time with those of the teacher (shared avatar hand). We compared their usability ratings and behavior against a controlled condition with full control of the hand (solo avatar hand). The teacher’s hand was displayed facing the same or the opposite direction as the participant’s hand. We hypothesized that using the shared avatar hand would improve imitation over using the solo hand, and the teacher’s hand presented in the same direction is better than that in the opposite direction. Subjective ratings showed that the shared hand was easier to use than the solo hand, and the teacher’s hand when presented in the same direction was easier to imitate than when presented in the opposite direction. Spatial error was less with the opposite-direction presentation than the same-direction presentation of the teacher’s hand, irrespective of movement sharing. Time delay was less when the participants used the shared hand compared to when they used the solo hand, irrespective of the teacher’s hand direction. These results suggest that sharing movements enhances usability and matching speed during movement imitation, and the same-direction presentation of the teacher’s hand improves usability while the opposite-direction presentation improves spatial accuracy of motor imitation. |
| first_indexed | 2024-03-12T01:24:38Z |
| format | Article |
| id | doaj.art-b88747599ed5455cb692212843e62c2e |
| institution | Directory Open Access Journal |
| issn | 2169-3536 |
| language | English |
| last_indexed | 2024-03-12T01:24:38Z |
| publishDate | 2023-01-01 |
| publisher | IEEE |
| record_format | Article |
| series | IEEE Access |
| spelling | doaj.art-b88747599ed5455cb692212843e62c2e2023-09-12T23:00:21ZengIEEEIEEE Access2169-35362023-01-0111967109671710.1109/ACCESS.2023.331217910239382Shared Avatar for Hand Movement Imitation: Subjective and Behavioral AnalysesYasunobu Katsumata0https://orcid.org/0009-0002-1526-858XYasuyuki Inoue1https://orcid.org/0000-0002-7116-9132Satoshi Toriumi2https://orcid.org/0009-0000-0075-1566Hiroki Ishimoto3Harin Hapuarachchi4https://orcid.org/0000-0002-3138-9229Michiteru Kitazaki5https://orcid.org/0000-0003-0966-4842Department of Computer Science and Engineering, Toyohashi University of Technology, Toyohashi, JapanDepartment of Information Systems Engineering, Toyama Prefectural University, Imizu, JapanDepartment of Computer Science and Engineering, Toyohashi University of Technology, Toyohashi, JapanDepartment of Computer Science and Engineering, Toyohashi University of Technology, Toyohashi, JapanDepartment of Computer Science and Engineering, Toyohashi University of Technology, Toyohashi, JapanDepartment of Computer Science and Engineering, Toyohashi University of Technology, Toyohashi, JapanVirtual co-embodiment enables sharing avatars with others in virtual environments and can be applied for training motor skills by allowing teachers to share movements with learners in first-person perspective. We conducted a task where participants were asked to imitate pre-recorded hand movements of a teacher as accurately as possible. The participant’s virtual hand movements were averaged in real-time with those of the teacher (shared avatar hand). We compared their usability ratings and behavior against a controlled condition with full control of the hand (solo avatar hand). The teacher’s hand was displayed facing the same or the opposite direction as the participant’s hand. We hypothesized that using the shared avatar hand would improve imitation over using the solo hand, and the teacher’s hand presented in the same direction is better than that in the opposite direction. Subjective ratings showed that the shared hand was easier to use than the solo hand, and the teacher’s hand when presented in the same direction was easier to imitate than when presented in the opposite direction. Spatial error was less with the opposite-direction presentation than the same-direction presentation of the teacher’s hand, irrespective of movement sharing. Time delay was less when the participants used the shared hand compared to when they used the solo hand, irrespective of the teacher’s hand direction. These results suggest that sharing movements enhances usability and matching speed during movement imitation, and the same-direction presentation of the teacher’s hand improves usability while the opposite-direction presentation improves spatial accuracy of motor imitation.https://ieeexplore.ieee.org/document/10239382/Avatarco-embodimentimitationvirtual realityhuman—computer interaction |
| spellingShingle | Yasunobu Katsumata Yasuyuki Inoue Satoshi Toriumi Hiroki Ishimoto Harin Hapuarachchi Michiteru Kitazaki Shared Avatar for Hand Movement Imitation: Subjective and Behavioral Analyses IEEE Access Avatar co-embodiment imitation virtual reality human—computer interaction |
| title | Shared Avatar for Hand Movement Imitation: Subjective and Behavioral Analyses |
| title_full | Shared Avatar for Hand Movement Imitation: Subjective and Behavioral Analyses |
| title_fullStr | Shared Avatar for Hand Movement Imitation: Subjective and Behavioral Analyses |
| title_full_unstemmed | Shared Avatar for Hand Movement Imitation: Subjective and Behavioral Analyses |
| title_short | Shared Avatar for Hand Movement Imitation: Subjective and Behavioral Analyses |
| title_sort | shared avatar for hand movement imitation subjective and behavioral analyses |
| topic | Avatar co-embodiment imitation virtual reality human—computer interaction |
| url | https://ieeexplore.ieee.org/document/10239382/ |
| work_keys_str_mv | AT yasunobukatsumata sharedavatarforhandmovementimitationsubjectiveandbehavioralanalyses AT yasuyukiinoue sharedavatarforhandmovementimitationsubjectiveandbehavioralanalyses AT satoshitoriumi sharedavatarforhandmovementimitationsubjectiveandbehavioralanalyses AT hirokiishimoto sharedavatarforhandmovementimitationsubjectiveandbehavioralanalyses AT harinhapuarachchi sharedavatarforhandmovementimitationsubjectiveandbehavioralanalyses AT michiterukitazaki sharedavatarforhandmovementimitationsubjectiveandbehavioralanalyses |