Investigating the Usability of a Head-Mounted Display Augmented Reality Device in Elementary School Children
Augmenting reality via head-mounted displays (HMD-AR) is an emerging technology in education. The interactivity provided by HMD-AR devices is particularly promising for learning, but presents a challenge to human activity recognition, especially with children. Recent technological advances regarding...
| Main Authors: | , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2021-10-01
|
| Series: | Sensors |
| Subjects: | |
| Online Access: | https://www.mdpi.com/1424-8220/21/19/6623 |
| _version_ | 1797515720402141184 |
|---|---|
| author | Luisa Lauer Kristin Altmeyer Sarah Malone Michael Barz Roland Brünken Daniel Sonntag Markus Peschel |
| author_facet | Luisa Lauer Kristin Altmeyer Sarah Malone Michael Barz Roland Brünken Daniel Sonntag Markus Peschel |
| author_sort | Luisa Lauer |
| collection | DOAJ |
| description | Augmenting reality via head-mounted displays (HMD-AR) is an emerging technology in education. The interactivity provided by HMD-AR devices is particularly promising for learning, but presents a challenge to human activity recognition, especially with children. Recent technological advances regarding speech and gesture recognition concerning Microsoft’s HoloLens 2 may address this prevailing issue. In a within-subjects study with 47 elementary school children (2nd to 6th grade), we examined the usability of the HoloLens 2 using a standardized tutorial on multimodal interaction in AR. The overall system usability was rated “good”. However, several behavioral metrics indicated that specific interaction modes differed in their efficiency. The results are of major importance for the development of learning applications in HMD-AR as they partially deviate from previous findings. In particular, the well-functioning recognition of children’s voice commands that we observed represents a novelty. Furthermore, we found different interaction preferences in HMD-AR among the children. We also found the use of HMD-AR to have a positive effect on children’s activity-related achievement emotions. Overall, our findings can serve as a basis for determining general requirements, possibilities, and limitations of the implementation of educational HMD-AR environments in elementary school classrooms. |
| first_indexed | 2024-03-10T06:51:18Z |
| format | Article |
| id | doaj.art-89c358b763854d64bb6d09cd36628b04 |
| institution | Directory Open Access Journal |
| issn | 1424-8220 |
| language | English |
| last_indexed | 2024-03-10T06:51:18Z |
| publishDate | 2021-10-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Sensors |
| spelling | doaj.art-89c358b763854d64bb6d09cd36628b042023-11-22T16:48:54ZengMDPI AGSensors1424-82202021-10-012119662310.3390/s21196623Investigating the Usability of a Head-Mounted Display Augmented Reality Device in Elementary School ChildrenLuisa Lauer0Kristin Altmeyer1Sarah Malone2Michael Barz3Roland Brünken4Daniel Sonntag5Markus Peschel6Department of Physics, Campus C6.3, Saarland University, 66123 Saarbrücken, GermanyDepartment of Education, Campus A4.2, Saarland University, 66123 Saarbrücken, GermanyDepartment of Education, Campus A4.2, Saarland University, 66123 Saarbrücken, GermanyGerman Research Center for Artificial Intelligence (DFKI), Interactive Machine Learning Department, Stuhlsatzenhausweg 3, Saarland Informatics Campus D3_2, 66123 Saarbrücken, GermanyDepartment of Education, Campus A4.2, Saarland University, 66123 Saarbrücken, GermanyGerman Research Center for Artificial Intelligence (DFKI), Interactive Machine Learning Department, Stuhlsatzenhausweg 3, Saarland Informatics Campus D3_2, 66123 Saarbrücken, GermanyDepartment of Physics, Campus C6.3, Saarland University, 66123 Saarbrücken, GermanyAugmenting reality via head-mounted displays (HMD-AR) is an emerging technology in education. The interactivity provided by HMD-AR devices is particularly promising for learning, but presents a challenge to human activity recognition, especially with children. Recent technological advances regarding speech and gesture recognition concerning Microsoft’s HoloLens 2 may address this prevailing issue. In a within-subjects study with 47 elementary school children (2nd to 6th grade), we examined the usability of the HoloLens 2 using a standardized tutorial on multimodal interaction in AR. The overall system usability was rated “good”. However, several behavioral metrics indicated that specific interaction modes differed in their efficiency. The results are of major importance for the development of learning applications in HMD-AR as they partially deviate from previous findings. In particular, the well-functioning recognition of children’s voice commands that we observed represents a novelty. Furthermore, we found different interaction preferences in HMD-AR among the children. We also found the use of HMD-AR to have a positive effect on children’s activity-related achievement emotions. Overall, our findings can serve as a basis for determining general requirements, possibilities, and limitations of the implementation of educational HMD-AR environments in elementary school classrooms.https://www.mdpi.com/1424-8220/21/19/6623head-mounted displaysaugmented realityhuman activity recognitionusabilityelementary education |
| spellingShingle | Luisa Lauer Kristin Altmeyer Sarah Malone Michael Barz Roland Brünken Daniel Sonntag Markus Peschel Investigating the Usability of a Head-Mounted Display Augmented Reality Device in Elementary School Children Sensors head-mounted displays augmented reality human activity recognition usability elementary education |
| title | Investigating the Usability of a Head-Mounted Display Augmented Reality Device in Elementary School Children |
| title_full | Investigating the Usability of a Head-Mounted Display Augmented Reality Device in Elementary School Children |
| title_fullStr | Investigating the Usability of a Head-Mounted Display Augmented Reality Device in Elementary School Children |
| title_full_unstemmed | Investigating the Usability of a Head-Mounted Display Augmented Reality Device in Elementary School Children |
| title_short | Investigating the Usability of a Head-Mounted Display Augmented Reality Device in Elementary School Children |
| title_sort | investigating the usability of a head mounted display augmented reality device in elementary school children |
| topic | head-mounted displays augmented reality human activity recognition usability elementary education |
| url | https://www.mdpi.com/1424-8220/21/19/6623 |
| work_keys_str_mv | AT luisalauer investigatingtheusabilityofaheadmounteddisplayaugmentedrealitydeviceinelementaryschoolchildren AT kristinaltmeyer investigatingtheusabilityofaheadmounteddisplayaugmentedrealitydeviceinelementaryschoolchildren AT sarahmalone investigatingtheusabilityofaheadmounteddisplayaugmentedrealitydeviceinelementaryschoolchildren AT michaelbarz investigatingtheusabilityofaheadmounteddisplayaugmentedrealitydeviceinelementaryschoolchildren AT rolandbrunken investigatingtheusabilityofaheadmounteddisplayaugmentedrealitydeviceinelementaryschoolchildren AT danielsonntag investigatingtheusabilityofaheadmounteddisplayaugmentedrealitydeviceinelementaryschoolchildren AT markuspeschel investigatingtheusabilityofaheadmounteddisplayaugmentedrealitydeviceinelementaryschoolchildren |