Design and assessment of a virtual reality learning environment for firefighters

The use of virtual reality (VR) in firefighter training is promising because it provides cost-effective, safe environments that arouse similar behavioral responses to real-life scenarios. However, the pedagogical potential of VR and its impact on learning outcomes compared to traditional methods is...

Full description

Bibliographic Details
Main Authors: Steven G. Wheeler, Simon Hoermann, Stephan Lukosch, Robert W. Lindeman
Format: Article
Language:English
Published: Frontiers Media S.A. 2024-02-01
Series:Frontiers in Computer Science
Subjects:
Online Access:https://www.frontiersin.org/articles/10.3389/fcomp.2024.1274828/full
_version_ 1797302500146020352
author Steven G. Wheeler
Simon Hoermann
Simon Hoermann
Stephan Lukosch
Robert W. Lindeman
author_facet Steven G. Wheeler
Simon Hoermann
Simon Hoermann
Stephan Lukosch
Robert W. Lindeman
author_sort Steven G. Wheeler
collection DOAJ
description The use of virtual reality (VR) in firefighter training is promising because it provides cost-effective, safe environments that arouse similar behavioral responses to real-life scenarios. However, the pedagogical potential of VR and its impact on learning outcomes compared to traditional methods is currently an under-explored area. This research investigates how well VR can support learning compared to traditional methods in the context of training firefighters in combating vegetation fires. A VR learning environment was developed, informed by a “design for learning” framework providing a pedagogical underpinning. A between-subjects experiment was conducted with 40 participants to measure the knowledge transfer of the VR learning environment against the official textbook. In addition, VR's theorized learning benefits of intrinsic motivation, situational interest, and self-efficacy were compared with textbook-based learning. Lastly, the design quality of the learning environment was assessed based on its learning and user experience. We employed a primarily quantitative approach to data collection and analysis, using a combination of knowledge test results and questionnaires, with supporting qualitative data from semi-structured interviews and observation notes to answer our hypotheses. The results found a significant difference between the knowledge transfer of both conditions, with textbook-based learning more effectively transferring factual and conceptual knowledge than VR. No significant difference was found in reported self-efficacy between the two conditions but was found in reported levels of intrinsic motivation and situational interest, which were higher in the VR condition. The design was found to have facilitated a good user and learning experience, assessed via questionnaire responses. During interviews, VR participants reported high levels of satisfaction with the experience, praising the hands-on learning approach and interactivity, while reporting frustration with the lack of knowledge reinforcement and initial difficulties with the controls. A key finding was that presence was found to be negatively associated with knowledge transfer, which we theorize to be caused by the novelty of the realistic VR environment distracting participants from the more familiar lesson content. This research contributes to the body of work related to knowledge transfer within VR in this domain while highlighting key pedagogical and design considerations that can be used to inform future design implementations.
first_indexed 2024-03-07T23:38:43Z
format Article
id doaj.art-d2bc192eb9134a78968b246740769280
institution Directory Open Access Journal
issn 2624-9898
language English
last_indexed 2024-03-07T23:38:43Z
publishDate 2024-02-01
publisher Frontiers Media S.A.
record_format Article
series Frontiers in Computer Science
spelling doaj.art-d2bc192eb9134a78968b2467407692802024-02-20T04:29:08ZengFrontiers Media S.A.Frontiers in Computer Science2624-98982024-02-01610.3389/fcomp.2024.12748281274828Design and assessment of a virtual reality learning environment for firefightersSteven G. Wheeler0Simon Hoermann1Simon Hoermann2Stephan Lukosch3Robert W. Lindeman4Human Interface Technology Lab NZ, University of Canterbury, Christchurch, New ZealandHuman Interface Technology Lab NZ, University of Canterbury, Christchurch, New ZealandSchool of Product Design, University of Canterbury, Christchurch, New ZealandHuman Interface Technology Lab NZ, University of Canterbury, Christchurch, New ZealandHuman Interface Technology Lab NZ, University of Canterbury, Christchurch, New ZealandThe use of virtual reality (VR) in firefighter training is promising because it provides cost-effective, safe environments that arouse similar behavioral responses to real-life scenarios. However, the pedagogical potential of VR and its impact on learning outcomes compared to traditional methods is currently an under-explored area. This research investigates how well VR can support learning compared to traditional methods in the context of training firefighters in combating vegetation fires. A VR learning environment was developed, informed by a “design for learning” framework providing a pedagogical underpinning. A between-subjects experiment was conducted with 40 participants to measure the knowledge transfer of the VR learning environment against the official textbook. In addition, VR's theorized learning benefits of intrinsic motivation, situational interest, and self-efficacy were compared with textbook-based learning. Lastly, the design quality of the learning environment was assessed based on its learning and user experience. We employed a primarily quantitative approach to data collection and analysis, using a combination of knowledge test results and questionnaires, with supporting qualitative data from semi-structured interviews and observation notes to answer our hypotheses. The results found a significant difference between the knowledge transfer of both conditions, with textbook-based learning more effectively transferring factual and conceptual knowledge than VR. No significant difference was found in reported self-efficacy between the two conditions but was found in reported levels of intrinsic motivation and situational interest, which were higher in the VR condition. The design was found to have facilitated a good user and learning experience, assessed via questionnaire responses. During interviews, VR participants reported high levels of satisfaction with the experience, praising the hands-on learning approach and interactivity, while reporting frustration with the lack of knowledge reinforcement and initial difficulties with the controls. A key finding was that presence was found to be negatively associated with knowledge transfer, which we theorize to be caused by the novelty of the realistic VR environment distracting participants from the more familiar lesson content. This research contributes to the body of work related to knowledge transfer within VR in this domain while highlighting key pedagogical and design considerations that can be used to inform future design implementations.https://www.frontiersin.org/articles/10.3389/fcomp.2024.1274828/fulltrainingfirefightingvirtual reality (VR)human-computer interaction (HCI)pedagogyinstructional design
spellingShingle Steven G. Wheeler
Simon Hoermann
Simon Hoermann
Stephan Lukosch
Robert W. Lindeman
Design and assessment of a virtual reality learning environment for firefighters
Frontiers in Computer Science
training
firefighting
virtual reality (VR)
human-computer interaction (HCI)
pedagogy
instructional design
title Design and assessment of a virtual reality learning environment for firefighters
title_full Design and assessment of a virtual reality learning environment for firefighters
title_fullStr Design and assessment of a virtual reality learning environment for firefighters
title_full_unstemmed Design and assessment of a virtual reality learning environment for firefighters
title_short Design and assessment of a virtual reality learning environment for firefighters
title_sort design and assessment of a virtual reality learning environment for firefighters
topic training
firefighting
virtual reality (VR)
human-computer interaction (HCI)
pedagogy
instructional design
url https://www.frontiersin.org/articles/10.3389/fcomp.2024.1274828/full
work_keys_str_mv AT stevengwheeler designandassessmentofavirtualrealitylearningenvironmentforfirefighters
AT simonhoermann designandassessmentofavirtualrealitylearningenvironmentforfirefighters
AT simonhoermann designandassessmentofavirtualrealitylearningenvironmentforfirefighters
AT stephanlukosch designandassessmentofavirtualrealitylearningenvironmentforfirefighters
AT robertwlindeman designandassessmentofavirtualrealitylearningenvironmentforfirefighters