Unraveling the Dynamics of Mental and Visuospatial Workload in Virtual Reality Environments
Mental workload, visuospatial processes and autonomic nervous system (ANS) activity are highly intertwined phenomena crucial for achieving optimal performance and improved mental health. Virtual reality (VR) serves as an effective tool for creating variety of controlled environments to better probe...
| Main Authors: | , , , , , , |
|---|---|
| Other Authors: | |
| Format: | Article |
| Published: |
Multidisciplinary Digital Publishing Institute
2024
|
| Online Access: | https://hdl.handle.net/1721.1/157422 |
| _version_ | 1824457965639303168 |
|---|---|
| author | Bernal, Guillermo Jung, Hahrin Yassı, İsmail Emir Hidalgo, Nelson Alemu, Yodahe Barnes-Diana, Tyler Maes, Pattie |
| author2 | Massachusetts Institute of Technology. Media Laboratory |
| author_facet | Massachusetts Institute of Technology. Media Laboratory Bernal, Guillermo Jung, Hahrin Yassı, İsmail Emir Hidalgo, Nelson Alemu, Yodahe Barnes-Diana, Tyler Maes, Pattie |
| author_sort | Bernal, Guillermo |
| collection | MIT |
| description | Mental workload, visuospatial processes and autonomic nervous system (ANS) activity are highly intertwined phenomena crucial for achieving optimal performance and improved mental health. Virtual reality (VR) serves as an effective tool for creating variety of controlled environments to better probe these features. This study investigates the relationship between mental and visuospatial workload, physiological arousal, and performance during a high-demand task in a VR environment. We utilized a modified version of the popular computer game TETRIS as the task, involving 25 participants, and employed a physiological computing VR headset that simultaneously records multimodal physiological data. Our findings indicate a broadband increase in EEG power just prior to a helper event, followed by a spike of visuospatial engagement (parietal alpha and beta 0-1-3 s) occurring concurrently with a decrease in mental workload (frontal theta 2–4 s), and subsequent decreases in visuospatial engagement (parietal theta at 14 s) and physiological arousal (HRV at 20 s). Regression analysis indicated that the subjective relief and helpfulness of the helper intervention was primarily driven by a decrease in physiological arousal and an increase in visuospatial engagement. These findings highlight the importance of multimodal physiological recording in rich environments, such as real world scenarios and VR, to understand the interplay between the various physiological responses involved in mental and visuospatial workload. |
| first_indexed | 2025-02-19T04:18:23Z |
| format | Article |
| id | mit-1721.1/157422 |
| institution | Massachusetts Institute of Technology |
| last_indexed | 2025-02-19T04:18:23Z |
| publishDate | 2024 |
| publisher | Multidisciplinary Digital Publishing Institute |
| record_format | dspace |
| spelling | mit-1721.1/1574222024-12-23T05:32:56Z Unraveling the Dynamics of Mental and Visuospatial Workload in Virtual Reality Environments Bernal, Guillermo Jung, Hahrin Yassı, İsmail Emir Hidalgo, Nelson Alemu, Yodahe Barnes-Diana, Tyler Maes, Pattie Massachusetts Institute of Technology. Media Laboratory Mental workload, visuospatial processes and autonomic nervous system (ANS) activity are highly intertwined phenomena crucial for achieving optimal performance and improved mental health. Virtual reality (VR) serves as an effective tool for creating variety of controlled environments to better probe these features. This study investigates the relationship between mental and visuospatial workload, physiological arousal, and performance during a high-demand task in a VR environment. We utilized a modified version of the popular computer game TETRIS as the task, involving 25 participants, and employed a physiological computing VR headset that simultaneously records multimodal physiological data. Our findings indicate a broadband increase in EEG power just prior to a helper event, followed by a spike of visuospatial engagement (parietal alpha and beta 0-1-3 s) occurring concurrently with a decrease in mental workload (frontal theta 2–4 s), and subsequent decreases in visuospatial engagement (parietal theta at 14 s) and physiological arousal (HRV at 20 s). Regression analysis indicated that the subjective relief and helpfulness of the helper intervention was primarily driven by a decrease in physiological arousal and an increase in visuospatial engagement. These findings highlight the importance of multimodal physiological recording in rich environments, such as real world scenarios and VR, to understand the interplay between the various physiological responses involved in mental and visuospatial workload. 2024-10-25T16:32:38Z 2024-10-25T16:32:38Z 2024-09-26 2024-10-25T13:42:52Z Article http://purl.org/eprint/type/JournalArticle https://hdl.handle.net/1721.1/157422 Bernal, G.; Jung, H.; Yassı, İ.E.; Hidalgo, N.; Alemu, Y.; Barnes-Diana, T.; Maes, P. Unraveling the Dynamics of Mental and Visuospatial Workload in Virtual Reality Environments. Computers 2024, 13, 246. PUBLISHER_CC http://dx.doi.org/10.3390/computers13100246 Computers Creative Commons Attribution https://creativecommons.org/licenses/by/4.0/ application/pdf Multidisciplinary Digital Publishing Institute Multidisciplinary Digital Publishing Institute |
| spellingShingle | Bernal, Guillermo Jung, Hahrin Yassı, İsmail Emir Hidalgo, Nelson Alemu, Yodahe Barnes-Diana, Tyler Maes, Pattie Unraveling the Dynamics of Mental and Visuospatial Workload in Virtual Reality Environments |
| title | Unraveling the Dynamics of Mental and Visuospatial Workload in Virtual Reality Environments |
| title_full | Unraveling the Dynamics of Mental and Visuospatial Workload in Virtual Reality Environments |
| title_fullStr | Unraveling the Dynamics of Mental and Visuospatial Workload in Virtual Reality Environments |
| title_full_unstemmed | Unraveling the Dynamics of Mental and Visuospatial Workload in Virtual Reality Environments |
| title_short | Unraveling the Dynamics of Mental and Visuospatial Workload in Virtual Reality Environments |
| title_sort | unraveling the dynamics of mental and visuospatial workload in virtual reality environments |
| url | https://hdl.handle.net/1721.1/157422 |
| work_keys_str_mv | AT bernalguillermo unravelingthedynamicsofmentalandvisuospatialworkloadinvirtualrealityenvironments AT junghahrin unravelingthedynamicsofmentalandvisuospatialworkloadinvirtualrealityenvironments AT yassıismailemir unravelingthedynamicsofmentalandvisuospatialworkloadinvirtualrealityenvironments AT hidalgonelson unravelingthedynamicsofmentalandvisuospatialworkloadinvirtualrealityenvironments AT alemuyodahe unravelingthedynamicsofmentalandvisuospatialworkloadinvirtualrealityenvironments AT barnesdianatyler unravelingthedynamicsofmentalandvisuospatialworkloadinvirtualrealityenvironments AT maespattie unravelingthedynamicsofmentalandvisuospatialworkloadinvirtualrealityenvironments |