Cognitive load estimation in VR flight simulator
This paper discusses the design and development of a low-cost virtual reality (VR) based flight simulator with cognitive load estimation feature using ocular and EEG signals. Focus is on exploring methods to evaluate pilot’s interactions with aircraft by means of quantifying pilot’s perceived...
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Bern Open Publishing
2023-07-01
|
| Series: | Journal of Eye Movement Research |
| Subjects: | |
| Online Access: | https://bop.unibe.ch/JEMR/article/view/9036 |
| _version_ | 1797786971751317504 |
|---|---|
| author | Archana Hebbar Sanjana Vinod Shah, A.K. Abhay Pashilkar Pradipta Biswas |
| author_facet | Archana Hebbar Sanjana Vinod Shah, A.K. Abhay Pashilkar Pradipta Biswas |
| author_sort | Archana Hebbar |
| collection | DOAJ |
| description |
This paper discusses the design and development of a low-cost virtual reality (VR) based flight simulator with cognitive load estimation feature using ocular and EEG signals. Focus is on exploring methods to evaluate pilot’s interactions with aircraft by means of quantifying pilot’s perceived cognitive load under different task scenarios. Realistic target tracking and context of the battlefield is designed in VR. Head mounted eye gaze tracker and EEG headset are used for acquiring pupil diameter, gaze fixation, gaze direction and EEG theta, alpha, and beta band power data in real time. We developed an AI agent model in VR and created scenarios of interactions with the piloted aircraft. To estimate the pilot’s cognitive load, we used low-frequency pupil diameter variations, fixation rate, gaze distribution pattern, EEG signal-based task load index and EEG task engagement index. We compared the physiological measures of workload with the standard user’s inceptor control-based workload metrics. Results of the piloted simulation study indicate that the metrics discussed in the paper have strong association with pilot’s perceived task difficulty.
|
| first_indexed | 2024-03-13T01:15:22Z |
| format | Article |
| id | doaj.art-3e5e25cb765043499c85d9e3a663e545 |
| institution | Directory Open Access Journal |
| issn | 1995-8692 |
| language | English |
| last_indexed | 2024-03-13T01:15:22Z |
| publishDate | 2023-07-01 |
| publisher | Bern Open Publishing |
| record_format | Article |
| series | Journal of Eye Movement Research |
| spelling | doaj.art-3e5e25cb765043499c85d9e3a663e5452023-07-05T10:56:29ZengBern Open PublishingJournal of Eye Movement Research1995-86922023-07-0115310.16910/jemr.15.3.11Cognitive load estimation in VR flight simulatorArchana Hebbar0Sanjana Vinod1Shah, A.K.2Abhay Pashilkar3Pradipta Biswas4Indian Institute of Science, Bengaluru; CSIR-National Aerospace LaboratoriesIndian Institute of Science, Bengaluru, IndiaAll India Institute of Medical Sciences, New Delhi, IndiaCSIR-National Aerospace LaboratoriesIndian Institute of Science, Bengaluru, India This paper discusses the design and development of a low-cost virtual reality (VR) based flight simulator with cognitive load estimation feature using ocular and EEG signals. Focus is on exploring methods to evaluate pilot’s interactions with aircraft by means of quantifying pilot’s perceived cognitive load under different task scenarios. Realistic target tracking and context of the battlefield is designed in VR. Head mounted eye gaze tracker and EEG headset are used for acquiring pupil diameter, gaze fixation, gaze direction and EEG theta, alpha, and beta band power data in real time. We developed an AI agent model in VR and created scenarios of interactions with the piloted aircraft. To estimate the pilot’s cognitive load, we used low-frequency pupil diameter variations, fixation rate, gaze distribution pattern, EEG signal-based task load index and EEG task engagement index. We compared the physiological measures of workload with the standard user’s inceptor control-based workload metrics. Results of the piloted simulation study indicate that the metrics discussed in the paper have strong association with pilot’s perceived task difficulty. https://bop.unibe.ch/JEMR/article/view/9036human factorsvirtual realitycognitive loadocular parameterseye gazeflight simulator |
| spellingShingle | Archana Hebbar Sanjana Vinod Shah, A.K. Abhay Pashilkar Pradipta Biswas Cognitive load estimation in VR flight simulator Journal of Eye Movement Research human factors virtual reality cognitive load ocular parameters eye gaze flight simulator |
| title | Cognitive load estimation in VR flight simulator |
| title_full | Cognitive load estimation in VR flight simulator |
| title_fullStr | Cognitive load estimation in VR flight simulator |
| title_full_unstemmed | Cognitive load estimation in VR flight simulator |
| title_short | Cognitive load estimation in VR flight simulator |
| title_sort | cognitive load estimation in vr flight simulator |
| topic | human factors virtual reality cognitive load ocular parameters eye gaze flight simulator |
| url | https://bop.unibe.ch/JEMR/article/view/9036 |
| work_keys_str_mv | AT archanahebbar cognitiveloadestimationinvrflightsimulator AT sanjanavinod cognitiveloadestimationinvrflightsimulator AT shahak cognitiveloadestimationinvrflightsimulator AT abhaypashilkar cognitiveloadestimationinvrflightsimulator AT pradiptabiswas cognitiveloadestimationinvrflightsimulator |