Heart rate variability analysis for the assessment of immersive emotional arousal using virtual reality: Comparing real and virtual scenarios.
Many affective computing studies have developed automatic emotion recognition models, mostly using emotional images, audio and videos. In recent years, virtual reality (VR) has been also used as a method to elicit emotions in laboratory environments. However, there is still a need to analyse the val...
| Main Authors: | , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Public Library of Science (PLoS)
2021-01-01
|
| Series: | PLoS ONE |
| Online Access: | https://doi.org/10.1371/journal.pone.0254098 |
| _version_ | 1818400162017443840 |
|---|---|
| author | Javier Marín-Morales Juan Luis Higuera-Trujillo Jaime Guixeres Carmen Llinares Mariano Alcañiz Gaetano Valenza |
| author_facet | Javier Marín-Morales Juan Luis Higuera-Trujillo Jaime Guixeres Carmen Llinares Mariano Alcañiz Gaetano Valenza |
| author_sort | Javier Marín-Morales |
| collection | DOAJ |
| description | Many affective computing studies have developed automatic emotion recognition models, mostly using emotional images, audio and videos. In recent years, virtual reality (VR) has been also used as a method to elicit emotions in laboratory environments. However, there is still a need to analyse the validity of VR in order to extrapolate the results it produces and to assess the similarities and differences in physiological responses provoked by real and virtual environments. We investigated the cardiovascular oscillations of 60 participants during a free exploration of a real museum and its virtualisation viewed through a head-mounted display. The differences between the heart rate variability features in the high and low arousal stimuli conditions were analysed through statistical hypothesis testing; and automatic arousal recognition models were developed across the real and the virtual conditions using a support vector machine algorithm with recursive feature selection. The subjects' self-assessments suggested that both museums elicited low and high arousal levels. In addition, the real museum showed differences in terms of cardiovascular responses, differences in vagal activity, while arousal recognition reached 72.92% accuracy. However, we did not find the same arousal-based autonomic nervous system change pattern during the virtual museum exploration. The results showed that, while the direct virtualisation of a real environment might be self-reported as evoking psychological arousal, it does not necessarily evoke the same cardiovascular changes as a real arousing elicitation. These contribute to the understanding of the use of VR in emotion recognition research; future research is needed to study arousal and emotion elicitation in immersive VR. |
| first_indexed | 2024-12-14T07:32:11Z |
| format | Article |
| id | doaj.art-4c52cb43a41a473aa939808f8a290e1e |
| institution | Directory Open Access Journal |
| issn | 1932-6203 |
| language | English |
| last_indexed | 2024-12-14T07:32:11Z |
| publishDate | 2021-01-01 |
| publisher | Public Library of Science (PLoS) |
| record_format | Article |
| series | PLoS ONE |
| spelling | doaj.art-4c52cb43a41a473aa939808f8a290e1e2022-12-21T23:11:20ZengPublic Library of Science (PLoS)PLoS ONE1932-62032021-01-01167e025409810.1371/journal.pone.0254098Heart rate variability analysis for the assessment of immersive emotional arousal using virtual reality: Comparing real and virtual scenarios.Javier Marín-MoralesJuan Luis Higuera-TrujilloJaime GuixeresCarmen LlinaresMariano AlcañizGaetano ValenzaMany affective computing studies have developed automatic emotion recognition models, mostly using emotional images, audio and videos. In recent years, virtual reality (VR) has been also used as a method to elicit emotions in laboratory environments. However, there is still a need to analyse the validity of VR in order to extrapolate the results it produces and to assess the similarities and differences in physiological responses provoked by real and virtual environments. We investigated the cardiovascular oscillations of 60 participants during a free exploration of a real museum and its virtualisation viewed through a head-mounted display. The differences between the heart rate variability features in the high and low arousal stimuli conditions were analysed through statistical hypothesis testing; and automatic arousal recognition models were developed across the real and the virtual conditions using a support vector machine algorithm with recursive feature selection. The subjects' self-assessments suggested that both museums elicited low and high arousal levels. In addition, the real museum showed differences in terms of cardiovascular responses, differences in vagal activity, while arousal recognition reached 72.92% accuracy. However, we did not find the same arousal-based autonomic nervous system change pattern during the virtual museum exploration. The results showed that, while the direct virtualisation of a real environment might be self-reported as evoking psychological arousal, it does not necessarily evoke the same cardiovascular changes as a real arousing elicitation. These contribute to the understanding of the use of VR in emotion recognition research; future research is needed to study arousal and emotion elicitation in immersive VR.https://doi.org/10.1371/journal.pone.0254098 |
| spellingShingle | Javier Marín-Morales Juan Luis Higuera-Trujillo Jaime Guixeres Carmen Llinares Mariano Alcañiz Gaetano Valenza Heart rate variability analysis for the assessment of immersive emotional arousal using virtual reality: Comparing real and virtual scenarios. PLoS ONE |
| title | Heart rate variability analysis for the assessment of immersive emotional arousal using virtual reality: Comparing real and virtual scenarios. |
| title_full | Heart rate variability analysis for the assessment of immersive emotional arousal using virtual reality: Comparing real and virtual scenarios. |
| title_fullStr | Heart rate variability analysis for the assessment of immersive emotional arousal using virtual reality: Comparing real and virtual scenarios. |
| title_full_unstemmed | Heart rate variability analysis for the assessment of immersive emotional arousal using virtual reality: Comparing real and virtual scenarios. |
| title_short | Heart rate variability analysis for the assessment of immersive emotional arousal using virtual reality: Comparing real and virtual scenarios. |
| title_sort | heart rate variability analysis for the assessment of immersive emotional arousal using virtual reality comparing real and virtual scenarios |
| url | https://doi.org/10.1371/journal.pone.0254098 |
| work_keys_str_mv | AT javiermarinmorales heartratevariabilityanalysisfortheassessmentofimmersiveemotionalarousalusingvirtualrealitycomparingrealandvirtualscenarios AT juanluishigueratrujillo heartratevariabilityanalysisfortheassessmentofimmersiveemotionalarousalusingvirtualrealitycomparingrealandvirtualscenarios AT jaimeguixeres heartratevariabilityanalysisfortheassessmentofimmersiveemotionalarousalusingvirtualrealitycomparingrealandvirtualscenarios AT carmenllinares heartratevariabilityanalysisfortheassessmentofimmersiveemotionalarousalusingvirtualrealitycomparingrealandvirtualscenarios AT marianoalcaniz heartratevariabilityanalysisfortheassessmentofimmersiveemotionalarousalusingvirtualrealitycomparingrealandvirtualscenarios AT gaetanovalenza heartratevariabilityanalysisfortheassessmentofimmersiveemotionalarousalusingvirtualrealitycomparingrealandvirtualscenarios |