Virtual reality alters cortical oscillations related to visuo-tactile integration during rubber hand illusion

Abstract Virtual reality (VR) enables the fast, free, and highly controllable setting of experimental body images. Illusions pertaining to a body, such as the rubber hand illusion (RHI), can be easily conducted in VR settings, and some phenomena, such as full-body illusions, are only realized in vir...

Full description

Bibliographic Details
Main Authors: Noriaki Kanayama, Masayuki Hara, Kenta Kimura
Format: Article
Language:English
Published: Nature Portfolio 2021-01-01
Series:Scientific Reports
Online Access:https://doi.org/10.1038/s41598-020-80807-y
_version_ 1818840896621248512
author Noriaki Kanayama
Masayuki Hara
Kenta Kimura
author_facet Noriaki Kanayama
Masayuki Hara
Kenta Kimura
author_sort Noriaki Kanayama
collection DOAJ
description Abstract Virtual reality (VR) enables the fast, free, and highly controllable setting of experimental body images. Illusions pertaining to a body, such as the rubber hand illusion (RHI), can be easily conducted in VR settings, and some phenomena, such as full-body illusions, are only realized in virtual environments. However, the multisensory-integration process in VR is not yet fully understood. Thus, it remains to be clarified if specific phenomena that occur under VR settings manifest in real life as well. One useful investigative approach is measuring brain activities during a psychological experiment. Electroencephalography (EEG) oscillatory activities provide insight into the human multisensory integration process. Nevertheless, EEG data can be vulnerable to VR noise, which causes measurement and analytical difficulties for EEG data recorded in VR environments. Here, we achieve an experimental RHI setting using a head-mounted display that provides a VR visual space and VR dummy hand along with EEG measurements. We compared EEG data collected in both real and VR environments and observed the gamma and theta band oscillatory activities. Ultimately, we observed statistically significant differences between congruent (RHI) and incongruent (not RHI) conditions in the real environment, which is consistent with previous studies. Differences in the VR condition were observed only on the late theta band oscillation, suggesting that the VR setting itself altered the perceptual and sensory integration mechanisms. Thus, we must model this difference between real and VR settings whenever we use VR to investigate our bodily self-perception.
first_indexed 2024-12-19T04:17:28Z
format Article
id doaj.art-3a310b5405f741faa309121bd2ec1481
institution Directory Open Access Journal
issn 2045-2322
language English
last_indexed 2024-12-19T04:17:28Z
publishDate 2021-01-01
publisher Nature Portfolio
record_format Article
series Scientific Reports
spelling doaj.art-3a310b5405f741faa309121bd2ec14812022-12-21T20:36:15ZengNature PortfolioScientific Reports2045-23222021-01-0111111310.1038/s41598-020-80807-yVirtual reality alters cortical oscillations related to visuo-tactile integration during rubber hand illusionNoriaki Kanayama0Masayuki Hara1Kenta Kimura2Human Informatics and Interaction Research Institute, National Institute of Advanced Industrial Science and Technology (AIST)Graduate School of Science and Engineering, Saitama UniversityHuman Informatics and Interaction Research Institute, National Institute of Advanced Industrial Science and Technology (AIST)Abstract Virtual reality (VR) enables the fast, free, and highly controllable setting of experimental body images. Illusions pertaining to a body, such as the rubber hand illusion (RHI), can be easily conducted in VR settings, and some phenomena, such as full-body illusions, are only realized in virtual environments. However, the multisensory-integration process in VR is not yet fully understood. Thus, it remains to be clarified if specific phenomena that occur under VR settings manifest in real life as well. One useful investigative approach is measuring brain activities during a psychological experiment. Electroencephalography (EEG) oscillatory activities provide insight into the human multisensory integration process. Nevertheless, EEG data can be vulnerable to VR noise, which causes measurement and analytical difficulties for EEG data recorded in VR environments. Here, we achieve an experimental RHI setting using a head-mounted display that provides a VR visual space and VR dummy hand along with EEG measurements. We compared EEG data collected in both real and VR environments and observed the gamma and theta band oscillatory activities. Ultimately, we observed statistically significant differences between congruent (RHI) and incongruent (not RHI) conditions in the real environment, which is consistent with previous studies. Differences in the VR condition were observed only on the late theta band oscillation, suggesting that the VR setting itself altered the perceptual and sensory integration mechanisms. Thus, we must model this difference between real and VR settings whenever we use VR to investigate our bodily self-perception.https://doi.org/10.1038/s41598-020-80807-y
spellingShingle Noriaki Kanayama
Masayuki Hara
Kenta Kimura
Virtual reality alters cortical oscillations related to visuo-tactile integration during rubber hand illusion
Scientific Reports
title Virtual reality alters cortical oscillations related to visuo-tactile integration during rubber hand illusion
title_full Virtual reality alters cortical oscillations related to visuo-tactile integration during rubber hand illusion
title_fullStr Virtual reality alters cortical oscillations related to visuo-tactile integration during rubber hand illusion
title_full_unstemmed Virtual reality alters cortical oscillations related to visuo-tactile integration during rubber hand illusion
title_short Virtual reality alters cortical oscillations related to visuo-tactile integration during rubber hand illusion
title_sort virtual reality alters cortical oscillations related to visuo tactile integration during rubber hand illusion
url https://doi.org/10.1038/s41598-020-80807-y
work_keys_str_mv AT noriakikanayama virtualrealityalterscorticaloscillationsrelatedtovisuotactileintegrationduringrubberhandillusion
AT masayukihara virtualrealityalterscorticaloscillationsrelatedtovisuotactileintegrationduringrubberhandillusion
AT kentakimura virtualrealityalterscorticaloscillationsrelatedtovisuotactileintegrationduringrubberhandillusion