Using immersive virtual reality to recreate the synaesthetic experience
Synaesthesia is a condition where people experience unusual sensory or cognitive sensations in response to apparently unrelated stimuli. This paper presents two experiments which aimed to examine whether Virtual Reality (VR) technology can be used to recreate the synaesthetic experience. There is a...
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
SAGE Publishing
2023-05-01
|
| Series: | i-Perception |
| Online Access: | https://doi.org/10.1177/20416695231166305 |
| _version_ | 1797692762469957632 |
|---|---|
| author | Rebecca Taylor Sarune Savickaite Susanna Henderson David Simmons |
| author_facet | Rebecca Taylor Sarune Savickaite Susanna Henderson David Simmons |
| author_sort | Rebecca Taylor |
| collection | DOAJ |
| description | Synaesthesia is a condition where people experience unusual sensory or cognitive sensations in response to apparently unrelated stimuli. This paper presents two experiments which aimed to examine whether Virtual Reality (VR) technology can be used to recreate the synaesthetic experience. There is a lack of research in this area, with most studies focussing primarily on synaesthetic colors. Experiment 1 aimed to build on previous research by using not only a traditional color-picker but also VR to capture a more nuanced picture of synaesthetic perception. A multiple case study design was used to examine the experiences of six participants in detail. Data gathering took place via Zoom. During the initial data-gathering session, participants used a color-picker to provide grapheme-color associations. After this session, some of the participants’ synaesthetic experiences were recreated using a VR-by-proxy approach. Results indicated that VR is capable of capturing elements of synaesthetic perception that other methods have been unable to, such as texture, small degrees of movement, and 3D structure. Experiment 2 expanded upon these findings by moving beyond the VR-by-proxy approach and asking three participants to recreate their own audiovisual synaesthetic associations in the VR environment. Inductive Thematic Analysis was used to analyze the results of this experiment. The potential of expanding this technique to other forms of perceptual diversity is discussed. |
| first_indexed | 2024-03-12T02:33:17Z |
| format | Article |
| id | doaj.art-decc79bb86264df9adff48bf3002f658 |
| institution | Directory Open Access Journal |
| issn | 2041-6695 |
| language | English |
| last_indexed | 2024-03-12T02:33:17Z |
| publishDate | 2023-05-01 |
| publisher | SAGE Publishing |
| record_format | Article |
| series | i-Perception |
| spelling | doaj.art-decc79bb86264df9adff48bf3002f6582023-09-05T05:33:21ZengSAGE Publishingi-Perception2041-66952023-05-011410.1177/20416695231166305Using immersive virtual reality to recreate the synaesthetic experienceRebecca TaylorSarune SavickaiteSusanna HendersonDavid SimmonsSynaesthesia is a condition where people experience unusual sensory or cognitive sensations in response to apparently unrelated stimuli. This paper presents two experiments which aimed to examine whether Virtual Reality (VR) technology can be used to recreate the synaesthetic experience. There is a lack of research in this area, with most studies focussing primarily on synaesthetic colors. Experiment 1 aimed to build on previous research by using not only a traditional color-picker but also VR to capture a more nuanced picture of synaesthetic perception. A multiple case study design was used to examine the experiences of six participants in detail. Data gathering took place via Zoom. During the initial data-gathering session, participants used a color-picker to provide grapheme-color associations. After this session, some of the participants’ synaesthetic experiences were recreated using a VR-by-proxy approach. Results indicated that VR is capable of capturing elements of synaesthetic perception that other methods have been unable to, such as texture, small degrees of movement, and 3D structure. Experiment 2 expanded upon these findings by moving beyond the VR-by-proxy approach and asking three participants to recreate their own audiovisual synaesthetic associations in the VR environment. Inductive Thematic Analysis was used to analyze the results of this experiment. The potential of expanding this technique to other forms of perceptual diversity is discussed.https://doi.org/10.1177/20416695231166305 |
| spellingShingle | Rebecca Taylor Sarune Savickaite Susanna Henderson David Simmons Using immersive virtual reality to recreate the synaesthetic experience i-Perception |
| title | Using immersive virtual reality to recreate the synaesthetic experience |
| title_full | Using immersive virtual reality to recreate the synaesthetic experience |
| title_fullStr | Using immersive virtual reality to recreate the synaesthetic experience |
| title_full_unstemmed | Using immersive virtual reality to recreate the synaesthetic experience |
| title_short | Using immersive virtual reality to recreate the synaesthetic experience |
| title_sort | using immersive virtual reality to recreate the synaesthetic experience |
| url | https://doi.org/10.1177/20416695231166305 |
| work_keys_str_mv | AT rebeccataylor usingimmersivevirtualrealitytorecreatethesynaestheticexperience AT sarunesavickaite usingimmersivevirtualrealitytorecreatethesynaestheticexperience AT susannahenderson usingimmersivevirtualrealitytorecreatethesynaestheticexperience AT davidsimmons usingimmersivevirtualrealitytorecreatethesynaestheticexperience |