Influence of Auditory and Haptic Stimulation in Visual Perception
While many studies have shown that visual information affects perception in the other modalities, little is known about how auditory and haptic information affect visual perception. In this study, we investigated how auditory, haptic, or auditory and haptic stimulation affects visual perception. We...
| Main Authors: | , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
SAGE Publishing
2011-10-01
|
| Series: | i-Perception |
| Online Access: | https://doi.org/10.1068/ic808 |
| _version_ | 1818504700744433664 |
|---|---|
| author | Shunichi Kawabata Takuro Kawabata Masafumi Yamada Seika Yanagida Atsuo Nuruki Kazutomo Yunokuchi John Rothwell |
| author_facet | Shunichi Kawabata Takuro Kawabata Masafumi Yamada Seika Yanagida Atsuo Nuruki Kazutomo Yunokuchi John Rothwell |
| author_sort | Shunichi Kawabata |
| collection | DOAJ |
| description | While many studies have shown that visual information affects perception in the other modalities, little is known about how auditory and haptic information affect visual perception. In this study, we investigated how auditory, haptic, or auditory and haptic stimulation affects visual perception. We used a behavioral task based on the subjects observing the phenomenon of two identical visual objects moving toward each other, overlapping and then continuing their original motion. Subjects may perceive the objects as either streaming each other or bouncing and reversing their direction of motion. With only visual motion stimulus, subjects usually report the objects as streaming, whereas if a sound or flash is played when the objects touch each other, subjects report the objects as bouncing (Bounce-Inducing Effect). In this study, “auditory stimulation”, “haptic stimulation” or “haptic and auditory stimulation” were presented at various times relative to the visual overlap of objects. Our result shows the bouncing rate when haptic and auditory stimulation were presented were the highest. This result suggests that the Bounce-Inducing Effect is enhanced by simultaneous modality presentation to visual motion. In the future, a neuroscience approach (eg, TMS, fMRI) may be required to elucidate the brain mechanism in this study. |
| first_indexed | 2024-12-10T21:40:40Z |
| format | Article |
| id | doaj.art-3efb3c4a955143b7995bcb05b2ed17f0 |
| institution | Directory Open Access Journal |
| issn | 2041-6695 |
| language | English |
| last_indexed | 2024-12-10T21:40:40Z |
| publishDate | 2011-10-01 |
| publisher | SAGE Publishing |
| record_format | Article |
| series | i-Perception |
| spelling | doaj.art-3efb3c4a955143b7995bcb05b2ed17f02022-12-22T01:32:31ZengSAGE Publishingi-Perception2041-66952011-10-01210.1068/ic80810.1068_ic808Influence of Auditory and Haptic Stimulation in Visual PerceptionShunichi Kawabata0Takuro Kawabata1Masafumi Yamada2Seika Yanagida3Atsuo Nuruki4Kazutomo Yunokuchi5John Rothwell6Kagoshima UniversityKagoshima UniversityKagoshima UniversityKagoshima UniversityKagoshima UniversityKagoshima UniversityUniversity College LondonWhile many studies have shown that visual information affects perception in the other modalities, little is known about how auditory and haptic information affect visual perception. In this study, we investigated how auditory, haptic, or auditory and haptic stimulation affects visual perception. We used a behavioral task based on the subjects observing the phenomenon of two identical visual objects moving toward each other, overlapping and then continuing their original motion. Subjects may perceive the objects as either streaming each other or bouncing and reversing their direction of motion. With only visual motion stimulus, subjects usually report the objects as streaming, whereas if a sound or flash is played when the objects touch each other, subjects report the objects as bouncing (Bounce-Inducing Effect). In this study, “auditory stimulation”, “haptic stimulation” or “haptic and auditory stimulation” were presented at various times relative to the visual overlap of objects. Our result shows the bouncing rate when haptic and auditory stimulation were presented were the highest. This result suggests that the Bounce-Inducing Effect is enhanced by simultaneous modality presentation to visual motion. In the future, a neuroscience approach (eg, TMS, fMRI) may be required to elucidate the brain mechanism in this study.https://doi.org/10.1068/ic808 |
| spellingShingle | Shunichi Kawabata Takuro Kawabata Masafumi Yamada Seika Yanagida Atsuo Nuruki Kazutomo Yunokuchi John Rothwell Influence of Auditory and Haptic Stimulation in Visual Perception i-Perception |
| title | Influence of Auditory and Haptic Stimulation in Visual Perception |
| title_full | Influence of Auditory and Haptic Stimulation in Visual Perception |
| title_fullStr | Influence of Auditory and Haptic Stimulation in Visual Perception |
| title_full_unstemmed | Influence of Auditory and Haptic Stimulation in Visual Perception |
| title_short | Influence of Auditory and Haptic Stimulation in Visual Perception |
| title_sort | influence of auditory and haptic stimulation in visual perception |
| url | https://doi.org/10.1068/ic808 |
| work_keys_str_mv | AT shunichikawabata influenceofauditoryandhapticstimulationinvisualperception AT takurokawabata influenceofauditoryandhapticstimulationinvisualperception AT masafumiyamada influenceofauditoryandhapticstimulationinvisualperception AT seikayanagida influenceofauditoryandhapticstimulationinvisualperception AT atsuonuruki influenceofauditoryandhapticstimulationinvisualperception AT kazutomoyunokuchi influenceofauditoryandhapticstimulationinvisualperception AT johnrothwell influenceofauditoryandhapticstimulationinvisualperception |