Different types of sounds influence gaze differently in videos
This paper presents an analysis of the effect of different types of sounds on visual gaze when a person is looking freely at videos, which would be helpful to predict eye position. In order to test the effect of sound, an audio-visual experiment was designed with two groups of participants, with aud...
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Bern Open Publishing
2013-10-01
|
| Series: | Journal of Eye Movement Research |
| Subjects: | |
| Online Access: | https://bop.unibe.ch/JEMR/article/view/2360 |
| _version_ | 1818596219119730688 |
|---|---|
| author | Guanghan Song Denis Pellerin Lionel Granjon |
| author_facet | Guanghan Song Denis Pellerin Lionel Granjon |
| author_sort | Guanghan Song |
| collection | DOAJ |
| description | This paper presents an analysis of the effect of different types of sounds on visual gaze when a person is looking freely at videos, which would be helpful to predict eye position. In order to test the effect of sound, an audio-visual experiment was designed with two groups of participants, with audio-visual (AV) and visual (V) conditions. By using statistical tools, we analyzed the difference between eye position of participants with AV and V conditions. We observed that the effect of sound is different depending on the kind of sound, and that the classes with human voice (i.e. speech, singer, human noise and singers) have the greatest effect. Furthermore, the results of the distance between sound source and eye position of the group with AV condition, suggested that only particular types of sound attract human eye position to the sound source. Finally, an analysis of the fixation duration between AV and V conditions showed that participants with AV condition move eyes more frequently than those with V condition. |
| first_indexed | 2024-12-16T11:28:26Z |
| format | Article |
| id | doaj.art-eabe3958fd3741e590e132d09b7fbbc1 |
| institution | Directory Open Access Journal |
| issn | 1995-8692 |
| language | English |
| last_indexed | 2024-12-16T11:28:26Z |
| publishDate | 2013-10-01 |
| publisher | Bern Open Publishing |
| record_format | Article |
| series | Journal of Eye Movement Research |
| spelling | doaj.art-eabe3958fd3741e590e132d09b7fbbc12022-12-21T22:33:17ZengBern Open PublishingJournal of Eye Movement Research1995-86922013-10-016410.16910/jemr.6.4.1Different types of sounds influence gaze differently in videosGuanghan Song0Denis Pellerin1Lionel Granjon2GIPSA-Lab, CNRS UMR 5216, Grenoble University, FranceGIPSA-Lab, CNRS UMR 5216, Grenoble University, FranceLPP, CNRS UMR 8158, Paris Descartes University, FranceThis paper presents an analysis of the effect of different types of sounds on visual gaze when a person is looking freely at videos, which would be helpful to predict eye position. In order to test the effect of sound, an audio-visual experiment was designed with two groups of participants, with audio-visual (AV) and visual (V) conditions. By using statistical tools, we analyzed the difference between eye position of participants with AV and V conditions. We observed that the effect of sound is different depending on the kind of sound, and that the classes with human voice (i.e. speech, singer, human noise and singers) have the greatest effect. Furthermore, the results of the distance between sound source and eye position of the group with AV condition, suggested that only particular types of sound attract human eye position to the sound source. Finally, an analysis of the fixation duration between AV and V conditions showed that participants with AV condition move eyes more frequently than those with V condition.https://bop.unibe.ch/JEMR/article/view/2360eye movementattentionvideoaudio-visualmultimodality |
| spellingShingle | Guanghan Song Denis Pellerin Lionel Granjon Different types of sounds influence gaze differently in videos Journal of Eye Movement Research eye movement attention video audio-visual multimodality |
| title | Different types of sounds influence gaze differently in videos |
| title_full | Different types of sounds influence gaze differently in videos |
| title_fullStr | Different types of sounds influence gaze differently in videos |
| title_full_unstemmed | Different types of sounds influence gaze differently in videos |
| title_short | Different types of sounds influence gaze differently in videos |
| title_sort | different types of sounds influence gaze differently in videos |
| topic | eye movement attention video audio-visual multimodality |
| url | https://bop.unibe.ch/JEMR/article/view/2360 |
| work_keys_str_mv | AT guanghansong differenttypesofsoundsinfluencegazedifferentlyinvideos AT denispellerin differenttypesofsoundsinfluencegazedifferentlyinvideos AT lionelgranjon differenttypesofsoundsinfluencegazedifferentlyinvideos |