Influence of soundtrack on eye movements during video exploration
Models of visual attention rely on visual features such as orientation, intensity or motion to predict which regions of complex scenes attract the gaze of observers. So far, sound has never been considered as a possible feature that might influence eye movements. Here, we evaluate the impact of non-...
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Bern Open Publishing
2012-08-01
|
| Series: | Journal of Eye Movement Research |
| Subjects: | |
| Online Access: | https://bop.unibe.ch/JEMR/article/view/2340 |
| _version_ | 1819097088196083712 |
|---|---|
| author | Antoine Coutrot Nathalie Guyader Gelu Ionescu Alice Caplier |
| author_facet | Antoine Coutrot Nathalie Guyader Gelu Ionescu Alice Caplier |
| author_sort | Antoine Coutrot |
| collection | DOAJ |
| description | Models of visual attention rely on visual features such as orientation, intensity or motion to predict which regions of complex scenes attract the gaze of observers. So far, sound has never been considered as a possible feature that might influence eye movements. Here, we evaluate the impact of non-spatial sound on the eye movements of observers watching videos. We recorded eye movements of 40 participants watching assorted videos with and without their related soundtracks. We found that sound impacts on eye position, fixation duration and saccade amplitude. The effect of sound is not constant across time but becomes significant around one second after the beginning of video shots. |
| first_indexed | 2024-12-22T00:09:32Z |
| format | Article |
| id | doaj.art-06e5477463b2498bb7c371f83989d957 |
| institution | Directory Open Access Journal |
| issn | 1995-8692 |
| language | English |
| last_indexed | 2024-12-22T00:09:32Z |
| publishDate | 2012-08-01 |
| publisher | Bern Open Publishing |
| record_format | Article |
| series | Journal of Eye Movement Research |
| spelling | doaj.art-06e5477463b2498bb7c371f83989d9572022-12-21T18:45:28ZengBern Open PublishingJournal of Eye Movement Research1995-86922012-08-015410.16910/jemr.5.4.2Influence of soundtrack on eye movements during video explorationAntoine Coutrot0Nathalie Guyader1Gelu Ionescu2Alice Caplier3Gipsa Laboratory - CNRS UMR 5216, Grenoble University, FranceGipsa Laboratory - CNRS UMR 5216, Grenoble University, FranceGipsa Laboratory - CNRS UMR 5216, Grenoble University, FranceGipsa Laboratory - CNRS UMR 5216, Grenoble University, FranceModels of visual attention rely on visual features such as orientation, intensity or motion to predict which regions of complex scenes attract the gaze of observers. So far, sound has never been considered as a possible feature that might influence eye movements. Here, we evaluate the impact of non-spatial sound on the eye movements of observers watching videos. We recorded eye movements of 40 participants watching assorted videos with and without their related soundtracks. We found that sound impacts on eye position, fixation duration and saccade amplitude. The effect of sound is not constant across time but becomes significant around one second after the beginning of video shots.https://bop.unibe.ch/JEMR/article/view/2340multimodaleye movementsaudio-visualsoundattentionvideos |
| spellingShingle | Antoine Coutrot Nathalie Guyader Gelu Ionescu Alice Caplier Influence of soundtrack on eye movements during video exploration Journal of Eye Movement Research multimodal eye movements audio-visual sound attention videos |
| title | Influence of soundtrack on eye movements during video exploration |
| title_full | Influence of soundtrack on eye movements during video exploration |
| title_fullStr | Influence of soundtrack on eye movements during video exploration |
| title_full_unstemmed | Influence of soundtrack on eye movements during video exploration |
| title_short | Influence of soundtrack on eye movements during video exploration |
| title_sort | influence of soundtrack on eye movements during video exploration |
| topic | multimodal eye movements audio-visual sound attention videos |
| url | https://bop.unibe.ch/JEMR/article/view/2340 |
| work_keys_str_mv | AT antoinecoutrot influenceofsoundtrackoneyemovementsduringvideoexploration AT nathalieguyader influenceofsoundtrackoneyemovementsduringvideoexploration AT geluionescu influenceofsoundtrackoneyemovementsduringvideoexploration AT alicecaplier influenceofsoundtrackoneyemovementsduringvideoexploration |