The contributions of image content and behavioral relevancy to overt attention.
During free-viewing of natural scenes, eye movements are guided by bottom-up factors inherent to the stimulus, as well as top-down factors inherent to the observer. The question of how these two different sources of information interact and contribute to fixation behavior has recently received a lot...
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Public Library of Science (PLoS)
2014-01-01
|
| Series: | PLoS ONE |
| Online Access: | http://europepmc.org/articles/PMC3988016?pdf=render |
| _version_ | 1819261669968183296 |
|---|---|
| author | Selim Onat Alper Açık Frank Schumann Peter König |
| author_facet | Selim Onat Alper Açık Frank Schumann Peter König |
| author_sort | Selim Onat |
| collection | DOAJ |
| description | During free-viewing of natural scenes, eye movements are guided by bottom-up factors inherent to the stimulus, as well as top-down factors inherent to the observer. The question of how these two different sources of information interact and contribute to fixation behavior has recently received a lot of attention. Here, a battery of 15 visual stimulus features was used to quantify the contribution of stimulus properties during free-viewing of 4 different categories of images (Natural, Urban, Fractal and Pink Noise). Behaviorally relevant information was estimated in the form of topographical interestingness maps by asking an independent set of subjects to click at image regions that they subjectively found most interesting. Using a Bayesian scheme, we computed saliency functions that described the probability of a given feature to be fixated. In the case of stimulus features, the precise shape of the saliency functions was strongly dependent upon image category and overall the saliency associated with these features was generally weak. When testing multiple features jointly, a linear additive integration model of individual saliencies performed satisfactorily. We found that the saliency associated with interesting locations was much higher than any low-level image feature and any pair-wise combination thereof. Furthermore, the low-level image features were found to be maximally salient at those locations that had already high interestingness ratings. Temporal analysis showed that regions with high interestingness ratings were fixated as early as the third fixation following stimulus onset. Paralleling these findings, fixation durations were found to be dependent mainly on interestingness ratings and to a lesser extent on the low-level image features. Our results suggest that both low- and high-level sources of information play a significant role during exploration of complex scenes with behaviorally relevant information being more effective compared to stimulus features. |
| first_indexed | 2024-12-23T19:45:29Z |
| format | Article |
| id | doaj.art-cf8eec6b842c4efca9ba1c873bda2dd1 |
| institution | Directory Open Access Journal |
| issn | 1932-6203 |
| language | English |
| last_indexed | 2024-12-23T19:45:29Z |
| publishDate | 2014-01-01 |
| publisher | Public Library of Science (PLoS) |
| record_format | Article |
| series | PLoS ONE |
| spelling | doaj.art-cf8eec6b842c4efca9ba1c873bda2dd12022-12-21T17:33:32ZengPublic Library of Science (PLoS)PLoS ONE1932-62032014-01-0194e9325410.1371/journal.pone.0093254The contributions of image content and behavioral relevancy to overt attention.Selim OnatAlper AçıkFrank SchumannPeter KönigDuring free-viewing of natural scenes, eye movements are guided by bottom-up factors inherent to the stimulus, as well as top-down factors inherent to the observer. The question of how these two different sources of information interact and contribute to fixation behavior has recently received a lot of attention. Here, a battery of 15 visual stimulus features was used to quantify the contribution of stimulus properties during free-viewing of 4 different categories of images (Natural, Urban, Fractal and Pink Noise). Behaviorally relevant information was estimated in the form of topographical interestingness maps by asking an independent set of subjects to click at image regions that they subjectively found most interesting. Using a Bayesian scheme, we computed saliency functions that described the probability of a given feature to be fixated. In the case of stimulus features, the precise shape of the saliency functions was strongly dependent upon image category and overall the saliency associated with these features was generally weak. When testing multiple features jointly, a linear additive integration model of individual saliencies performed satisfactorily. We found that the saliency associated with interesting locations was much higher than any low-level image feature and any pair-wise combination thereof. Furthermore, the low-level image features were found to be maximally salient at those locations that had already high interestingness ratings. Temporal analysis showed that regions with high interestingness ratings were fixated as early as the third fixation following stimulus onset. Paralleling these findings, fixation durations were found to be dependent mainly on interestingness ratings and to a lesser extent on the low-level image features. Our results suggest that both low- and high-level sources of information play a significant role during exploration of complex scenes with behaviorally relevant information being more effective compared to stimulus features.http://europepmc.org/articles/PMC3988016?pdf=render |
| spellingShingle | Selim Onat Alper Açık Frank Schumann Peter König The contributions of image content and behavioral relevancy to overt attention. PLoS ONE |
| title | The contributions of image content and behavioral relevancy to overt attention. |
| title_full | The contributions of image content and behavioral relevancy to overt attention. |
| title_fullStr | The contributions of image content and behavioral relevancy to overt attention. |
| title_full_unstemmed | The contributions of image content and behavioral relevancy to overt attention. |
| title_short | The contributions of image content and behavioral relevancy to overt attention. |
| title_sort | contributions of image content and behavioral relevancy to overt attention |
| url | http://europepmc.org/articles/PMC3988016?pdf=render |
| work_keys_str_mv | AT selimonat thecontributionsofimagecontentandbehavioralrelevancytoovertattention AT alperacık thecontributionsofimagecontentandbehavioralrelevancytoovertattention AT frankschumann thecontributionsofimagecontentandbehavioralrelevancytoovertattention AT peterkonig thecontributionsofimagecontentandbehavioralrelevancytoovertattention AT selimonat contributionsofimagecontentandbehavioralrelevancytoovertattention AT alperacık contributionsofimagecontentandbehavioralrelevancytoovertattention AT frankschumann contributionsofimagecontentandbehavioralrelevancytoovertattention AT peterkonig contributionsofimagecontentandbehavioralrelevancytoovertattention |