Rapid visual categorization is not guided by early salience-based selection.
The current dominant visual processing paradigm in both human and machine research is the feedforward, layered hierarchy of neural-like processing elements. Within this paradigm, visual saliency is seen by many to have a specific role, namely that of early selection. Early selection is thought to en...
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Public Library of Science (PLoS)
2019-01-01
|
| Series: | PLoS ONE |
| Online Access: | https://doi.org/10.1371/journal.pone.0224306 |
| _version_ | 1819114090605314048 |
|---|---|
| author | John K Tsotsos Iuliia Kotseruba Calden Wloka |
| author_facet | John K Tsotsos Iuliia Kotseruba Calden Wloka |
| author_sort | John K Tsotsos |
| collection | DOAJ |
| description | The current dominant visual processing paradigm in both human and machine research is the feedforward, layered hierarchy of neural-like processing elements. Within this paradigm, visual saliency is seen by many to have a specific role, namely that of early selection. Early selection is thought to enable very fast visual performance by limiting processing to only the most salient candidate portions of an image. This strategy has led to a plethora of saliency algorithms that have indeed improved processing time efficiency in machine algorithms, which in turn have strengthened the suggestion that human vision also employs a similar early selection strategy. However, at least one set of critical tests of this idea has never been performed with respect to the role of early selection in human vision. How would the best of the current saliency models perform on the stimuli used by experimentalists who first provided evidence for this visual processing paradigm? Would the algorithms really provide correct candidate sub-images to enable fast categorization on those same images? Do humans really need this early selection for their impressive performance? Here, we report on a new series of tests of these questions whose results suggest that it is quite unlikely that such an early selection process has any role in human rapid visual categorization. |
| first_indexed | 2024-12-22T04:39:46Z |
| format | Article |
| id | doaj.art-e96edeefd4984bda84044db8636a0cec |
| institution | Directory Open Access Journal |
| issn | 1932-6203 |
| language | English |
| last_indexed | 2024-12-22T04:39:46Z |
| publishDate | 2019-01-01 |
| publisher | Public Library of Science (PLoS) |
| record_format | Article |
| series | PLoS ONE |
| spelling | doaj.art-e96edeefd4984bda84044db8636a0cec2022-12-21T18:38:47ZengPublic Library of Science (PLoS)PLoS ONE1932-62032019-01-011410e022430610.1371/journal.pone.0224306Rapid visual categorization is not guided by early salience-based selection.John K TsotsosIuliia KotserubaCalden WlokaThe current dominant visual processing paradigm in both human and machine research is the feedforward, layered hierarchy of neural-like processing elements. Within this paradigm, visual saliency is seen by many to have a specific role, namely that of early selection. Early selection is thought to enable very fast visual performance by limiting processing to only the most salient candidate portions of an image. This strategy has led to a plethora of saliency algorithms that have indeed improved processing time efficiency in machine algorithms, which in turn have strengthened the suggestion that human vision also employs a similar early selection strategy. However, at least one set of critical tests of this idea has never been performed with respect to the role of early selection in human vision. How would the best of the current saliency models perform on the stimuli used by experimentalists who first provided evidence for this visual processing paradigm? Would the algorithms really provide correct candidate sub-images to enable fast categorization on those same images? Do humans really need this early selection for their impressive performance? Here, we report on a new series of tests of these questions whose results suggest that it is quite unlikely that such an early selection process has any role in human rapid visual categorization.https://doi.org/10.1371/journal.pone.0224306 |
| spellingShingle | John K Tsotsos Iuliia Kotseruba Calden Wloka Rapid visual categorization is not guided by early salience-based selection. PLoS ONE |
| title | Rapid visual categorization is not guided by early salience-based selection. |
| title_full | Rapid visual categorization is not guided by early salience-based selection. |
| title_fullStr | Rapid visual categorization is not guided by early salience-based selection. |
| title_full_unstemmed | Rapid visual categorization is not guided by early salience-based selection. |
| title_short | Rapid visual categorization is not guided by early salience-based selection. |
| title_sort | rapid visual categorization is not guided by early salience based selection |
| url | https://doi.org/10.1371/journal.pone.0224306 |
| work_keys_str_mv | AT johnktsotsos rapidvisualcategorizationisnotguidedbyearlysaliencebasedselection AT iuliiakotseruba rapidvisualcategorizationisnotguidedbyearlysaliencebasedselection AT caldenwloka rapidvisualcategorizationisnotguidedbyearlysaliencebasedselection |