In Praise of Artifice Reloaded: Caution With Natural Image Databases in Modeling Vision
Subjective image quality databases are a major source of raw data on how the visual system works in naturalistic environments. These databases describe the sensitivity of many observers to a wide range of distortions of different nature and intensity seen on top of a variety of natural images. Data...
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Frontiers Media S.A.
2019-02-01
|
| Series: | Frontiers in Neuroscience |
| Subjects: | |
| Online Access: | https://www.frontiersin.org/article/10.3389/fnins.2019.00008/full |
| _version_ | 1811336870841286656 |
|---|---|
| author | Marina Martinez-Garcia Marina Martinez-Garcia Marcelo Bertalmío Jesús Malo |
| author_facet | Marina Martinez-Garcia Marina Martinez-Garcia Marcelo Bertalmío Jesús Malo |
| author_sort | Marina Martinez-Garcia |
| collection | DOAJ |
| description | Subjective image quality databases are a major source of raw data on how the visual system works in naturalistic environments. These databases describe the sensitivity of many observers to a wide range of distortions of different nature and intensity seen on top of a variety of natural images. Data of this kind seems to open a number of possibilities for the vision scientist to check the models in realistic scenarios. However, while these natural databases are great benchmarks for models developed in some other way (e.g., by using the well-controlled artificial stimuli of traditional psychophysics), they should be carefully used when trying to fit vision models. Given the high dimensionality of the image space, it is very likely that some basic phenomena are under-represented in the database. Therefore, a model fitted on these large-scale natural databases will not reproduce these under-represented basic phenomena that could otherwise be easily illustrated with well selected artificial stimuli. In this work we study a specific example of the above statement. A standard cortical model using wavelets and divisive normalization tuned to reproduce subjective opinion on a large image quality dataset fails to reproduce basic cross-masking. Here we outline a solution for this problem by using artificial stimuli and by proposing a modification that makes the model easier to tune. Then, we show that the modified model is still competitive in the large-scale database. Our simulations with these artificial stimuli show that when using steerable wavelets, the conventional unit norm Gaussian kernels in divisive normalization should be multiplied by high-pass filters to reproduce basic trends in masking. Basic visual phenomena may be misrepresented in large natural image datasets but this can be solved with model-interpretable stimuli. This is an additional argument in praise of artifice in line with Rust and Movshon (2005). |
| first_indexed | 2024-04-13T17:45:49Z |
| format | Article |
| id | doaj.art-288f7265d31348768d11dfd5333a0568 |
| institution | Directory Open Access Journal |
| issn | 1662-453X |
| language | English |
| last_indexed | 2024-04-13T17:45:49Z |
| publishDate | 2019-02-01 |
| publisher | Frontiers Media S.A. |
| record_format | Article |
| series | Frontiers in Neuroscience |
| spelling | doaj.art-288f7265d31348768d11dfd5333a05682022-12-22T02:36:59ZengFrontiers Media S.A.Frontiers in Neuroscience1662-453X2019-02-011310.3389/fnins.2019.00008344418In Praise of Artifice Reloaded: Caution With Natural Image Databases in Modeling VisionMarina Martinez-Garcia0Marina Martinez-Garcia1Marcelo Bertalmío2Jesús Malo3Image Processing Lab, Universitat de ValènciaValencia, SpainCSIC, Instituto de NeurocienciasAlicante, SpainDepartamento de Tecnologías de la Información y las Comunicaciones, Universidad Pompeu FabraBarcelona, SpainImage Processing Lab, Universitat de ValènciaValencia, SpainSubjective image quality databases are a major source of raw data on how the visual system works in naturalistic environments. These databases describe the sensitivity of many observers to a wide range of distortions of different nature and intensity seen on top of a variety of natural images. Data of this kind seems to open a number of possibilities for the vision scientist to check the models in realistic scenarios. However, while these natural databases are great benchmarks for models developed in some other way (e.g., by using the well-controlled artificial stimuli of traditional psychophysics), they should be carefully used when trying to fit vision models. Given the high dimensionality of the image space, it is very likely that some basic phenomena are under-represented in the database. Therefore, a model fitted on these large-scale natural databases will not reproduce these under-represented basic phenomena that could otherwise be easily illustrated with well selected artificial stimuli. In this work we study a specific example of the above statement. A standard cortical model using wavelets and divisive normalization tuned to reproduce subjective opinion on a large image quality dataset fails to reproduce basic cross-masking. Here we outline a solution for this problem by using artificial stimuli and by proposing a modification that makes the model easier to tune. Then, we show that the modified model is still competitive in the large-scale database. Our simulations with these artificial stimuli show that when using steerable wavelets, the conventional unit norm Gaussian kernels in divisive normalization should be multiplied by high-pass filters to reproduce basic trends in masking. Basic visual phenomena may be misrepresented in large natural image datasets but this can be solved with model-interpretable stimuli. This is an additional argument in praise of artifice in line with Rust and Movshon (2005).https://www.frontiersin.org/article/10.3389/fnins.2019.00008/fullnatural stimuliartificial stimulisubjective image quality databaseswavelet + divisive normalizationcontrast masking |
| spellingShingle | Marina Martinez-Garcia Marina Martinez-Garcia Marcelo Bertalmío Jesús Malo In Praise of Artifice Reloaded: Caution With Natural Image Databases in Modeling Vision Frontiers in Neuroscience natural stimuli artificial stimuli subjective image quality databases wavelet + divisive normalization contrast masking |
| title | In Praise of Artifice Reloaded: Caution With Natural Image Databases in Modeling Vision |
| title_full | In Praise of Artifice Reloaded: Caution With Natural Image Databases in Modeling Vision |
| title_fullStr | In Praise of Artifice Reloaded: Caution With Natural Image Databases in Modeling Vision |
| title_full_unstemmed | In Praise of Artifice Reloaded: Caution With Natural Image Databases in Modeling Vision |
| title_short | In Praise of Artifice Reloaded: Caution With Natural Image Databases in Modeling Vision |
| title_sort | in praise of artifice reloaded caution with natural image databases in modeling vision |
| topic | natural stimuli artificial stimuli subjective image quality databases wavelet + divisive normalization contrast masking |
| url | https://www.frontiersin.org/article/10.3389/fnins.2019.00008/full |
| work_keys_str_mv | AT marinamartinezgarcia inpraiseofartificereloadedcautionwithnaturalimagedatabasesinmodelingvision AT marinamartinezgarcia inpraiseofartificereloadedcautionwithnaturalimagedatabasesinmodelingvision AT marcelobertalmio inpraiseofartificereloadedcautionwithnaturalimagedatabasesinmodelingvision AT jesusmalo inpraiseofartificereloadedcautionwithnaturalimagedatabasesinmodelingvision |