Analysis and Synthesis of Natural Texture Perception From Visual Evoked Potentials
The primate visual system analyzes statistical information in natural images and uses it for the immediate perception of scenes, objects, and surface materials. To investigate the dynamical encoding of image statistics in the human brain, we measured visual evoked potentials (VEPs) for 166 natural t...
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Frontiers Media S.A.
2021-07-01
|
| Series: | Frontiers in Neuroscience |
| Subjects: | |
| Online Access: | https://www.frontiersin.org/articles/10.3389/fnins.2021.698940/full |
| _version_ | 1819136646161891328 |
|---|---|
| author | Taiki Orima Taiki Orima Isamu Motoyoshi |
| author_facet | Taiki Orima Taiki Orima Isamu Motoyoshi |
| author_sort | Taiki Orima |
| collection | DOAJ |
| description | The primate visual system analyzes statistical information in natural images and uses it for the immediate perception of scenes, objects, and surface materials. To investigate the dynamical encoding of image statistics in the human brain, we measured visual evoked potentials (VEPs) for 166 natural textures and their synthetic versions, and performed a reverse-correlation analysis of the VEPs and representative texture statistics of the image. The analysis revealed occipital VEP components strongly correlated with particular texture statistics. VEPs correlated with low-level statistics, such as subband SDs, emerged rapidly from 100 to 250 ms in a spatial frequency dependent manner. VEPs correlated with higher-order statistics, such as subband kurtosis and cross-band correlations, were observed at slightly later times. Moreover, these robust correlations enabled us to inversely estimate texture statistics from VEP signals via linear regression and to reconstruct texture images that appear similar to those synthesized with the original statistics. Additionally, we found significant differences in VEPs at 200–300 ms between some natural textures and their Portilla–Simoncelli (PS) synthesized versions, even though they shared almost identical texture statistics. This differential VEP was related to the perceptual “unnaturalness” of PS-synthesized textures. These results suggest that the visual cortex rapidly encodes image statistics hidden in natural textures specifically enough to predict the visual appearance of a texture, while it also represents high-level information beyond image statistics, and that electroencephalography can be used to decode these cortical signals. |
| first_indexed | 2024-12-22T10:38:17Z |
| format | Article |
| id | doaj.art-9a248bc6b2004734ae677c66b75aa2c0 |
| institution | Directory Open Access Journal |
| issn | 1662-453X |
| language | English |
| last_indexed | 2024-12-22T10:38:17Z |
| publishDate | 2021-07-01 |
| publisher | Frontiers Media S.A. |
| record_format | Article |
| series | Frontiers in Neuroscience |
| spelling | doaj.art-9a248bc6b2004734ae677c66b75aa2c02022-12-21T18:29:07ZengFrontiers Media S.A.Frontiers in Neuroscience1662-453X2021-07-011510.3389/fnins.2021.698940698940Analysis and Synthesis of Natural Texture Perception From Visual Evoked PotentialsTaiki Orima0Taiki Orima1Isamu Motoyoshi2Department of Life Sciences, The University of Tokyo, Tokyo, JapanJapan Society for the Promotion of Science, Tokyo, JapanDepartment of Life Sciences, The University of Tokyo, Tokyo, JapanThe primate visual system analyzes statistical information in natural images and uses it for the immediate perception of scenes, objects, and surface materials. To investigate the dynamical encoding of image statistics in the human brain, we measured visual evoked potentials (VEPs) for 166 natural textures and their synthetic versions, and performed a reverse-correlation analysis of the VEPs and representative texture statistics of the image. The analysis revealed occipital VEP components strongly correlated with particular texture statistics. VEPs correlated with low-level statistics, such as subband SDs, emerged rapidly from 100 to 250 ms in a spatial frequency dependent manner. VEPs correlated with higher-order statistics, such as subband kurtosis and cross-band correlations, were observed at slightly later times. Moreover, these robust correlations enabled us to inversely estimate texture statistics from VEP signals via linear regression and to reconstruct texture images that appear similar to those synthesized with the original statistics. Additionally, we found significant differences in VEPs at 200–300 ms between some natural textures and their Portilla–Simoncelli (PS) synthesized versions, even though they shared almost identical texture statistics. This differential VEP was related to the perceptual “unnaturalness” of PS-synthesized textures. These results suggest that the visual cortex rapidly encodes image statistics hidden in natural textures specifically enough to predict the visual appearance of a texture, while it also represents high-level information beyond image statistics, and that electroencephalography can be used to decode these cortical signals.https://www.frontiersin.org/articles/10.3389/fnins.2021.698940/fullimage statisticsvisual evoked potentialstexture perceptionstimulus reconstructionnaturalness perception |
| spellingShingle | Taiki Orima Taiki Orima Isamu Motoyoshi Analysis and Synthesis of Natural Texture Perception From Visual Evoked Potentials Frontiers in Neuroscience image statistics visual evoked potentials texture perception stimulus reconstruction naturalness perception |
| title | Analysis and Synthesis of Natural Texture Perception From Visual Evoked Potentials |
| title_full | Analysis and Synthesis of Natural Texture Perception From Visual Evoked Potentials |
| title_fullStr | Analysis and Synthesis of Natural Texture Perception From Visual Evoked Potentials |
| title_full_unstemmed | Analysis and Synthesis of Natural Texture Perception From Visual Evoked Potentials |
| title_short | Analysis and Synthesis of Natural Texture Perception From Visual Evoked Potentials |
| title_sort | analysis and synthesis of natural texture perception from visual evoked potentials |
| topic | image statistics visual evoked potentials texture perception stimulus reconstruction naturalness perception |
| url | https://www.frontiersin.org/articles/10.3389/fnins.2021.698940/full |
| work_keys_str_mv | AT taikiorima analysisandsynthesisofnaturaltextureperceptionfromvisualevokedpotentials AT taikiorima analysisandsynthesisofnaturaltextureperceptionfromvisualevokedpotentials AT isamumotoyoshi analysisandsynthesisofnaturaltextureperceptionfromvisualevokedpotentials |