Visual perceptual learning of feature conjunctions leverages non-linear mixed selectivity
Abstract Visual objects are often defined by multiple features. Therefore, learning novel objects entails learning feature conjunctions. Visual cortex is organized into distinct anatomical compartments, each of which is devoted to processing a single feature. A prime example are neurons purely selec...
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Nature Portfolio
2024-03-01
|
| Series: | npj Science of Learning |
| Online Access: | https://doi.org/10.1038/s41539-024-00226-w |
| _version_ | 1797275855431401472 |
|---|---|
| author | Behnam Karami Caspar M. Schwiedrzik |
| author_facet | Behnam Karami Caspar M. Schwiedrzik |
| author_sort | Behnam Karami |
| collection | DOAJ |
| description | Abstract Visual objects are often defined by multiple features. Therefore, learning novel objects entails learning feature conjunctions. Visual cortex is organized into distinct anatomical compartments, each of which is devoted to processing a single feature. A prime example are neurons purely selective to color and orientation, respectively. However, neurons that jointly encode multiple features (mixed selectivity) also exist across the brain and play critical roles in a multitude of tasks. Here, we sought to uncover the optimal policy that our brain adapts to achieve conjunction learning using these available resources. 59 human subjects practiced orientation-color conjunction learning in four psychophysical experiments designed to nudge the visual system towards using one or the other resource. We find that conjunction learning is possible by linear mixing of pure color and orientation information, but that more and faster learning takes place when both pure and mixed selectivity representations are involved. We also find that learning with mixed selectivity confers advantages in performing an untrained “exclusive or” (XOR) task several months after learning the original conjunction task. This study sheds light on possible mechanisms underlying conjunction learning and highlights the importance of learning by mixed selectivity. |
| first_indexed | 2024-03-07T15:19:02Z |
| format | Article |
| id | doaj.art-7767ad2ada0d486f9d60aeabe18defa8 |
| institution | Directory Open Access Journal |
| issn | 2056-7936 |
| language | English |
| last_indexed | 2024-03-07T15:19:02Z |
| publishDate | 2024-03-01 |
| publisher | Nature Portfolio |
| record_format | Article |
| series | npj Science of Learning |
| spelling | doaj.art-7767ad2ada0d486f9d60aeabe18defa82024-03-05T17:44:16ZengNature Portfolionpj Science of Learning2056-79362024-03-019111610.1038/s41539-024-00226-wVisual perceptual learning of feature conjunctions leverages non-linear mixed selectivityBehnam Karami0Caspar M. Schwiedrzik1Neural Circuits and Cognition Lab, European Neuroscience Institute Göttingen – A Joint Initiative of the University Medical Center Göttingen and the Max Planck SocietyNeural Circuits and Cognition Lab, European Neuroscience Institute Göttingen – A Joint Initiative of the University Medical Center Göttingen and the Max Planck SocietyAbstract Visual objects are often defined by multiple features. Therefore, learning novel objects entails learning feature conjunctions. Visual cortex is organized into distinct anatomical compartments, each of which is devoted to processing a single feature. A prime example are neurons purely selective to color and orientation, respectively. However, neurons that jointly encode multiple features (mixed selectivity) also exist across the brain and play critical roles in a multitude of tasks. Here, we sought to uncover the optimal policy that our brain adapts to achieve conjunction learning using these available resources. 59 human subjects practiced orientation-color conjunction learning in four psychophysical experiments designed to nudge the visual system towards using one or the other resource. We find that conjunction learning is possible by linear mixing of pure color and orientation information, but that more and faster learning takes place when both pure and mixed selectivity representations are involved. We also find that learning with mixed selectivity confers advantages in performing an untrained “exclusive or” (XOR) task several months after learning the original conjunction task. This study sheds light on possible mechanisms underlying conjunction learning and highlights the importance of learning by mixed selectivity.https://doi.org/10.1038/s41539-024-00226-w |
| spellingShingle | Behnam Karami Caspar M. Schwiedrzik Visual perceptual learning of feature conjunctions leverages non-linear mixed selectivity npj Science of Learning |
| title | Visual perceptual learning of feature conjunctions leverages non-linear mixed selectivity |
| title_full | Visual perceptual learning of feature conjunctions leverages non-linear mixed selectivity |
| title_fullStr | Visual perceptual learning of feature conjunctions leverages non-linear mixed selectivity |
| title_full_unstemmed | Visual perceptual learning of feature conjunctions leverages non-linear mixed selectivity |
| title_short | Visual perceptual learning of feature conjunctions leverages non-linear mixed selectivity |
| title_sort | visual perceptual learning of feature conjunctions leverages non linear mixed selectivity |
| url | https://doi.org/10.1038/s41539-024-00226-w |
| work_keys_str_mv | AT behnamkarami visualperceptuallearningoffeatureconjunctionsleveragesnonlinearmixedselectivity AT casparmschwiedrzik visualperceptuallearningoffeatureconjunctionsleveragesnonlinearmixedselectivity |