General object-based features account for letter perception.

After years of experience, humans become experts at perceiving letters. Is this visual capacity attained by learning specialized letter features, or by reusing general visual features previously learned in service of object categorization? To explore this question, we first measured the perceptual s...

Full description

Bibliographic Details
Main Authors: Daniel Janini, Chris Hamblin, Arturo Deza, Talia Konkle
Format: Article
Language:English
Published: Public Library of Science (PLoS) 2022-09-01
Series:PLoS Computational Biology
Online Access:https://doi.org/10.1371/journal.pcbi.1010522
_version_ 1811237720814518272
author Daniel Janini
Chris Hamblin
Arturo Deza
Talia Konkle
author_facet Daniel Janini
Chris Hamblin
Arturo Deza
Talia Konkle
author_sort Daniel Janini
collection DOAJ
description After years of experience, humans become experts at perceiving letters. Is this visual capacity attained by learning specialized letter features, or by reusing general visual features previously learned in service of object categorization? To explore this question, we first measured the perceptual similarity of letters in two behavioral tasks, visual search and letter categorization. Then, we trained deep convolutional neural networks on either 26-way letter categorization or 1000-way object categorization, as a way to operationalize possible specialized letter features and general object-based features, respectively. We found that the general object-based features more robustly correlated with the perceptual similarity of letters. We then operationalized additional forms of experience-dependent letter specialization by altering object-trained networks with varied forms of letter training; however, none of these forms of letter specialization improved the match to human behavior. Thus, our findings reveal that it is not necessary to appeal to specialized letter representations to account for perceptual similarity of letters. Instead, we argue that it is more likely that the perception of letters depends on domain-general visual features.
first_indexed 2024-04-12T12:28:09Z
format Article
id doaj.art-ebe98e46e3834776b85a67b9ddf12244
institution Directory Open Access Journal
issn 1553-734X
1553-7358
language English
last_indexed 2024-04-12T12:28:09Z
publishDate 2022-09-01
publisher Public Library of Science (PLoS)
record_format Article
series PLoS Computational Biology
spelling doaj.art-ebe98e46e3834776b85a67b9ddf122442022-12-22T03:33:06ZengPublic Library of Science (PLoS)PLoS Computational Biology1553-734X1553-73582022-09-01189e101052210.1371/journal.pcbi.1010522General object-based features account for letter perception.Daniel JaniniChris HamblinArturo DezaTalia KonkleAfter years of experience, humans become experts at perceiving letters. Is this visual capacity attained by learning specialized letter features, or by reusing general visual features previously learned in service of object categorization? To explore this question, we first measured the perceptual similarity of letters in two behavioral tasks, visual search and letter categorization. Then, we trained deep convolutional neural networks on either 26-way letter categorization or 1000-way object categorization, as a way to operationalize possible specialized letter features and general object-based features, respectively. We found that the general object-based features more robustly correlated with the perceptual similarity of letters. We then operationalized additional forms of experience-dependent letter specialization by altering object-trained networks with varied forms of letter training; however, none of these forms of letter specialization improved the match to human behavior. Thus, our findings reveal that it is not necessary to appeal to specialized letter representations to account for perceptual similarity of letters. Instead, we argue that it is more likely that the perception of letters depends on domain-general visual features.https://doi.org/10.1371/journal.pcbi.1010522
spellingShingle Daniel Janini
Chris Hamblin
Arturo Deza
Talia Konkle
General object-based features account for letter perception.
PLoS Computational Biology
title General object-based features account for letter perception.
title_full General object-based features account for letter perception.
title_fullStr General object-based features account for letter perception.
title_full_unstemmed General object-based features account for letter perception.
title_short General object-based features account for letter perception.
title_sort general object based features account for letter perception
url https://doi.org/10.1371/journal.pcbi.1010522
work_keys_str_mv AT danieljanini generalobjectbasedfeaturesaccountforletterperception
AT chrishamblin generalobjectbasedfeaturesaccountforletterperception
AT arturodeza generalobjectbasedfeaturesaccountforletterperception
AT taliakonkle generalobjectbasedfeaturesaccountforletterperception