Independency of Coding for Affective Similarities and for Word Co-occurrences in Temporal Perisylvian Neocortex
AbstractWord valence is one of the principal dimensions in the organization of word meaning. Co-occurrence-based similarities calculated by predictive natural language processing models are relatively poor at representing affective content, but very powerful in their own way. Here, w...
| Main Authors: | , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
The MIT Press
2023-01-01
|
| Series: | Neurobiology of Language |
| Online Access: | https://direct.mit.edu/nol/article/4/2/257/114206/Independency-of-Coding-for-Affective-Similarities |
| _version_ | 1797837471201886208 |
|---|---|
| author | Antonietta Gabriella Liuzzi Karen Meersmans Gerrit Storms Simon De Deyne Patrick Dupont Rik Vandenberghe |
| author_facet | Antonietta Gabriella Liuzzi Karen Meersmans Gerrit Storms Simon De Deyne Patrick Dupont Rik Vandenberghe |
| author_sort | Antonietta Gabriella Liuzzi |
| collection | DOAJ |
| description |
AbstractWord valence is one of the principal dimensions in the organization of word meaning. Co-occurrence-based similarities calculated by predictive natural language processing models are relatively poor at representing affective content, but very powerful in their own way. Here, we determined how these two canonical but distinct ways of representing word meaning relate to each other in the human brain both functionally and neuroanatomically. We re-analysed an fMRI study of word valence. A co-occurrence-based model was used and the correlation with the similarity of brain activity patterns was compared to that of affective similarities. The correlation between affective and co-occurrence-based similarities was low (r = 0.065), confirming that affect was captured poorly by co-occurrence modelling. In a whole-brain representational similarity analysis, word embedding similarities correlated significantly with the similarity between activity patterns in a region confined to the superior temporal sulcus to the left, and to a lesser degree to the right. Affective word similarities correlated with the similarity in activity patterns in this same region, confirming previous findings. The affective similarity effect extended more widely beyond the superior temporal cortex than the effect of co-occurrence-based similarities did. The effect of co-occurrence-based similarities remained unaltered after partialling out the effect of affective similarities (and vice versa). To conclude, different aspects of word meaning, derived from affective judgements or from word co-occurrences, are represented in superior temporal language cortex in a neuroanatomically overlapping but functionally independent manner. |
| first_indexed | 2024-04-09T15:26:19Z |
| format | Article |
| id | doaj.art-d85267ea86e140abbb3ab64fcf64098b |
| institution | Directory Open Access Journal |
| issn | 2641-4368 |
| language | English |
| last_indexed | 2024-04-09T15:26:19Z |
| publishDate | 2023-01-01 |
| publisher | The MIT Press |
| record_format | Article |
| series | Neurobiology of Language |
| spelling | doaj.art-d85267ea86e140abbb3ab64fcf64098b2023-04-28T18:13:49ZengThe MIT PressNeurobiology of Language2641-43682023-01-014225727910.1162/nol_a_00095Independency of Coding for Affective Similarities and for Word Co-occurrences in Temporal Perisylvian NeocortexAntonietta Gabriella Liuzzi0http://orcid.org/0000-0001-8960-5601Karen Meersmans1http://orcid.org/0000-0001-6018-0072Gerrit Storms2http://orcid.org/0000-0002-4100-8725Simon De Deyne3http://orcid.org/0000-0002-7899-6210Patrick Dupont4http://orcid.org/0000-0003-1980-2540Rik Vandenberghe5http://orcid.org/0000-0001-6237-2502Laboratory for Cognitive Neurology, Department of Neurosciences, Leuven Brain Institute, KU Leuven, Leuven, BelgiumLaboratory for Cognitive Neurology, Department of Neurosciences, Leuven Brain Institute, KU Leuven, Leuven, BelgiumLaboratory of Experimental Psychology, KU Leuven, Leuven, BelgiumComputational Cognitive Science Lab, University of Melbourne, Melbourne, AustraliaLaboratory for Cognitive Neurology, Department of Neurosciences, Leuven Brain Institute, KU Leuven, Leuven, BelgiumLaboratory for Cognitive Neurology, Department of Neurosciences, Leuven Brain Institute, KU Leuven, Leuven, Belgium AbstractWord valence is one of the principal dimensions in the organization of word meaning. Co-occurrence-based similarities calculated by predictive natural language processing models are relatively poor at representing affective content, but very powerful in their own way. Here, we determined how these two canonical but distinct ways of representing word meaning relate to each other in the human brain both functionally and neuroanatomically. We re-analysed an fMRI study of word valence. A co-occurrence-based model was used and the correlation with the similarity of brain activity patterns was compared to that of affective similarities. The correlation between affective and co-occurrence-based similarities was low (r = 0.065), confirming that affect was captured poorly by co-occurrence modelling. In a whole-brain representational similarity analysis, word embedding similarities correlated significantly with the similarity between activity patterns in a region confined to the superior temporal sulcus to the left, and to a lesser degree to the right. Affective word similarities correlated with the similarity in activity patterns in this same region, confirming previous findings. The affective similarity effect extended more widely beyond the superior temporal cortex than the effect of co-occurrence-based similarities did. The effect of co-occurrence-based similarities remained unaltered after partialling out the effect of affective similarities (and vice versa). To conclude, different aspects of word meaning, derived from affective judgements or from word co-occurrences, are represented in superior temporal language cortex in a neuroanatomically overlapping but functionally independent manner.https://direct.mit.edu/nol/article/4/2/257/114206/Independency-of-Coding-for-Affective-Similarities |
| spellingShingle | Antonietta Gabriella Liuzzi Karen Meersmans Gerrit Storms Simon De Deyne Patrick Dupont Rik Vandenberghe Independency of Coding for Affective Similarities and for Word Co-occurrences in Temporal Perisylvian Neocortex Neurobiology of Language |
| title | Independency of Coding for Affective Similarities and for Word Co-occurrences in Temporal Perisylvian Neocortex |
| title_full | Independency of Coding for Affective Similarities and for Word Co-occurrences in Temporal Perisylvian Neocortex |
| title_fullStr | Independency of Coding for Affective Similarities and for Word Co-occurrences in Temporal Perisylvian Neocortex |
| title_full_unstemmed | Independency of Coding for Affective Similarities and for Word Co-occurrences in Temporal Perisylvian Neocortex |
| title_short | Independency of Coding for Affective Similarities and for Word Co-occurrences in Temporal Perisylvian Neocortex |
| title_sort | independency of coding for affective similarities and for word co occurrences in temporal perisylvian neocortex |
| url | https://direct.mit.edu/nol/article/4/2/257/114206/Independency-of-Coding-for-Affective-Similarities |
| work_keys_str_mv | AT antoniettagabriellaliuzzi independencyofcodingforaffectivesimilaritiesandforwordcooccurrencesintemporalperisylvianneocortex AT karenmeersmans independencyofcodingforaffectivesimilaritiesandforwordcooccurrencesintemporalperisylvianneocortex AT gerritstorms independencyofcodingforaffectivesimilaritiesandforwordcooccurrencesintemporalperisylvianneocortex AT simondedeyne independencyofcodingforaffectivesimilaritiesandforwordcooccurrencesintemporalperisylvianneocortex AT patrickdupont independencyofcodingforaffectivesimilaritiesandforwordcooccurrencesintemporalperisylvianneocortex AT rikvandenberghe independencyofcodingforaffectivesimilaritiesandforwordcooccurrencesintemporalperisylvianneocortex |