Grounding Language Processing: The Added Value of Specifying Linguistic/Compositional Representations and Processes
Abundant empirical evidence suggests that visual perception and motor responses are involved in language comprehension (‘grounding’). However, when modeling the grounding of sentence comprehension on a word-by-word basis, linguistic representations and cognitive processes are rarely made fully expli...
| Main Author: | |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Ubiquity Press
2021-04-01
|
| Series: | Journal of Cognition |
| Subjects: | |
| Online Access: | https://www.journalofcognition.org/articles/155 |
| _version_ | 1818736343383015424 |
|---|---|
| author | Pia Knoeferle |
| author_facet | Pia Knoeferle |
| author_sort | Pia Knoeferle |
| collection | DOAJ |
| description | Abundant empirical evidence suggests that visual perception and motor responses are involved in language comprehension (‘grounding’). However, when modeling the grounding of sentence comprehension on a word-by-word basis, linguistic representations and cognitive processes are rarely made fully explicit. This article reviews representational formalisms and associated (computational) models with a view to accommodating incremental and compositional grounding effects. Are different representation formats equally suitable and what mechanisms and representations do models assume to accommodate grounding effects? I argue that we must minimally specify compositional semantic representations, a set of incremental processes/mechanisms, and an explicit link from the assumed processes to measured behavior. Different representational formats can be contrasted in psycholinguistic modeling by holding the set of processes/mechanisms constant; contrasting different processes/mechanisms is possible by holding representations constant. Such psycholinguistic modeling could be applied across a wide range of experimental investigations and complement computational modeling. |
| first_indexed | 2024-12-18T00:35:36Z |
| format | Article |
| id | doaj.art-700e8aeb40b240689978e288881ad3d6 |
| institution | Directory Open Access Journal |
| issn | 2514-4820 |
| language | English |
| last_indexed | 2024-12-18T00:35:36Z |
| publishDate | 2021-04-01 |
| publisher | Ubiquity Press |
| record_format | Article |
| series | Journal of Cognition |
| spelling | doaj.art-700e8aeb40b240689978e288881ad3d62022-12-21T21:27:01ZengUbiquity PressJournal of Cognition2514-48202021-04-014110.5334/joc.155171Grounding Language Processing: The Added Value of Specifying Linguistic/Compositional Representations and ProcessesPia Knoeferle0Institut für deutsche Sprache und Linguistik, Unter den Linden 6, Humboldt-Universität zu Berlin, 10099Abundant empirical evidence suggests that visual perception and motor responses are involved in language comprehension (‘grounding’). However, when modeling the grounding of sentence comprehension on a word-by-word basis, linguistic representations and cognitive processes are rarely made fully explicit. This article reviews representational formalisms and associated (computational) models with a view to accommodating incremental and compositional grounding effects. Are different representation formats equally suitable and what mechanisms and representations do models assume to accommodate grounding effects? I argue that we must minimally specify compositional semantic representations, a set of incremental processes/mechanisms, and an explicit link from the assumed processes to measured behavior. Different representational formats can be contrasted in psycholinguistic modeling by holding the set of processes/mechanisms constant; contrasting different processes/mechanisms is possible by holding representations constant. Such psycholinguistic modeling could be applied across a wide range of experimental investigations and complement computational modeling.https://www.journalofcognition.org/articles/155embodied cognitionsentence processingsemanticseye movements |
| spellingShingle | Pia Knoeferle Grounding Language Processing: The Added Value of Specifying Linguistic/Compositional Representations and Processes Journal of Cognition embodied cognition sentence processing semantics eye movements |
| title | Grounding Language Processing: The Added Value of Specifying Linguistic/Compositional Representations and Processes |
| title_full | Grounding Language Processing: The Added Value of Specifying Linguistic/Compositional Representations and Processes |
| title_fullStr | Grounding Language Processing: The Added Value of Specifying Linguistic/Compositional Representations and Processes |
| title_full_unstemmed | Grounding Language Processing: The Added Value of Specifying Linguistic/Compositional Representations and Processes |
| title_short | Grounding Language Processing: The Added Value of Specifying Linguistic/Compositional Representations and Processes |
| title_sort | grounding language processing the added value of specifying linguistic compositional representations and processes |
| topic | embodied cognition sentence processing semantics eye movements |
| url | https://www.journalofcognition.org/articles/155 |
| work_keys_str_mv | AT piaknoeferle groundinglanguageprocessingtheaddedvalueofspecifyinglinguisticcompositionalrepresentationsandprocesses |