A Model of Online Temporal-Spatial Integration for Immediacy and Overrule in Discourse Comprehension
AbstractDuring discourse comprehension, information from prior processing is integrated and appears to be immediately accessible. This was remarkably demonstrated by an N400 for “salted” and not “in love” in response to “The peanut was salted/in love.” Discourse overrule was induced...
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
The MIT Press
2021-01-01
|
| Series: | Neurobiology of Language |
| Online Access: | https://direct.mit.edu/nol/article/2/1/83/95859/A-Model-of-Online-Temporal-Spatial-Integration-for |
| _version_ | 1818947808417284096 |
|---|---|
| author | Takahisa Uchida Nicolas Lair Hiroshi Ishiguro Peter Ford Dominey |
| author_facet | Takahisa Uchida Nicolas Lair Hiroshi Ishiguro Peter Ford Dominey |
| author_sort | Takahisa Uchida |
| collection | DOAJ |
| description |
AbstractDuring discourse comprehension, information from prior processing is integrated and appears to be immediately accessible. This was remarkably demonstrated by an N400 for “salted” and not “in love” in response to “The peanut was salted/in love.” Discourse overrule was induced by prior discourse featuring the peanut as an animate agent. Immediate discourse overrule requires a model that integrates information at two timescales. One is over the lifetime and includes event knowledge and word semantics. The second is over the discourse in an event context. We propose a model where both are accounted for by temporal-to-spatial integration of experience into distributed spatial representations, providing immediate access to experience accumulated over different timescales. For lexical semantics, this is modeled by a word embedding system trained by sequential exposure to the entire Wikipedia corpus. For discourse, this is modeled by a recurrent reservoir network trained to generate a discourse vector for input sequences of words. The N400 is modeled as the difference between the instantaneous discourse vector and the target word. We predict this model can account for semantic immediacy and discourse overrule. The model simulates lexical priming and discourse overrule in the “Peanut in love” discourse, and it demonstrates that an unexpected word elicits reduced N400 if it is generally related to the event described in prior discourse, and that this effect disappears when the discourse context is removed. This neurocomputational model is the first to simulate immediacy and overrule in discourse-modulated N400, and contributes to characterization of online integration processes in discourse. |
| first_indexed | 2024-12-20T08:36:47Z |
| format | Article |
| id | doaj.art-d0b1690a669b44e79834470df85a522e |
| institution | Directory Open Access Journal |
| issn | 2641-4368 |
| language | English |
| last_indexed | 2024-12-20T08:36:47Z |
| publishDate | 2021-01-01 |
| publisher | The MIT Press |
| record_format | Article |
| series | Neurobiology of Language |
| spelling | doaj.art-d0b1690a669b44e79834470df85a522e2022-12-21T19:46:32ZengThe MIT PressNeurobiology of Language2641-43682021-01-01218310510.1162/nol_a_00026A Model of Online Temporal-Spatial Integration for Immediacy and Overrule in Discourse ComprehensionTakahisa Uchida0Nicolas Lair1http://orcid.org/0000-0002-0608-0297Hiroshi Ishiguro2Peter Ford Dominey3http://orcid.org/0000-0002-9318-179XIshiguro Lab, Graduate School of Engineering Science, Osaka University, Osaka, JapanINSERM UMR1093-CAPS, Université Bourgogne Franche-Comté, UFR des Sciences du Sport, Dijon, FranceIshiguro Lab, Graduate School of Engineering Science, Osaka University, Osaka, JapanINSERM UMR1093-CAPS, Université Bourgogne Franche-Comté, UFR des Sciences du Sport, Dijon, France AbstractDuring discourse comprehension, information from prior processing is integrated and appears to be immediately accessible. This was remarkably demonstrated by an N400 for “salted” and not “in love” in response to “The peanut was salted/in love.” Discourse overrule was induced by prior discourse featuring the peanut as an animate agent. Immediate discourse overrule requires a model that integrates information at two timescales. One is over the lifetime and includes event knowledge and word semantics. The second is over the discourse in an event context. We propose a model where both are accounted for by temporal-to-spatial integration of experience into distributed spatial representations, providing immediate access to experience accumulated over different timescales. For lexical semantics, this is modeled by a word embedding system trained by sequential exposure to the entire Wikipedia corpus. For discourse, this is modeled by a recurrent reservoir network trained to generate a discourse vector for input sequences of words. The N400 is modeled as the difference between the instantaneous discourse vector and the target word. We predict this model can account for semantic immediacy and discourse overrule. The model simulates lexical priming and discourse overrule in the “Peanut in love” discourse, and it demonstrates that an unexpected word elicits reduced N400 if it is generally related to the event described in prior discourse, and that this effect disappears when the discourse context is removed. This neurocomputational model is the first to simulate immediacy and overrule in discourse-modulated N400, and contributes to characterization of online integration processes in discourse.https://direct.mit.edu/nol/article/2/1/83/95859/A-Model-of-Online-Temporal-Spatial-Integration-for |
| spellingShingle | Takahisa Uchida Nicolas Lair Hiroshi Ishiguro Peter Ford Dominey A Model of Online Temporal-Spatial Integration for Immediacy and Overrule in Discourse Comprehension Neurobiology of Language |
| title | A Model of Online Temporal-Spatial Integration for Immediacy and Overrule in Discourse Comprehension |
| title_full | A Model of Online Temporal-Spatial Integration for Immediacy and Overrule in Discourse Comprehension |
| title_fullStr | A Model of Online Temporal-Spatial Integration for Immediacy and Overrule in Discourse Comprehension |
| title_full_unstemmed | A Model of Online Temporal-Spatial Integration for Immediacy and Overrule in Discourse Comprehension |
| title_short | A Model of Online Temporal-Spatial Integration for Immediacy and Overrule in Discourse Comprehension |
| title_sort | model of online temporal spatial integration for immediacy and overrule in discourse comprehension |
| url | https://direct.mit.edu/nol/article/2/1/83/95859/A-Model-of-Online-Temporal-Spatial-Integration-for |
| work_keys_str_mv | AT takahisauchida amodelofonlinetemporalspatialintegrationforimmediacyandoverruleindiscoursecomprehension AT nicolaslair amodelofonlinetemporalspatialintegrationforimmediacyandoverruleindiscoursecomprehension AT hiroshiishiguro amodelofonlinetemporalspatialintegrationforimmediacyandoverruleindiscoursecomprehension AT peterforddominey amodelofonlinetemporalspatialintegrationforimmediacyandoverruleindiscoursecomprehension AT takahisauchida modelofonlinetemporalspatialintegrationforimmediacyandoverruleindiscoursecomprehension AT nicolaslair modelofonlinetemporalspatialintegrationforimmediacyandoverruleindiscoursecomprehension AT hiroshiishiguro modelofonlinetemporalspatialintegrationforimmediacyandoverruleindiscoursecomprehension AT peterforddominey modelofonlinetemporalspatialintegrationforimmediacyandoverruleindiscoursecomprehension |