Rational integration of noisy evidence and prior semantic expectations in sentence interpretation

Sentence processing theories typically assume that the input to our language processing mechanisms is an error-free sequence of words. However, this assumption is an oversimplification because noise is present in typical language use (for instance, due to a noisy environment, producer errors, or per...

Full description

Bibliographic Details
Main Authors: Gibson, Edward A., Bergen, Leon, Piantadosi, Steven T.
Other Authors: Massachusetts Institute of Technology. Department of Brain and Cognitive Sciences
Format: Article
Language:en_US
Published: National Academy of Sciences (U.S.) 2014
Online Access:http://hdl.handle.net/1721.1/88255
https://orcid.org/0000-0003-1013-1461
https://orcid.org/0000-0002-5912-883X
_version_ 1811095272639430656
author Gibson, Edward A.
Bergen, Leon
Piantadosi, Steven T.
author2 Massachusetts Institute of Technology. Department of Brain and Cognitive Sciences
author_facet Massachusetts Institute of Technology. Department of Brain and Cognitive Sciences
Gibson, Edward A.
Bergen, Leon
Piantadosi, Steven T.
author_sort Gibson, Edward A.
collection MIT
description Sentence processing theories typically assume that the input to our language processing mechanisms is an error-free sequence of words. However, this assumption is an oversimplification because noise is present in typical language use (for instance, due to a noisy environment, producer errors, or perceiver errors). A complete theory of human sentence comprehension therefore needs to explain how humans understand language given imperfect input. Indeed, like many cognitive systems, language processing mechanisms may even be “well designed”–in this case for the task of recovering intended meaning from noisy utterances. In particular, comprehension mechanisms may be sensitive to the types of information that an idealized statistical comprehender would be sensitive to. Here, we evaluate four predictions about such a rational (Bayesian) noisy-channel language comprehender in a sentence comprehension task: (i) semantic cues should pull sentence interpretation towards plausible meanings, especially if the wording of the more plausible meaning is close to the observed utterance in terms of the number of edits; (ii) this process should asymmetrically treat insertions and deletions due to the Bayesian “size principle”; such non-literal interpretation of sentences should (iii) increase with theperceived noise rate of the communicative situation and (iv) decrease if semantically anomalous meanings are more likely to be communicated. These predictions are borne out, strongly suggesting that human language relies on rational statistical inference over a noisy channel.
first_indexed 2024-09-23T16:14:21Z
format Article
id mit-1721.1/88255
institution Massachusetts Institute of Technology
language en_US
last_indexed 2024-09-23T16:14:21Z
publishDate 2014
publisher National Academy of Sciences (U.S.)
record_format dspace
spelling mit-1721.1/882552022-10-02T07:11:41Z Rational integration of noisy evidence and prior semantic expectations in sentence interpretation Gibson, Edward A. Bergen, Leon Piantadosi, Steven T. Massachusetts Institute of Technology. Department of Brain and Cognitive Sciences Massachusetts Institute of Technology. Department of Linguistics and Philosophy Gibson, Edward A. Bergen, Leon Sentence processing theories typically assume that the input to our language processing mechanisms is an error-free sequence of words. However, this assumption is an oversimplification because noise is present in typical language use (for instance, due to a noisy environment, producer errors, or perceiver errors). A complete theory of human sentence comprehension therefore needs to explain how humans understand language given imperfect input. Indeed, like many cognitive systems, language processing mechanisms may even be “well designed”–in this case for the task of recovering intended meaning from noisy utterances. In particular, comprehension mechanisms may be sensitive to the types of information that an idealized statistical comprehender would be sensitive to. Here, we evaluate four predictions about such a rational (Bayesian) noisy-channel language comprehender in a sentence comprehension task: (i) semantic cues should pull sentence interpretation towards plausible meanings, especially if the wording of the more plausible meaning is close to the observed utterance in terms of the number of edits; (ii) this process should asymmetrically treat insertions and deletions due to the Bayesian “size principle”; such non-literal interpretation of sentences should (iii) increase with theperceived noise rate of the communicative situation and (iv) decrease if semantically anomalous meanings are more likely to be communicated. These predictions are borne out, strongly suggesting that human language relies on rational statistical inference over a noisy channel. National Science Foundation (U.S.) (Grant 0844472, from the Linguistics Program) 2014-07-10T20:32:19Z 2014-07-10T20:32:19Z 2013-05 2012-09 Article http://purl.org/eprint/type/JournalArticle 0027-8424 1091-6490 http://hdl.handle.net/1721.1/88255 Gibson, E., L. Bergen, and S. T. Piantadosi. “Rational Integration of Noisy Evidence and Prior Semantic Expectations in Sentence Interpretation.” Proceedings of the National Academy of Sciences 110, no. 20 (May 14, 2013): 8051–8056. https://orcid.org/0000-0003-1013-1461 https://orcid.org/0000-0002-5912-883X en_US http://dx.doi.org/110.1073/pnas.1216438110 Proceedings of the National Academy of Sciences Article is made available in accordance with the publisher's policy and may be subject to US copyright law. Please refer to the publisher's site for terms of use. application/pdf National Academy of Sciences (U.S.) PNAS
spellingShingle Gibson, Edward A.
Bergen, Leon
Piantadosi, Steven T.
Rational integration of noisy evidence and prior semantic expectations in sentence interpretation
title Rational integration of noisy evidence and prior semantic expectations in sentence interpretation
title_full Rational integration of noisy evidence and prior semantic expectations in sentence interpretation
title_fullStr Rational integration of noisy evidence and prior semantic expectations in sentence interpretation
title_full_unstemmed Rational integration of noisy evidence and prior semantic expectations in sentence interpretation
title_short Rational integration of noisy evidence and prior semantic expectations in sentence interpretation
title_sort rational integration of noisy evidence and prior semantic expectations in sentence interpretation
url http://hdl.handle.net/1721.1/88255
https://orcid.org/0000-0003-1013-1461
https://orcid.org/0000-0002-5912-883X
work_keys_str_mv AT gibsonedwarda rationalintegrationofnoisyevidenceandpriorsemanticexpectationsinsentenceinterpretation
AT bergenleon rationalintegrationofnoisyevidenceandpriorsemanticexpectationsinsentenceinterpretation
AT piantadosistevent rationalintegrationofnoisyevidenceandpriorsemanticexpectationsinsentenceinterpretation