Using Computational Models to Test Syntactic Learnability

<jats:title>Abstract</jats:title> <jats:p>We study the learnability of English filler–gap dependencies and the “island” constraints on them by assessing the generalizations made by autoregressive (incremental) language models that use deep learning to predict the ne...

Full description

Bibliographic Details
Main Authors: Wilcox, Ethan Gotlieb, Futrell, Richard, Levy, Roger
Other Authors: Massachusetts Institute of Technology. Department of Brain and Cognitive Sciences
Format: Article
Language:English
Published: MIT Press 2023
Online Access:https://hdl.handle.net/1721.1/150009
Description
Summary:<jats:title>Abstract</jats:title> <jats:p>We study the learnability of English filler–gap dependencies and the “island” constraints on them by assessing the generalizations made by autoregressive (incremental) language models that use deep learning to predict the next word given preceding context. Using factorial tests inspired by experimental psycholinguistics, we find that models acquire not only the basic contingency between fillers and gaps, but also the unboundedness and hierarchical constraints implicated in the dependency. We evaluate a model’s acquisition of island constraints by demonstrating that its expectation for a filler–gap contingency is attenuated within an island environment. Our results provide empirical evidence against the Argument from the Poverty of the Stimulus for this particular structure.</jats:p>