A Systematic Assessment of Syntactic Generalization in Neural Language Models

While state-of-the-art neural network models continue to achieve lower perplexity scores on language modeling benchmarks, it remains unknown whether optimizing for broad-coverage predictive performance leads to human-like syntactic knowledge. Furthermore, existing work has not provided a clear pictu...

Full description

Bibliographic Details
Main Authors: Hu, Jennifer, Gauthier, Jon, Qian, Peng, Levy, Roger P
Other Authors: Massachusetts Institute of Technology. Department of Brain and Cognitive Sciences
Format: Article
Language:English
Published: Association for Computational Linguistics (ACL) 2021
Online Access:https://hdl.handle.net/1721.1/130402