Interactions Between Syntax and Semantics in Language Models

How do syntax and semantics interact in neural language models? Is the intuitive dichotomy between semantics and syntax useful as a mental model of their behavior? In this thesis, I systematically investigate how models handle the interactions between sentence corruptions of each kind. I develop a s...

Full description

Bibliographic Details
Main Author: Bau, Anthony
Other Authors: Andreas, Jacob
Format: Thesis
Published: Massachusetts Institute of Technology 2022
Online Access:https://hdl.handle.net/1721.1/144680