Schrödinger's tree—On syntax and neural language models

In the last half-decade, the field of natural language processing (NLP) has undergone two major transitions: the switch to neural networks as the primary modeling paradigm and the homogenization of the training regime (pre-train, then fine-tune). Amidst this process, language models have emerged as...

Full description

Bibliographic Details
Main Authors: Artur Kulmizev, Joakim Nivre
Format: Article
Language:English
Published: Frontiers Media S.A. 2022-10-01
Series:Frontiers in Artificial Intelligence
Subjects:
Online Access:https://www.frontiersin.org/articles/10.3389/frai.2022.796788/full