Cross-Lingual Alignment of Contextual Word Embeddings, with Applications to Zero-shot Dependency Parsing

We introduce a novel method for multilingual transfer that utilizes deep contextual embeddings, pretrained in an unsupervised fashion. While contextual embeddings have been shown to yield richer representations of meaning compared to their static counterparts, aligning them poses a challenge due to...

Descrición completa

Detalles Bibliográficos
Main Authors: Schuster, Tal, Ram, Ori, Barzilay, Regina, Globerson, Amir
Outros autores: Massachusetts Institute of Technology. Computer Science and Artificial Intelligence Laboratory
Formato: Artigo
Idioma:English
Publicado: Association for Computational Linguistics 2020
Acceso en liña:https://hdl.handle.net/1721.1/128715