Cross-Lingual Alignment of Contextual Word Embeddings, with Applications to Zero-shot Dependency Parsing

We introduce a novel method for multilingual transfer that utilizes deep contextual embeddings, pretrained in an unsupervised fashion. While contextual embeddings have been shown to yield richer representations of meaning compared to their static counterparts, aligning them poses a challenge due to...

Full description

Bibliographic Details
Main Authors: Schuster, Tal, Ram, Ori, Barzilay, Regina, Globerson, Amir
Other Authors: Massachusetts Institute of Technology. Computer Science and Artificial Intelligence Laboratory
Format: Article
Language:English
Published: Association for Computational Linguistics 2020
Online Access:https://hdl.handle.net/1721.1/128715

Similar Items