Adapting to the Long Tail: A Meta-Analysis of Transfer Learning Research for Language Understanding Tasks

AbstractNatural language understanding (NLU) has made massive progress driven by large benchmarks, but benchmarks often leave a long tail of infrequent phenomena underrepresented. We reflect on the question: Have transfer learning methods sufficiently addressed the poor performance o...

Full description

Bibliographic Details
Main Authors: Aakanksha Naik, Jill Lehman, Carolyn Rosé
Format: Article
Language:English
Published: The MIT Press 2022-01-01
Series:Transactions of the Association for Computational Linguistics
Online Access:https://direct.mit.edu/tacl/article/doi/10.1162/tacl_a_00500/112917/Adapting-to-the-Long-Tail-A-Meta-Analysis-of