Augmenting Transformers with KNN-Based Composite Memory for Dialog

AbstractVarious machine learning tasks can benefit from access to external information of different modalities, such as text and images. Recent work has focused on learning architectures with large memories capable of storing this knowledge. We propose augmenting generative Transform...

Full description

Bibliographic Details
Main Authors: Angela Fan, Claire Gardent, Chloé Braud, Antoine Bordes
Format: Article
Language:English
Published: The MIT Press 2021-01-01
Series:Transactions of the Association for Computational Linguistics
Online Access:https://direct.mit.edu/tacl/article/doi/10.1162/tacl_a_00356/97779/Augmenting-Transformers-with-KNN-Based-Composite