Toward Practical Usage of the Attention Mechanism as a Tool for Interpretability

Natural language processing (NLP) has been one of the subfields of artificial intelligence much affected by the recent neural revolution. Architectures such as recurrent neural networks (RNNs) and attention-based transformers helped propel the state of the art across various NLP tasks, such as seque...

Full description

Bibliographic Details
Main Authors: Martin Tutek, Jan Snajder
Format: Article
Language:English
Published: IEEE 2022-01-01
Series:IEEE Access
Subjects:
Online Access:https://ieeexplore.ieee.org/document/9762294/