Experimental Comparison of Transformers and Reformers for Text Classification

In this paper, we present experimental analysis of Transformers and Reformers for text classification applications in natural language processing. Transformers and Reformers yield the state-of-the-art performance and use attention scores for capturing the relationships between words in the sentences...

Full description

Bibliographic Details
Main Authors: Roghayeh Soleymani, Julien Beaulieu, Jérémie Farret
Format: Article
Language:English
Published: IFSA Publishing, S.L. 2021-02-01
Series:Sensors & Transducers
Subjects:
Online Access:https://sensorsportal.com/HTML/DIGEST/february_2021/Vol_249/P_3212.pdf