Neural Architecture Search for Transformers: A Survey

Neural Architecture Search for Transformers: A Survey

Transformer-based Deep Neural Network architectures have gained tremendous interest due to their effectiveness in various applications across Natural Language Processing (NLP) and Computer Vision (CV) domains. These models are the de facto choice in several language tasks, such as Sentiment Analysis...

Full description

Bibliographic Details
Main Authors: Krishna Teja Chitty-Venkata, Murali Emani, Venkatram Vishwanath, Arun K. Somani
Format: Article
Language:English
Published: IEEE 2022-01-01
Series:IEEE Access
Subjects:
Neural architecture search
NAS
transformers
BERT
vision transformers
multi-head self-attention
Online Access:https://ieeexplore.ieee.org/document/9913476/

Internet

https://ieeexplore.ieee.org/document/9913476/

Similar Items