Full-Memory Transformer for Image Captioning

The Transformer-based approach represents the state-of-the-art in image captioning. However, existing studies have shown Transformer has a problem that irrelevant tokens with overlapping neighbors incorrectly attend to each other with relatively large attention scores. We believe that this limitatio...

Full description

Bibliographic Details
Main Authors: Tongwei Lu, Jiarong Wang, Fen Min
Format: Article
Language:English
Published: MDPI AG 2023-01-01
Series:Symmetry
Subjects:
Online Access:https://www.mdpi.com/2073-8994/15/1/190