Transformers Meet Small Datasets
The research and application areas of transformers have been extensively enlarged due to the success of vision transformers (ViTs). However, due to the lack of local content acquisition capabilities, the pure transformer architectures cannot be trained directly on small datasets. In this work, we fi...
Main Authors: | Ran Shao, Xiao-Jun Bi |
---|---|
Format: | Article |
Language: | English |
Published: |
IEEE
2022-01-01
|
Series: | IEEE Access |
Subjects: | |
Online Access: | https://ieeexplore.ieee.org/document/9944625/ |
Similar Items
-
Transformer-Based Disease Identification for Small-Scale Imbalanced Capsule Endoscopy Dataset
by: Long Bai, et al.
Published: (2022-08-01) -
CAEVT: Convolutional Autoencoder Meets Lightweight Vision Transformer for Hyperspectral Image Classification
by: Zhiwen Zhang, et al.
Published: (2022-05-01) -
Car Full View Dataset: Fine-Grained Predictions of Car Orientation from Images
by: Andy Catruna, et al.
Published: (2023-12-01) -
Person Identification and Gender Classification Based on Vision Transformers for Periocular Images
by: Vasu Krishna Suravarapu, et al.
Published: (2023-02-01) -
CCTCOVID: COVID-19 detection from chest X-ray images using Compact Convolutional Transformers
by: Abdolreza Marefat, et al.
Published: (2023-02-01)