A Systematic Review of Transformer-Based Pre-Trained Language Models through Self-Supervised Learning

Transfer learning is a technique utilized in deep learning applications to transmit learned inference to a different target domain. The approach is mainly to solve the problem of a few training datasets resulting in model overfitting, which affects model performance. The study was carried out on pub...

Full description

Bibliographic Details
Main Authors: Evans Kotei, Ramkumar Thirunavukarasu
Format: Article
Language:English
Published: MDPI AG 2023-03-01
Series:Information
Subjects:
Online Access:https://www.mdpi.com/2078-2489/14/3/187