Lightweight transformers for clinical natural language processing

Specialised pre-trained language models are becoming more frequent in Natural language Processing (NLP) since they can potentially outperform models trained on generic texts. BioBERT (Sanh et al., Distilbert, a distilled version of bert: smaller, faster, cheaper and lighter. arXiv preprint arXiv: 19...

Full description

Bibliographic Details
Main Authors: Rohanian, O, Nouriborji, M, Jauncey, H, Kouchaki, S, Nooralahzadeh, F, Clifton, L, Merson, L, Clifton, DA
Other Authors: ISARIC Clinical Characterisation Group
Format: Journal article
Language:English
Published: Cambridge University Press 2024