Efficient LLMs Training and Inference: An Introduction

ChatGPT was released in late November 2022, making a significant impact globally. Following this release, numerous domestic and international open-source projects for large model training emerged, including Alpaca, BOOLM, LLaMA, ChatGLM, DeepSpeedChat, and ColossalChat. Both academia and industry ha...

Full description

Bibliographic Details
Main Authors: Rui Li, Deji Fu, Chunyu Shi, Zhilan Huang, Gang Lu
Format: Article
Language:English
Published: IEEE 2025-01-01
Series:IEEE Access
Subjects:
Online Access:https://ieeexplore.ieee.org/document/10756602/