Tree-based Data Replay for More Efficient LLM Continual Learning

As Large Language Models (LLMs) gain popularity, they face a crucial challenge: effectively updating their knowledge bases with new data while retaining knowledge of prior information. This challenge is compounded by the considerable computational resources and time required to do so. This problem h...

Full description

Bibliographic Details
Main Author: Bailey, Brian
Other Authors: Chase, Christina
Format: Thesis
Published: Massachusetts Institute of Technology 2024
Online Access:https://hdl.handle.net/1721.1/157017