Comparing Parameter Efficient Finetuning Techniques (PEFT) using Datamodels

Advances in machine learning, particularly through algorithmic innovations and large datasets, have led to models with hundreds of billions of parameters. Deploying these models is challenging and costly, especially due to the extensive finetuning required. Parameter-efficient finetuning techniques...

Full description

Bibliographic Details
Main Author: Chamdal, Harshal
Other Authors: Mądry, Aleksander
Format: Thesis
Published: Massachusetts Institute of Technology 2024
Online Access:https://hdl.handle.net/1721.1/157345