When do prompting and prefix-tuning work? a theory of capabilities and limitations
Context-based fine-tuning methods, including prompting, in-context learning, soft prompting (also known as prompt tuning), and prefix-tuning, have gained popularity due to their ability to often match the performance of full fine-tuning with a fraction of the parameters. Despite their empirical succ...
Main Authors: | , , |
---|---|
Format: | Conference item |
Language: | English |
Published: |
OpenReview
2024
|