Ask HN: How do you fine-tune LLMs?

Posted by xzyaoi on Sunday October 06, 2024 @04:20PM
from the ask-hn dept.

Do you usually do full fine-tuning or LoRA (or its variants)? and why?

( 1 comment | 2 points | on HN )

Re:Ask HN: How do you fine-tune LLMs? by yawnxyz on Sunday October 06, 2024 @04:22PM (#41759989)

I'm curious if the how ppl fine-tune LLMs depends on why ppl fine-tune LLMs.

The couple of times I've tried to fine-tune a text model I've consistently gotten way worse results (I'm not good at it), so I've just stopped trying...

[ Parent | on HN ]