News for hackers. Stuff that matters.
Re:Fine-tune Google's Gemma 3 by danielhanchen on Wednesday March 19, 2025 @07:31PM (#43418359)
We see a lot of this in large orgs! The main issue imo is actually the selection of chat templates - there's a lot of people who use a template for finetuning then totally forget to use it for finetuning.

A lot of financial, legal and health companies do fine-tuning! Reasoning finetuning via GRPO is also very powerful since you don't need any cot data in between! Just inputs and outputs!

There are no comments on this comment yet.