News for hackers. Stuff that matters.
Re:Fine-tune Google's Gemma 3 by simonw on Wednesday March 19, 2025 @09:36PM (#43419137)
"Codebases, docs, large corpses of internal datasets"

I still haven't seen a convincing demo of using fine-tuning to "teach" a model new information from additional documents. I'd love to see one.

(Closest I've come to that is I heard a rumor that Jane Street have fine-tuned an LLM for OCaml)

Re:Fine-tune Google's Gemma 3 by adefa on Wednesday March 19, 2025 @10:03PM (#43419269)
Here is a small LLM I trained to output dollars and cents from a verbal numeric amount:

https://huggingface.co/TrevorJS/check-amount-deverbalizer-sm...