News for hackers. Stuff that matters.

A comment on Ask HN: When is fine-tuning a small LLM worth it?.

Re:Ask HN: When is fine-tuning a small LLM worth it? by Vicmed13 on Tuesday September 22, 2026 @05:27PM (#49808350)
I personally would only do it if I need it to solve a highly specialized problem that requires every inch of privacy I can get. Otherwise there are better options out there
[ Parent | on HN ]
Re:Ask HN: When is fine-tuning a small LLM worth it? by dsjakupov on Saturday September 26, 2026 @02:34PM (#49859219)
Yeah, I did it for my app that specializes in privacy. Basically I used qwen2.5 for the mobile use and the case I was solving is user's most private thoughts - smth like a private diary But I am thinking about how can I fine-tune the model on the users' data and keep them private? Maybe like improve the model directly on the phone ahhaha
[ Parent | on HN ]