News for hackers. Stuff that matters.
Re:Replit - How to train your own LLM Models by PlantsRpeople2 on Thursday April 20, 2023 @08:01AM (#35638730)
Is it possible to add to an LLM without re-training it, my understanding was no.
Re:Replit - How to train your own LLM Models by ssivark on Thursday April 20, 2023 @09:05AM (#35639319)
The original “pre-training” Is what’s expensive. The “fine-tuning” (also training that it modifies network weights) for instruction following or other tasks costs the thousand dollar range.