News for hackers. Stuff that matters.
Re:Can LLMs learn from a single example? by antupis on Wednesday September 06, 2023 @04:06AM (#37402468)
I think some cases CF would be even good eg you want llm that produces only valid json data as output.
Re:Can LLMs learn from a single example? by josephg on Wednesday September 06, 2023 @05:47AM (#37403060)
Yeah, this is essentially how finetuned models work. If you fine tune stablediffusion to produce anime images, it might forget how to produce images in any other style. But it will become much better at anime images than the base model. If anime images are the art style you’re after, this is a good trade. Same with fine tuning LLMs for SQL or whatever.