Re:New models and developer products announced at OpenAI DevDay
by muttled on Monday November 06, 2023 @04:43PM
(#38169443)
For me personally, being able to fine-tune the local LLM's at a much higher rank and training more layers is very useful for (somewhat unreliably) embedding information. AFAIK the OpenAI fine-tuning is more geared towards formatting the output.
[ Parent
| on HN ]
Re:New models and developer products announced at OpenAI DevDay
by bigfudge on Monday November 06, 2023 @05:06PM
(#38169738)
As I understand it, fine tuning is never really about adding content. RAG and related techniques are likely cheaper/better if that’s what you want.