Re:Fine tune LLAMA3 on million scale dataset in consumer GPU...
by bigfudge on Thursday April 25, 2024 @03:27AM
(#40154530)
Fine tuning doesn’t ’add content’ the way RAG does though. They’re not really comparable in that way.
Re:Fine tune LLAMA3 on million scale dataset in consumer GPU...
by Foobar8568 on Thursday April 25, 2024 @06:53AM
(#40155859)
So more to be optimized for specific tasks in a domain ?
Another aspect where I am unsure is multi user for a model e.g. can we have concurrency for a model or the queries have to be queued.