News for hackers. Stuff that matters.
Re:Looking to build a personalized AI for myself. Any resour... by kcorbitt on Friday March 29, 2024 @08:56PM (#39870770)
Just to correct the record a bit, while you certainly can spend $1K+ to fine-tune a model we've found that the average user on openpipe.ai spends less than $30 per fine-tune. It actually takes quite a lot of data (likely more than the OP has produced in their interactions with the forum) to crack $100 in fine-tuning costs!

Of course this is heavily dependent on what you're using for source data. And in any case, the OP would certainly be spending far more than $30 in time trying to get their data in the right format, which may or may not be a good use of time based on how excited they are about learning the process end-to-end. :)

Re:Looking to build a personalized AI for myself. Any resour... by kordlessagain on Sunday March 31, 2024 @07:51AM (#39883399)
Would a model actually perform better fine tuned on such a small data set? Seems to me that just giving it the data during inference of new stuff would net better results, using something like RAG.