Re:Learnings from fine-tuning LLM on my Telegram messages
by furiousteabag on Tuesday November 28, 2023 @01:02AM
(#38442851)
This may sound stupid, but from my perspective renting random VMs on vast.ai is safe in general and might be safer than using traditional cloud providers in particular. Consider this: on your VM a new image starts several times a day, each time with a new volume. It downloads tens of GBs of data and weights for training. Once training is done, everything gets cleaned up and the process starts again for a new tenant. This constant cycle makes it kind of difficult to track and extract any meaningful data from it.
But that's not what he says.
>I don’t want to use any third-party fine-tuning services
He might be okay with a third-party storing his messages but not using them in their models etc.