News for hackers. Stuff that matters.
Re:Building a personal, private AI computer on a budget by ollybee on Tuesday February 11, 2025 @11:44AM (#43014955)
The middle ground is to rent a GPU VPS as needed. You can get an H100 for $2/h. Not quite the same privacy as fully local offline, but better than a SASS API and good enough for me. Hopefully in a year or three it will truly be cost effective to run something useful locally and then I can switch.
Re:Building a personal, private AI computer on a budget by 1shooner on Tuesday February 11, 2025 @12:56PM (#43015871)
Do you have a recommended provider or other pointers for GPU rental?
Re:Building a personal, private AI computer on a budget by anonzzzies on Tuesday February 11, 2025 @01:24PM (#43016267)
That is what I do but it costs a lot of $, more than just using openrouter. I would like to have a machine so I can have a model talk to itself 24/7 for a realtively fixed price. I have enough solar and wind + cheap net electric so it would basically be free after buying. Just hard to pick what to buy without just forking out a fortune on GPU's.