Re:Alternative clouds are booming as companies seek cheaper ...
by Palmik on Monday May 06, 2024 @03:34PM
(#40278622)
It's horrible horrible pricing! Their on demand price for A100 is what gets you H100 sxm in other places.
Re:Alternative clouds are booming as companies seek cheaper ...
by dangrairo on Monday May 06, 2024 @05:04PM
(#40279511)
I am curious what "other places" are you comparing it to.
Re:Alternative clouds are booming as companies seek cheaper ...
by indigodaddy on Monday May 06, 2024 @06:58PM
(#40280455)
Also we’d have to do apples to apples right? One cannot complain about fly.io gpu pricing and then point to say vast.ai or lambda labs as “evidence” of that. They aren’t at all the same type of service..
Re:Alternative clouds are booming as companies seek cheaper ...
by benwaffle on Monday May 06, 2024 @04:51PM
(#40279364)
We've got a one-liner for spinning up your own ollama UI. See https://github.com/fly-apps/ollama-open-webui
Re:Alternative clouds are booming as companies seek cheaper ...
by indigodaddy on Monday May 06, 2024 @07:00PM
(#40280463)
Oh snap thank you!
Only problem might be everytime it spins up to download the large model might be wasteful as far as getting charged for network/bw usage— wonder if it would be more cost-efficient to have persistent storage or just see how much time and bw it is to download on every cold start…