News for hackers. Stuff that matters.
Re:MLC-LLM: GPT/Llama on consumer-class GPUs and phones by taneq on Sunday April 30, 2023 @08:12PM (#35767755)
Those economies are for the cloud provider, not you. The cost to you is set at just less than their best guess at what you think self-hosting will cost you.

Cloud hosting only makes sense in a case that your capacity needs are changing rapidly and unpredictably, or the case where you’re so big that the cloud hosting company is effectively a department. Any other time it will almost certainly be cheaper to self host.

There are no comments on this comment yet.