News for hackers. Stuff that matters.
Re:MLC-LLM: GPT/Llama on consumer-class GPUs and phones by smoldesu on Sunday April 30, 2023 @02:13PM (#35765115)
If you can saturate it, sure. The average person is not going to be running 24/7 AI compute tasks though, so paying for a month of A100 dedi when you only need 10-20 minutes of compute/week is a complete waste.

There are no comments on this comment yet.