Re:MLC-LLM: GPT/Llama on consumer-class GPUs and phones
by smoldesu on Sunday April 30, 2023 @02:13PM
(#35765115)
If you can saturate it, sure. The average person is not going to be running 24/7 AI compute tasks though, so paying for a month of A100 dedi when you only need 10-20 minutes of compute/week is a complete waste.
[ Parent
| on HN ]
There are no comments on this comment yet.