Re:I regret building this $3000 Pi AI cluster
by a2128 on Sunday September 21, 2025 @08:29AM
(#45322124)
Yep those are exactly the same considerations. LLM providers will have inconsistent latency and throughput due to batching across many users, while training with cloud GPU servers can have inconsistent bandwidth and delay for uploading mass training data. LLM providers are always limited in how you can use them (often no LoRAs, finetuned models, prompt restrictions)
[ Parent
| on HN ]
There are no comments on this comment yet.