Re:Cost Per 1M tokens Of Self Hosting Llama-3
by wongarsu on Friday June 14, 2024 @02:13PM
(#40683316)
In a previous AI wave hosters like OVH and Hetzner started offering servers with GTX 1080 at prices other hosters with datacenter-grade GPUs couldn't possibly compete with - and VRAM wasn't as big of a deal back then. That's who this clause targets.
If you don't rent our servers or VMs Nvidia doesn't care. They aren't Oracle.
If you don't rent our servers or VMs Nvidia doesn't care. They aren't Oracle.