Re:NVIDIA introduces TensorRT-LLM for accelerating LLM infer...
by KaoruAoiShiho on Friday September 08, 2023 @08:12PM
(#37440904)
H100 is about $4 an hour and A100 is about $2 an hour at public market rates. But if you're willing to put up with some caveats and know where to look you can get them at roughly half of that each.
[ Parent
| on HN ]
There are no comments on this comment yet.