News for hackers. Stuff that matters.
Re:NVIDIA introduces TensorRT-LLM for accelerating LLM infer... by KaoruAoiShiho on Friday September 08, 2023 @08:12PM (#37440904)
H100 is about $4 an hour and A100 is about $2 an hour at public market rates. But if you're willing to put up with some caveats and know where to look you can get them at roughly half of that each.

There are no comments on this comment yet.