News for hackers. Stuff that matters.

A comment on ChatGPT Hardware a Look at 8x Nvidia A100 Powering the Tool. Parent comment

Re:ChatGPT Hardware a Look at 8x Nvidia A100 Powering the Tool by 0x008 on Tuesday February 14, 2023 @10:24AM (#34790593)
Not for whole systems but the single GPUs (A100/A40) are significantly better in performance per watt (almost by a factor of 2) than RTX cards for Machine Learning workloads.

You can watch this LTT video to get an idea: https://youtu.be/zBAxiQi2nPc

Probably if you run them full time in a enterprise environment the power consumption will be the bulk of your cost?

[ Parent | on HN ]

There are no comments on this comment yet.