News for hackers. Stuff that matters.

A comment on Mistral: Our first AI endpoints are available in early access. Parent comment

Re:Mistral: Our first AI endpoints are available in early ac... by Filligree on Monday December 11, 2023 @08:35AM (#38600494)
The 4090 is considerably more power-hungry compared to e.g. an A100, however.
[ Parent | on HN ]
Re:Mistral: Our first AI endpoints are available in early ac... by fpgaminer on Monday December 11, 2023 @03:00PM (#38604727)
If comparing apples to apples, the 4090 needs to clock up and consume about 450 W to match the A100 at 350W. Part of that is due to being able to run larger batches on the A100, which gives it an additional performance edge, but yes in general the A100 is more power efficient.
[ Parent | on HN ]