Every story and comment from the Hacker News API, in a layout borrowed from 2001.
A comment on Laptop Isn't Ready for LLMs. That's About to Change. Parent comment
But the operational costs are much lower than some people in this thread seem to think.
You can find a safe margin for the price by looking at aggregators.
https://gpus.io/gpus/h100 is showing $1.83/hour lowest price, around $2.85 average.
That easily pays running costs - a H100 server with cooling etc is around $0.10/hour to keep running
And a massive overbuild pushes prices down not up!
There are no comments on this comment yet.
But the operational costs are much lower than some people in this thread seem to think.
You can find a safe margin for the price by looking at aggregators.
https://gpus.io/gpus/h100 is showing $1.83/hour lowest price, around $2.85 average.
That easily pays running costs - a H100 server with cooling etc is around $0.10/hour to keep running
And a massive overbuild pushes prices down not up!