Re:Deploying DeepSeek on 96 H100 GPUs
by zipy124 on Friday August 29, 2025 @12:17PM
(#45066023)
This is all costs included. Thats 22k tokens per second per node, so per 8 h100's. With 12 nodes they get 264k tokens per second, or 950 million an hour. This get's you to roughly $0.2021 per million at $2 an hour for an h100, which is what they go for on services such as runpod.io . (cheaper if not paying spot-price + volume discounts).
[ Parent
| on HN ]
There are no comments on this comment yet.