News for hackers. Stuff that matters.
Re:Deploying DeepSeek on 96 H100 GPUs by zipy124 on Friday August 29, 2025 @12:17PM (#45066023)
This is all costs included. Thats 22k tokens per second per node, so per 8 h100's. With 12 nodes they get 264k tokens per second, or 950 million an hour. This get's you to roughly $0.2021 per million at $2 an hour for an h100, which is what they go for on services such as runpod.io . (cheaper if not paying spot-price + volume discounts).

There are no comments on this comment yet.