inferencecoder

Not necessarily, could be agent swarm with low N

It doesn't imply that, it's just measuring the amount of compute.

I meant serious players often do serve on a single node. They can beat API pricing as well. Multi-node can add gain, but also adds a lot of deployment complexity so its just not always possible or optimal.

> Not to mention no one serious is serving this on 8xB200 instead of multiple nodes: the vast majority of Moonshot's inference work is focused on PD-disaggregation

The GPU price discourse is absurd, but many are serving models on single node setups when the model fits

To begin with, as I pointed out separately, the price comparison that makes the headline is absurd. No one is easily getting the MI355X's at $2.5/hr. And then the eval is unreplicable and poorly defined.

I think it's fair to expect an extensive review of an article before publishing. Not everything has a set of serious flaws.

Wafer is making themselves synonymous with slop in the inference space. Exaggerated unfair comparisons in all their results, twitter hype posts with alarm emojis etc.

> $2.50/GPU-hr for the MI355X, $6.00 for the B300, and $4.25 for the B200.

This is not an accurate price comparison for real terms.

There is barely any effort, a simple GPT5.6 sol pro query rips the post apart.