Is there enough volume of this chip for it to mean anything to anyone? If there are only a few that no one can’t buy, and they are only better than nvidia at 1 out of 10’000 workloads, can people even use their existence to try to get lower H100 prices?
I am currently analyzing the feasibility and economics of building a cloud service for AI training. This involves "day to day" analysis changes since all the "parts" are moving.
Also, how Gaudi3 compares to Google TPUs? Thanks! I know that Gaudi3 is not readily available yet.
[1] https://habana.ai/products/gaudi/