sorcer

No mining GPUs are in their fleet anymore, that's long gone. It's all datacenter GPUs as per their website.

A40 / A6000 and A5000 is a great GPU for single GPU inference and training, provides better price/performance than A100 for models that fit.

+1 to this

The only H100s available to get is the "little brother" PCIe version with HBM2e memory instead of HBM3. Very very few clouds, or people, in general, have H100 deployed at any scale. You will see when the MLPerf benchmark results come out.