> no high quantisation library supports two GPUs for example, and there seems to be no interest in implementating it by the guys behind the best inference tools
I'm curious to hear what you're trying to run, because I haven't used any software that is not compatible with multiple GPUs.
Why do you think they continue to run at a loss? From the goodness of their heart? Their biggest goal is to discourage anyobe from running local models. The hardware is expensive... The way to run models is very difficult (for example I have dual rtx 3090 for vram and running large heavily quantized models is a real pain in the arse, no high quantisation library supports two GPUs for example, and there seems to be no interest in implementating it by the guys behind the best inference tools).
So this is welcome, but let's not forget why it is being done.