I'm not in a position to recommend or not a particular provider for gpu-equipped servers, simply because I've never had the need for gpus.

My first thought was related to colocation services. From what I understand, a lot of people avoid on-premise/in-house solutions because they don't want to deal with server rooms, redundant power, redundant networks, etc.

So people go to the cloud and pay horrendous prices there.

Why not take a middle path? Build your own custom server with your perferred hardware and put in a colocation