Buying modded rtx 2080ti (22gb) still seems a good deal as long as you go to the source. It is a very nice card for the money. Around half of capability of rtx3090 for a third of the price.

As for v100, p100 etc I considered them, but they make zero sense as they don't have int8/int4. Everything gets upscaled in them which slows the inference down.