if you want an always-on gpu for $50/mo? That's unreasonable. Consider how much "building from scratch" even a cheap "minimal" GPU unit costs (let's say 3k GPU + 1k supporting PC), whereas a cheap "building from scratch minimal webspace" is a fraction of a single CPU unit, so let's say $100-ish/unit dollars, to be really generous. A rented non-fractional GPU should be easily minimally 40x the cost of a website.

Don't expect these ratios to be authoritative; there are obviously different economies of scale and many many details I papered over, but this should just give you an idea of the back of the envelope "relative costs"; just that 5x is way out of the range you should have guessed.