buying GPUs will always be cheaper than renting, unless something changes dramatically. even with GPU prices being what they are today.

depending on usage, you could start saving money over rented GPU time in a single-digit number of weeks.