If there are more units than renters, prices WILL drop, and fast. Landlords compete against each other, which is why you want many of them.
However, in today's world where AirBNB is unbelievably profitable, more houses than ever can be put up for rent at extreme prices. It heavily restricts the housing supply in a way that wasn't possible before AirBNB came around.
But I don’t think there’s either an infinite pool of AirBnB demand or that every landlord is willing to put up with running an AirBnB regardless of profit (doing AirBnB is more a business than a passive investment).
Maybe limiting AirBnB in residential zones will contribute to the solution, but neither limiting the capital flow into housing nor limiting the number of new units built will ever work.
Renting houses simply shouldn't be such a profitable endeavor. There have been stories posted where hotels snap up apartment units for AirBNB because those make more money than hotel rooms. That should never be the case.