If landlords can make a killing by constraining supply politically, they will. So the primary cause is the incentive system and the political environment which makes it possible for them to do that.
It's all about how the reward functions are designed. So of course if you reward scarcity and profiteering that's what you get - as a secondary outcome, not a primary cause.
In cities with zoning constraints, developers are the only natural predators of landlords. They are entirely different skillsets, building new units requires managing an extremely difficult political process for permits, raising capital, working with contractors and labor, etc. Being a landlord requires very different analysis and skills.
There may be a few landlords with the capacity to cross over to development too, but it isn't many of them.
If you have a bunch of left wing groups who are anti-development fighting to keep supply constrained even while complaining the rent is too damn high and the character of the City is changing and yadda yadda yadda, who are you[1], as a landlord, to take the wind out of their sails when you are profiting from their protests?
[1] The general “you”, not you specifically.
I've literally never seen it dismissed as a non factor - not even once.
EDIT: While I’m inside the edit window, let me throw in another big variable as an example. Costs are another factor that inform a price, and a big one. You could make a case that it deserves higher billing than supply and demand, but if your costs are $X but you can only sell your widget for $X-1, and not $X+>=0, then $X-1 is your price ceiling. Your business is unprofitable and losing money.
I’m trying to be careful with my words but I still seem to be leaving some people with the impression that I think supply and demand is the only variable that informs a price. It’s not, but it’s still incredibly important and often dismissed as a non-factor when discussing San Francisco rental and real estate prices with San Franciscans.