Not only that, but they remain in power with fantasy mandates, because people who hated them were forced to rank them. In Australia, it's criminal not to rank candidates you hate, and criminal to encourage people not to include particular candidates in their rankings, aka a Langer Vote: https://en.wikipedia.org/wiki/Albert_Langer
Australia: Political activist becomes first prisoner of conscience for over 20 years (Albert Langer)
Term limits just change the balance away from elected politicians (who can build up a reputation for integrity and competence) and towards the unelected party machinery, who inexperienced politicians are more dependent on.
(Of course, for life-time appointments like supreme court justices, term limits would be an improvement, you're right).
What we need are term limits.