You've got that backwards. With the people that voted for them the bulk of the politicians are still happy. A recalled vote would simply deduct one from the result as set and would leave the rest of the results in place until the balance point was reached. That would not be something that would 'go back and forth', you could only do that once and when the withdrawn votes balance out (which typically for both parties would normally happen at roughly the same rate) would you call a new election.

So that would not happen nearly as often as you might think, and would likely require a fairly major turn of opinion before it would have any effect.

The two party system by the way is very much broken, as is the influence of money in American politics but that's a completely different - and local - affair.