The problem arises when that contract is binding on future homeowners.
The even bigger problem is that if you are in a reasonable HOA, draconian rules can be enacted that you disagree with - as long as the majority agree.
Which is quite a lot of them; there are cities where you're unlikely to find anything reasonable in city limits.
> the vast majority of them are low maintenance
Most HOAs can become worse on a moment's notice depending on who has power in them, because most people (reasonably) don't want to spend the energy fighting in bitter ridiculous politics.
I've lived in a country ruled by a dictator. I can assure you - in most such countries the majority of the folks are happy with the status quo. It's only a small percentage that is badly abused. Therefore we should all be OK surrendering our rights to the government, right?
And so it is with HOAs. The majority don't screw you, but I don't want them to have the power to screw me.