It seems to me that what is really going on here is that the personalization is lousy. The point of personalization, one hopes, is to show you what you want to see. But you say the personalized version does not do that. That being the case, the personalization has completely failed. Which might answer the OP's question about why people don't like personalized feeds.

On the other hand, it could be that you are upvoting not things you want to see, but things you agree with. Tragically, many people do. In that case, it's your own fault (or the fault of anyone who does such upvoting, and dislikes the results); the personalization algorithm is doing it's best, but it's getting bad data. And since upvoting based on agreement is so common, this also might answer the OP's question.