Maybe the fact that everyone becomes old, whereas with other protected classes, everyone does not eventually gain membership into that class. So society as a whole is more sympathetic to discrimination that favors the older maybe because we can see ourselves in their shoes.