You would not pay those taxes if they were optional. Most wouldn't anyways. Most people live in a paycheck to paycheck world and would love to get a free pass on that tax bill.

"We" also have not really decided anything as a society but were born into the decisions of prior generations and it could be changed. See Roe v Wade, marijuana, etc.