Hence the problem (in my view).

Because "marriage" has important legal ramifications in the U.S., you are denying people rights if you deny them marriage.

I think you should be free to think about marriage _as a tradition_ as you want. But to enforce discrimination against people is a different thing.