This is cognate to the "Black people can get married, just not to members of a different race" argument, which has long been recognized as specious.