Get romantically married, but don't sign a contract with the government! By not singing some paperwork you can both avoid of alot of problems (but not all). Frame it like this: honey, I want to get married with you, not sign a business contract with you. Or I want to get married with you, not with the government too!