It starts to break down for child custody as well as medical directives, end-of-life decisions, hospital visitation. You also don’t get marriage related tax benefits or the ability to hold title to real estate or financial accounts as “tenants in the entirety” (which is permitted only in some states, solely for married couples, that protects joint assets when only one person has claims against them), which is important depending on the creditor laws of your state and how they handle claims against a member of a multi member LLC.
People can use different terms to distinguish between different things, but that doesn't necessarily make any of those things "second class," full stop.
All label the upper/dominant class uses to show they are giving those below them everything they are entitled to, except actual equality, while firmly keeping them where they belong.
I agree entirely with this, but just as civil rights and legalizing recreational drugs took forever (and is still ongoing), it's going to be decades of effort to dismantle the societal expectations of marriage while still enabling the benefits that come/came along with traditional marriage (legal, financial rights).
Relationships are hard enough with just two people, adding more people doesn't make it easier, so you have to provide resources to help cultivate that stability society wants to express (insert diatribe about lacking mental health funding here).
EDIT: Regarding raising kids in a poly family, "it takes a village" [+].
[+] https://en.wikipedia.org/wiki/It_takes_a_village