I will say that casual love != casual sex. You can experience casual love without any sex at all. You can form romantic relationships that do not involve sex. While I personally am not wired that way I have plenty of poly friends who are. The longest running podcast on the subject, Polyamory Weekly, to this day uses the slogan “it’s not all about the sex.”
Casual sex for a lot of people is a much less satisfying experience than sex in a long term relationship. But to be fair, let’s acknowledge that loads of committed relationships also suffer in the bedroom, so it’s not all great there either. Ultimately it depends on you and your preferences/needs. And of course on the partners you select.
Empirically I can say that I experience love towards a partner about 1/10 times or so. Though my sample size is not actually all that great because while poly, I am very very selective. This may be surprising but the reality is that poly doesn’t mean “screw everything with two legs.” It just means that if someone does interest you, you are free to explore that however you want, and your partners have the same freedom. Whether you choose to have one anchor partner who you share your home life with, or you do “solo poly” where you live alone and have multiple partners with whom you have no plans to ever progress on the escalator is 100% up to you. A couple of people I know actually identify as monogamous, while practicing Polyamory through their partner being poly. Not my cup of tea, but that seems right for them.
What does this mean? If it's just physical attraction, why not date more attractive people?
Not saying the other poster is on that spectrum, just pointing out that many different brain configuration exist, with some going “all the sex” all the way to “sex? No thanks.”
It sounds horrifying and disruptive...
But, to me, even sex in itself would be unappealing so casually; the only thing that can overcome the surface-level, material ugliness of other humans enough to make me want to have sex with them is long-term familiarity and mutual interest, and that sounds pretty anathema to "leave anytime, no expectations lol". :p So I guess the typical relationship escalator is what feels most natural to me.
But then the poly model probably assures you a LOT more sex and relationships than mine, which requires meeting naturally and then building guarded, incremental trust, which, due to a mix of how our society is structured (there's HEAVY sexual partitioning of interests, hobbies, and careers) and my personality (I only engage with the most partitioned elements of society), ostensibly never happens for me. :D