Think of it in terms of life. Once you are dead you’re dead, it’s the end. If the variance in your life outcomes “crosses the zero line” then the game ends, even if it’s just for an hour.
You could bend your argument to cover that by arguing that the utility of that last little fraction tends to infinity. Like what would you exchange for the drink of water that would save your life if you were minutes from death?
But it’s a bit strained, especially as a way to explain it to someone for whom utility is not already intuitive.
I think it’s pretty easy to understand that excessive variance leads to death or very negative outcomes.
All you need to demonstrate it is a houseplant and a supply of water, air, and sunshine. If you increase the variance of any of those three things sufficiently you quickly don’t have a houseplant any more, regardless of the average total supply.
You gamble every paycheck knowing eventually you will get a big payout. You quickly pay for the waterline and now you don't have to walk 300 ft to the well everyday.
In the Philippines they even have a pooling system 'paluwagan' like this to make it possible for people to buy big things without a bank account or having to store large sums for large period of time which can be risky there.
If you've been in the position where every dollar you make gets somehow taken from you without warning for years you'd act differently. Goes from things like avoiding banks due to various fees or garnishments, up to practices of wearing expensive jewelry because it's a fairly efficient way to carry value on your person, and because you often get to keep it even when you get arrested, unlike the cash in your pocket.
That's why I mentioned that "avoiding variance" in itself is not a good argument. You avoid it for a reason and that reason is that (u(x - a) + (u + a)) / 2 < u(x) for vast majority of life scenarios.
In the context of money variance is usually synonymous with instability and unpredictability. Those things are bad and it’s worth paying a fairly priced premium to avoid them.
In simple math terms gambling is essentially the opposite dynamic. Of course things that are unpredictable can be entertaining, which is why gambling is correctly viewed as a form of entertainment.