I don't think that it's a good argument to make that anyone can do it, because it does require _some_ technical knowledge in order to do it. I'd make the argument that if it's not accessible to everyone, then I don't think it's a viable replacement for an app store.
To lean on F-droid as an example on the Android side, outside of the initial installation of F-droid(which can be done from your phone), you can easily browse F-droid and install apps.
I don't think it's as easy to sideload apps on iOS. I haven't done it in years(since my jailbreak days), but I remember that you needed to be on a Mac and needed xcode to do it. It's probably updated now to make it a bit easier, but from a quick Google it looks like you need to download a separate program in order to do it. It looks like other ways to sideload apps requires some abuse of developer certificates to make it work.
Is this seriously the argument?
There are multiple stores that you can try and get your product on. If Walmart doesn't work, then you could try Target, or Aldi, or Amazon.
You have literally one option to go with on iOS. You can't even "drive to a new store", as switching to Android costs hundreds of dollars, and not everyone is in a financial situation to purchase a new phone on a whim.
I won't argue about the specifics of this, Epic paid lawyers millions of dollars to draft a court document about the monopolization of the iOS app distribution store. I'd urge you to read the document first before drawing pretty poor parallels.
"Apple monopolizes the iOS App Distribution Market".
https://cdn2.unrealengine.com/apple-complaint-734589783.pdf