We also have the insurance component: Say some famous musician and a few influencers decide to launch a new music festival, get a lot of money paid to their festival-making company, and then, due to mismanagement, fail to have a working music festival. Most of the people that paid with credit cards will ask for refunds, and will get them, even if the festival company goes bankrupt. Some of those people managing transactions hold the bag, and end up losing millions in refunds. There's also a wide gamut of fraudulent operations that will try to extract money from the system, either by posing as merchants, or as customers. Some of that fraud is also eaten by the companies that handle the transaction.
So while fees could go down in a world with little fraud (and they do, as companies that are large enough, and have sufficient controls, end up negotiating serious discounts), it makes sense for fees to have a flat base and a percentage base, even if the entire system between you and your customer was just attempting to break even. The right percent though, barring the most fraudulent of environments, has nothing to do with a 30% cut.
And the banks that issue the cards are the ones that pay points/get interest, not Visa. Visa simply processes the transactions. If you noticed, your "Visa" card has a bank issuer, like the Capital One Quicksilver card (which uses Visa network)
The cost of running a transaction network has nothing to do with credit card points, insurance, chargebacks. Those are all handled by other parties.