I'm ok with paying $100 for internet access (well, not really, but still). If $100 cannot get me internet access at the advertised speeds, I'm ok with paying 120, or whatever additional cost per GB.
What I'm not ok with, is if $100 doesn't do it, Verizon goes out and shakes down the companies I do business with on the internet connection that I ostensibly paid for, who then raise their prices (gotta pay the bills) for reasons I don't understand. I'm still going to pay, there's no such thing as a free lunch. And not only does this obscure information about the real cost of my connection and the services I use (and that does matter), not only does it open the door to all kinds of anti-competitive practices around who gets the best deal with comcast/verizon, it's guaranteed to be less efficient than just upgrading the network and charging me for what it costs. Now I'm paying for all the hotel rooms and buffet spreads that went into that deal being struck? In addition to the cost of the fiber? Just build the fiber, and charge the customer (me) for it.
Now, you can ameliorate this somewhat based on per-GB charges, but people have an irrational hatred of that. The business deals on the backend are obscure, but at the end of the day, how much a customer spends on services on top of their internet connection is a decent proxy for how much utility they derive from that connection.
Is your case that more money would go to network improvements with the backroom deal routine? Have you considered that the backroom deal routine allows a lot more room for pocketing money and not really investing in the network?
But that's what it costs. Make it clear to the consumer what things cost and they'll either curtail their usage or cough up the money. Maybe they should have a charge per GB of transfer over some monthly limit. I don't know. But obscuring it through a bunch of additional business deals on the back-end isn't going to make those costs go away, it's just a way to hide them and delay the day when ISPs compete with each other on actual cost per GB delivered.
If he's on $OTHER_ISP, I'm sure he's not thrilled that some of that money is going to Comcast and Verizon.
No they're not. They cover, e.g., marketing to get you to hook up in the first place, but not, e.g., marketing to keep you from switching to Comcast a year later. They account for the cost of hookup, but not, e.g., ongoing maintenance.
As to your other point, charging up front is not the same as charging services that operate on top. The former effectively creates a cross-subsidy: my parents who just want fast-loading web pages end up subsidizing Netflix junkies. Now you can charge per-GB, but Netflix really doesn't want to go in that direction. They're quite happy with this implicit cross-subsidy.
"Market transparency" is a red herring. You pay $10 per month to Netflix, because that's the value of that content to you. You don't care if some of that money goes to Verizon any more than you care that some of it goes to the studios that own the content. Indeed, the "backroom deals" ultimately have the effect of allowing Verizon to capture the costs from the people who derive the most value from the infrastructure, because the consumer value represented by one GB is not equal across services.