While I agree in principle, congestion pricing is generally a monopoly and not subject to the ordinary pressures of supply and demand, which means there's little to stop the price from being too low or too high.
So nobody can say they benefit indirectly without paying.
Congestion is not a big deal. People willing to put up with it will put up with it. People not willing to will use the resource at different times. You will never have a system that does not get congested at peak times. The more capacity you have the less time the system will run at peak capacity (compare rush hour start/end times across cities to see this). Think of it like dumping a 5gal bucket into the sink and system capacity being the drain size. This statement applies to road, rail and everything else.
It is a big deal to people waiting on services like fire trucks and ambulances. It is a big deal to people breathing air near roads. It is a big deal to public transit users whose needs often get de prioritized in favor of private cars.
Furthermore, at artificially low prices, more people drive until congestion is unmanageable. Without that pricing your 45 minute drive might balloon to twice that amount of time. Congestion is so bad in NYC that interferes with city services, like busses.