On the other hand, there are many minimum wage jobs, at least in the U.S., where living close to work is completely out of the question financially. So there's an implicit 2+ hour unpaid daily commute required to have that job.

I'm not sure how to give affluent people the freedom to exchange commute times for lifestyle choices without forcing the same lifestyle choices on the less privileged.