I disagree. If I only had to come into the office, say, once or twice a week (3x might be pushing it) I'd be willing to live much further out because I'd be willing to tolerate a horrible commute if I only had to do it a small percentage of the time.

For example, in Austin, these days anything located within a half hour of downtown tends to be horribly expensive. But just go a little beyond that and house/real estate prices drop precipitously. You're going to see a boom in these exurbs as these "mostly remote" jobs increase.