And to be honest, this might be a personal thing, but if a job isn't worth being in person for, then it's not worth pursuing at all. I know I'd much rather be with a few friends hacking projects together for pennies on the dollar than making 200k remote.

Agreed, except the biggest movers for my career have been social contacts made outside of work.

People incorrectly keep thinking about remote work only in a pandemic sense. Remote work doesn't mean zero social contact, it means more control over the social contact you have.