This isn't the military, there is no higher purpose or mission. This is about shareholder value. Why sacrifice yourself for some shareholders you've never met in a one-sided deal, when you can just go work for someone who is willing to meet you halfway?

That's my point: go work somewhere else. You can't work in a team that does pair programming and choose to work at different times. It's about culture match. If you don't fit the team, don't expect the team to fit you.