Lack of sleep amplifies stress. That's why people argue more frequently and are more easily agitated when they're sleep deprived.

A lot of the people who say this doesn't affect them seem to be bored video gamers with no career focus and no stress.

I feel like they'd feel it too if they had to work 12 hours a day and had some moderate stress.