I disagree. I worked in construction and factories in the past. Problem solving at your typical physical job is easier mentally. Moreover, the duration and number of occurrences is much less. When I came home after work, I did not think about work compared to when I became a programmer. The physical exhaustion and aches were pronounced, but I didn't feel any mental exhaustion unless I was sleep deprived due to working overtime.