'Harder' is subjective.
Programming is 100% beyond a doubt harder. My brain is mush at the end of a good day of programming.
Making doors? Physically tired but mentally fine.. and I find the physical side was easier to recover from.
So I get the door making -> programming is "harder" and I make about 10x the money.. but I would not say it was 10x harder, maybe 1.3x harder.. so clearly programming is a better job for me than door making.
So have I, and I come to the opposite conclusion. Does my anecdote trump yours?
As mindless as work like that tends to be, there is a kind of zen quality to it. I think the trick now is to find a hobby that lets me turn off the left side of by brain for a while to do something so simple, yet satisfying.
In my opinion, our brains have a way of painting the bad old days in a nostalgic light. I would posit that if you were forced by circumstances to chuck boxes for 8 hours a day with company-specified arrival and departure times plus company-specified breaks, you would not relish it. But that's just my opinion.