It's completely natural to be attached to the process of your job, rather than the outcome. It's not a phenomenon restricted to mathematics. We can say it shouldn't be like that, but it is.