> why do so many programmers think their job is inherently more special and difficult than everyone else's?

Probably largely because they get paid more than all of their peers when they start their careers.