Will switching from framework X to framework Y really increase my productivity? Is it a matter of not understanding how Y is so much more efficient to build thing than X or is it just hyperbole/marketing/cult. Switching to different product management software, different game engine, different 3d software, different wiki system, etc etc .. How can I know. If I believed everyone I'd be switching every week.
The lack of knowing you reference is exactly what I'm riffing on here. There are people who have leveraged Lisp features to huge benefit, and there's just no easy way to explain those features to people who don't use Lisp. "There's no way to say it in that language". To outsiders then, Lisp looks like a back-patting cult with no tangible benefits and yet an air of elitism. Similarly, those with "people skills" can't always explain the mental framework and skills they've built up to make themselves excellent at working with other people, but they can easily recognize those skills in another.
EDIT: Here's the article. http://www.paulgraham.com/avg.html
The whole thing is well worth the read, but for what I'm talking about here, you could skip down to read about the Blub paradox.
I've found this pattern of human thinking to repeat itself in countless places in my life. From politics to programming and everything in between, systems look like unusable chaos when you don't understand it and have not been able to derive a controlled benefit from it. Once you learn how to use it, everything falls into place, and you immediately see how blind others are to the system as you now understand it (the curse of knowledge).
Working with people effectively is a skill, and one as rare as competent programming. And when you don't know how to do it, it looks useless or arbitrary.