It is sheer overbearing arrogance no matter how good you are at what you do.
Arrogance is not a characteristic reserved only for the less competent, and it is never a positive trait in even the most competent.
The only difference between a competent jerk and an incompetent jerk is that it may be worth your while to make an effort to look past the less-than-desirable qualities of the competent jerk in order to take advantage of the good advice he or she may have. This does not mean that competence excuses a jerk from the responsibility to learn how to not be a jerk.
I think what you may be trying to say is that it's reasonable to tolerate an arrogant jerk if their skills truly tip the scales in their favor. That's fine, but I'm saying that everyone, including the most skilled jerk, has something to gain from purging arrogance from their personality.
Interpersonal skills are always a great thing to have.
It's just that, among those that are really, really good at what they do, they tend to adopt this attitude of arrogance, and like you say, the only time it should maybe be tolerated is if they're really that good.
In one instance, my colleague noticed a potential security hole in a PHP application and notified the lead ... who ignored it because "the application is running fine and I don't change production code lightly". Which is laughable because this dude actually edited code directly, live on the servers; there were no test servers, and we weren't allowed to set them up, so we just had to test what we could locally and cross our fingers when it was sent up to the real environment.
And so on. I mean, I could go on with things like this for a long time. But, the point is, it wasn't that he disagreed, it was that he was entirely unreasonable and wouldn't ever even listen. If you have a group of people that do things fundamentally different than you and aren't interested in adjusting, then it makes sense to jettison them for those who are somewhat more compatible. The thing is that we were interested in adjusting and adhering to style guidelines, corporate conventions, and similar, and I personally haven't had any substantive problems following varied style guidelines in the past, but they had no conventions or guidelines here, and developers were just left to catch on as best as they could and hope that it wouldn't set off the existing members of the "company family" ... which wasn't easy here.
And it's more than just the style guidelines. The act of physically typing code is not that exciting for most developers. This guy was not open to any input at all, and would shoot us down swiftly whenever we brought something that wasn't praise. It wasn't a matter of just disagreeing and then not being able to accept the boss's decision. The problem was what I typed, that he expected robots that would deliver without questioning or working to find the best solution. The whole point of an IT team is to work together and contribute and everyone listens to everyone and comes up with the best combinations of concepts, methods, etc. That's how a team of engineers works, and that's what makes IT enjoyable. That's not how it worked there. There, it's "Defy guy and be ridiculed and fired".
This is enough for now. You get the drift, I hope. They've been through three different sets of qualified people now (all the while oblivious that this man is the reason why all his subordinates left, despite being notified of such), so I think that's the main reason they've settled on on-the-job development training for designers instead of real programmers.
If you're absolutely certain you're correct, it's natural to want to limit the amount of discussion, feedback, and argument you have to deal with. You've already made up your mind, and that's that, and it's unlikely that a convincing enough argument exists that would cause you to change your mind.
The catch is, you have to be really, really good at what you do in order to adopt this stance, otherwise it's just sheer overbearing arrogance.
That's where the conflict comes in. Most people, frankly, aren't that stellar at what they do. A lot of folks kinda muddle along, and often change their opinions about accepted practices whenever they read something that takes precedence over their experience. If you doubt this, I think you need only to read some of the security-related threads here on News.YC, or just about any thread on OpenBSD-misc that incurs the wrath of one of the developers.
Furthermore, if he was the team lead, and he established a particular syntactic convention -- for whatever reason -- and you didn't follow it, then -- and I say this as gently as I can -- you weren't doing your job. That doesn't mean you were incompetent, and I'm not looking to insult you. But, basically, you weren't following his rules, and he was within his authority to establish those rules. It sucks that his rules weren't written out, but on the other hand, it's really not all that hard to look at some code and then format yours similarly. (Especially with CSS.)
Then apparently the lead developer started hiring what you call monkeys. I call them trainable.
See, my grandfather had a similar problem. He was one of the best RF and cable TV distributions systems guys in the Bay Area up until he died a few years back. He was an idiotic businessman, but when he was dealing with the technology, he simply was one of the best. (I could bore you to tears with stories.)
He absolutely refused ever to hire anybody else with cable TV experience. He hated dealing with them, because they'd been taught all of these bad habits that he would first have to un-teach before he could even begin to get them to do things his way -- the right way. Instead, he hired people with no experience at all, and they naturally just followed his lead, along with a little coaching.
It isn't quite possible to do just that in software development, because I think software development requires an entirely different kind of thought process from just about anything else. But, I can see the appeal to hiring inexperienced developers, and making them do it your way right from the beginning.