Yes, there are exceptions, and the converse doesn't hold. But it works as a simplification when you're hunting for a job. You're right that the underlying problem is finding work where you're valued and, I'll add, where you work with great people. If pointy haired boss did the hiring, your coworkers are likely going to be inept to add to your misery.