That's my point, why I bring up how bad hiring is. "Widespread best practice" in hiring does not imply effectiveness. Most companies are terrible at hiring. They just get away with it because other aspects of those companies are good enough to compensate.
Here's an example: let's say you're a typical startup, and you need to move fast. You need to think fast and you need to act fast. Let's say you've made the decision to hire people around that principle. You can ask someone about how they've coped with short deadlines, or to tell you about a time they had to get a lot done in a short period of time, and you judge them based on their responses to your questions.
Generally there will be a number of different principles, and there are also ways you can overdo them, but you want to decide on the right balance and the right mix and then conduct behavioral interviews to measure candidates against that.
The wrong way to do it is to make subjective judgments like, "I want to work with this person" or "I can really have a conversation with this person".
I'd never let a good culture fit override a poor technical interview, but I've seen the consequences of hiring a brilliant programmer that happens to be an asshole, and it's not pretty. Am I misinterpreting what you're saying, or do you really think social skills should be entirely ignored when it comes to hiring?
Because business decisions should be made based upon facts and data, not based upon hunches and gut feelings. Going with your gut basically means throwing out the data and letting all of your personal biases decide the matter, consciously or unconsciously.
If it's a question of being able to work with others, then you can develop principles and behavioral interview questions around what you want your coworkers to be like. That's a bit of a pain in the ass, but empiricism was always more of a chore than just following your gut instinct.
I feel like it might be almost impossible to remove gut feeling from the equation alogether, though, since a lot of the problems that wreck teams really do come down to "X really doesn't like Y's personality". At some level, isn't a negative gut feeling expressed by one of your team members as valid a data point as you can get to predict how well the person will work out on that team?