Conversation, as opposed to written text, has a lot of "filler" designed to give the conversant time to formulate their words.
Your implication is that people who respond "on time" have thought less about their response than those who do not. More likely, they have just a better intuition for conversation that allows it appear that way.
I cut out most filler words out of my vocabulary years ago as I find them annoying but occasionally do use the "mhm" hum. That said, I will fully admit I'm a traditional nerd at heart and do lack intuition for nonsensical, "how's the weather" conversation.
But if you want to speak about something meaningful? A conversation that would flip the roles and leave the majority of the public at a loss for words, you would probably prefer to speak with me.
Most of my social interaction is at places where naturally curious people gather (like user groups / meetups).
This is why in most situations I let most people do the talking, and I focus on questioning them. I can judge what level they're on intellectually and as a bonus, people like to talk about themselves.
Pretty sure it was not intentional, it was just what he had converged on as his optimal conversational strategy, but it was incredibly frustrating for others. Partly just the endless pause, but also I think (after reading this article) that everyone is busily optimizing a response in real time while he talks, but when he stops talking mid sentence, suddenly the algorithm has no more input to process yet still knows there will be more coming at some point soon, so cannot complete and also cannot swap out, so instead goes into an uncomfortable spin wait state that gets quite exhausting after a while.
I think this is because some of us prefer to take time to actually think about a response, rather than just react.