Though I listened to a 3 1/2 hour train-wreck of a conversation he posted on his podcast with someone who'd reviewed a recent book of his unfairly (in his opinion). He made a very strong effort to keep the conversation on track, and communicated as clearly as ever, but it didn't take long for the frustration to become clear to anyone who listens. My impression is, that as good a communicator as Sam Harris is, there's almost no way to salvage a conversation with a terrible communicator.
My advice would be just stop and think when you need to. It's completely fine and you will convey the impression that you are a serious and thoughtful individual, which is good. You can show that you were listening and are about to respond entirely through your body language.
If you feel uncomfortable with that, there are a bunch of simple tricks you can use here and saying "umm..." is not a good one. One easy thing is to always ensure you have a glass/bottle of water. If someone asks a tough question and you need time to think, wait until they have finished their question, then take a drink of water. No-one thinks this is even slightly strange and it gives you time to think and make a considered answer.
Q: "Where should we host our service?" A[instant]: "Well, you have X, Y, and Z." A[afterwards]: "X has these features, but Y might be a better fit for you because..."
It probably wasn't, but that phrase is friendly and buys time to prepare the actual answer.
I'm a bit confused. So if I understand you correctly, Sam is the one with clear, calm speech, but Craig is the praised "orator", yet he would appear "insane" in your living room. So which one do you think is the better speaker?
Oh you are way too hopeful. I've experienced so many times situations where I think "surely everyone is seeing through the speaker's BS" only to be severely disappointed.
It's easy to see the difference with examples. A good example of clear speech is Sam Harris. Even when debating contentious topics, he speaks in calm paragraphs.[1] I could imagine Harris behaving the same in a one-on-one conversation. Contrast that to his opponent, William Lane Craig.[2] If Craig spoke that way in my living room, he would appear insane.
Avoiding filler is necessary for oration, but it's not remotely sufficient. I think this app will improve people's ability to communicate, not bloviate.
1. https://www.youtube.com/watch?v=yqaHXKLRKzg&t=3556
2. https://www.youtube.com/watch?v=yqaHXKLRKzg&t=4226