I pretty much had this speech impediment and had to see a speech language pathologist to get it fixed :) Your description contrasting the two types of pauses nails it.
While Bush is indeed a really good example of how not to do it, his failing was not pausing. His failing was, as you say, confusion and incompetence.
See my post below.
The same could be argued about 'umms': that the 'umms' aren't the problem, confusion and incompetence is.
Another might be how you make a statement. The one you made here is positional. It's positional in that I feel you're trying to push me into telling you you're right.
I may well be wrong, but that's what I feel when I read your comment above.
So another something one might improve, in addition to eliminating umms, is to move from a positional stance to a principled stance. [START Starship Trooper voice] Would you like to know more?[END Starship Trooper voice] :-)
Ums in either case are a distraction, and to some annoying. The degree obviously varies from person to person. Being a good conversationalist is as counter-intuitive as skiing (where you have to lean forward when facing downhill) in that a good conversationalist is in fact a good listener, and only interjects to elicit more conversation from the other party. So... in a way you're right. Uming a lot when you're really just listening isn't going to affect anything ;-)
Making a speech is about communicting a message. There are many ways to structure that message, for example SCIPAB, but the structure and supporting slides, if any, can be spectacularly annihilated by a mediocre delivery.
To be exceptional you need to work on your delivery. That means slowing way down, not using ums and ahs, maintaining eye contact (I've addressed a 5000-strong crowd, so believe me when I say it's irrespective of the size of the audience), and getting your body language right.
Depends entirely on how good you want to be :-)
If you want to be exceptional you could do worse that start with The Voice Book (http://www.amazon.co.uk/dp/0571195253/ - Amazon.com is sold out). It's been derided somewhat elsewhere in this thread, but Toastmasters is another hugely useful route.
[Edit - forgot to describe SCIPAB]
(S)ituation
(C)omplication
(I)mplication
(P)osition
(A)ction
(B)enefit
I think there is a middle ground where 'umms' and general fillers make the communication more authentic and seemingly less rehearsed. Most people don't like listening to a robot, not even a well-rehearsed one.