Fellow speaker, and a large part of my "speaking with confidence" breakthrough was realizing this point exactly.

The other key unlock for me was the realization that I was the ONLY one in the entire room who would know when I fumbled a word or didn't deliver the content on each slide absolutely perfectly.