But, the belief in a Higher Power, a God, a Creator of some sort, is rooted in using logic. That is something that I don't understand how someone can deny.
God's existence, if He were to have a reasonable fraction of the attributes ascribed to him, would be trivially provable to the most hardened atheist.
The fact that that hasn't happened, with no clear reason why not, is quite tricky for a lot of sceptics to get passed.
The best way I've heard it put is that Athiests believe there is no God. Agnostics believe that it is unknown and unknowable whether there is a god.
Yes, technically, I'm agnostic about a teapot orbiting Mars, or an invisible unicorn living on the Moon... but it's a reasonable statement to just say flatly "there's no such thing" until someone presents some pretty solid evidence that's incorrect.
I've also heard folks make a distinction between "weak" and "strong" atheism; weak being "I don't believe there's a God, but I could be convinced with good enough evidence" and strong being "nothing would convince me of a God".
That said, if the evidence were significantly more convincing, I'd change in a heartbeat.