Which is why you'll meet almost nobody that's a 'strict' atheist by that definition, and I'm afraid that I think this is a straw man, much more than the accusation you level in the following sentence -
> Of course many atheists will point to some specific religious belief as being unlikely without evidence, but that is a strawman
Not when they are actually closely held beliefs. What do you think it the proportion of religious people that have closely examined their beliefs in a philosophical manner and found an unanswerable question and recognised Dualism in their outlook?
Because in my experience of religious people, their beliefs have been every bit as literal as the ones the atheists lambast and which you write off as a straw man. It's the philosophically minded apologists that are the rarity.
Anything that it would make sense to call "god" - and certainly anything that would have a particular interest in what some jumped-up apes on an utterly insignificant little blue green planet orbiting a small unregarded yellow sun out in the uncharted backwaters of the unfashionable end of the western spiral arm of the Galaxy thought about anything - is absurd and unlikely. There may well be unknown entities, but they would almost certainly be no more godlike than any other object or force of nature we've encountered.
Here's the crux: What would make sense to call "god"? What would make sense to call "a higher power"? Personally, if there is any consciousness that exists on a different level than our immediately observable universe perhaps with a radically different relationship to space-time, I believe two things are true: 1) it's nature is likely to be so far beyond our understanding that we don't have the precepts to even begin to reason about it and 2) it definitely makes sense to consider such an entity in those terms regardless of whether it has a particular interest in earth-life or not.
Again, this is the semantic game that we play. It's easy to set up these strawmen based on our inherent anthropocentrism combined with past mythologies created to explain things which science subsequently provided better explanations for. However it is a huge leap to look at that progress and jump to the conclusion that our perspective is the one true lens on reality and that there is nothing beyond the reach of our instruments, logic and models.
Of course many atheists will point to some specific religious belief as being unlikely without evidence, but that is a strawman argument that comes down to the semantic question of defining "god" narrowly enough to make it seem absurd and unlikely. The larger question is whether the observable universe is the end-all-be-all of existence, and that is a philosophical question which outspans the reaches of the scientific method. One can assume Materialism and reject Dualism—many do because they find it silly to consider unanswerable questions and prefer to assume a deterministic universe which could theoretically be fully understood from our meat sack bodies given enough time and resources—but unfortunately this belief is based on faith; it can not be proven anymore than the Halting problem can be solved.