To me agnosticism would be more the absence of religion, because the absence of religion doesn't imply any particular opinion on the existence or not of a God. One can believe there might be a God without embracing any religion.
So it is pointless to speak of whether you are “religious”. It makes more sense to ask how you are religious. It is far more interesting to discuss the merits of your religion or other religions than to go around pretending you don’t have one.
The fact that we are open to changing our mind if theoretically presented with strong evidence does not make us agnostic.
You’d probably also accept that sun is made of cheese if presented strong enough evidence but don’t call yourself agnostic about the topic given your current knowledge.
It is not a mere lack of belief, as agnostics can be said to lack belief in God as well. People who are simply ignorant of God also lack a proper belief in God, but this is not atheism, only ignorance. They simply have not come to terms with the subject and therefore have no position on the matter. An atheist does, however unsophisticated it may be.
This view that atheism is simply a lack of belief in God is common among the intellectually challenged New Atheist crowd and would have been ridiculous to the much more intellectually substantive atheists of old, like Neitzsche (who, btw, while an atheist, found it a horrifying thing; the other classic atheists could be described as world-weary rather than insipid, parochial, middle class triumphant).
That aside, "atheism" can obviously mean both things—with regard to a belief or the endorsement of an "existence" proposition. In the case of atheism/theism, the belief part plays a substantial role—it distinguishes between B(~p) and ~B(p), the strong and weak positions, respectively.
There are other ways besides ignorance or agnosticism to arrive at ~B. For example, if my view is that ontological claims can't be propositions, then obviously I can't have beliefs about them one way or another. Or I could reject all supernatural claims out of hand. Why would you insist that one take a firm position on whether "God" specifically "exists" or not? Isn't atheism just a consequence of these views?
To put it plainly, logical consequences of other views can make one an atheist just as much as rejecting p outright. One needn't explicitly endorse or reject every mystical metaphysical claim out there. That would be a bit silly, just as it's a bit silly that we've inherited a special word for "atheism" in the first place.
More than playing with words, not believing in god may be one of three things: irrelevant, a disadvantage, or a door to a better world. It is irrelevant if you observe the rites and traditions of your society anyway, e.g. if you celebrate newborn life at Shinto Shrines, and weddings and Christian Churches, and Christmas, and if your passing through this world does not intend to play with those "immutables". It's a disadvantage if you find yourself in an ostracized minority or simply disconnected from your neighbors. But it may also be a door to a better world if you yourself or your neighbor are gay, or if you yourself and your neighbor are medical researchers trying to understand why people age, or if you yourself and your neighbor are fighting for the rights of women in some dark corner of the world.
An atheist may write books where gods, angels and demons play with humans, and find it amusing and delight others with it. Or they may enter a church and find it pretty and feel empathy for the pain that move people to worship in such places. An atheist may come to terms with their irreverent faith on that pain not having to be an eternal part of the world, and may try to do something to change it.