Is atheism often framed within the context of theism? Well, sure, because that's the category of the discussion. Like you, I have a "don't believe; don't care too strongly; not a factor in my life whatsoever" stance toward religion. But if the subject of religion comes up, and I am asked to give my stance on the matter, atheism is a better label than most. "Apathetic atheist," or even "atheist who rejects the premise of this line of inquiry altogether" are acceptable and defensible flavors of atheism.
Atheism isn't specifically defined in opposition to the Abrahamic religions. It so happens that those religions (particularly, Christianity) occupy a majority of this country's religious population, and as such, they're the belief systems most often pitted vis-a-vis atheism, and vice versa. But there were atheists and agnostics long before Judaism, Christianity, or Islam.
Being an atheist doesn't have to mean much more to your life than not being a tennis fan. The state of not being a tennis fan is largely irrelevant until someone asks you if you watch tennis. At that point, you are temporarily and conditionally defined as a non-tennis-fan, within the framing of tennis fandom as a subject. But your non-tennis-fandom doesn't have to define your life, or even be much of a factor outside of that conversation.
Religion is a much more fraught subject than tennis. But the precise subject of the analogy wasn't intended to be 1:1 congruous. I'd be sitting on my butt for weeks, trying to come up with a different analogy, if I felt I needed a measure-for-measure match. :)
So because I don't believe in an Abrahamic god, I'm still supposed to take a stand/have an opinion on him. Why? Do Christians have an opinion/stance on Vishnu?