I don't think it's fair to say Guatama was an atheist, at least in the common-use definition of the word. He doesn't teach about an almighty creator God, but there are plenty of unimaginably powerful, vast, supramundane beings that he interacts with in the Buddhist canon that your average atheist would deny the existence or possibility of.