You could go, as someone who's open to the possibility of spiritual enlightenment. And likes company. But if you really are an atheist, you'd probably be most comfortable with a Unitarian church. Or perhaps a Friends meeting.