More specifically, many were deists, which was culturally equivalent to atheism at the time. Jefferson even published a version of the New Testament with all mention of God or the supernatural removed.

http://en.wikipedia.org/wiki/Jefferson_Bible