More specifically, many were deists, which was culturally equivalent to atheism at the time. Jefferson even published a version of the New Testament with all mention of God or the supernatural removed.

http://en.wikipedia.org/wiki/Jefferson_Bible

Thomas Paine's deism was rather too godless for a lot of people's tastes, including Theodore Roosevelt.

http://atheism.wikia.com/wiki/Thomas_Paine