I'm in the middle of reading Nonverts by Stephen Bullivant, about the variety of people who grew up in a religion and "converted" to no religion. He makes the argument that it's incredibly difficult (bordering on pointless) to make sweeping generalizations about all of them at once. His book is sectioned by which religion these non-believers came from, suggesting that their religious background accounts for a lot of who they are without religion.