In absolute numbers, the nonreligious are growing. As a percentage of population, they are shrinking, largely due to birth rates.