Having kids is expensive (even when health care and education is free, they eat and wear clothes and play sports and stuff!). People also want to work and not just raise kids, I think. I don't know of anyone with half that many kids.

I think the Swedish culture is also very practically minded. (Romance is dead!) Which means the practical drawbacks from having a big family (car size, expensive vacations etc) will weigh a lot.