Two reasons. The first is that women tend to just like babies. Female friends want to hold a baby but male friends almost never do. Women get "clucky" around them, etc.

The second is that when my youngest was 6 months old I felt nothing for him. I saw a psychologist about this and they said it was really normal for dads to not feel connected to second+ kids until the kids are past a year.