If you are happy with your choices, it does not really matter what others (especially random people on the internet) think so I'd say just ignore what others think :)

Plus I'd say that to have kids (in a family sense) does not necessarily mean they have to be your biological kids as I think that the bonding/family aspect of it is much more important than simple reproduction. Atleast for the mental well being of a person that is.