This isn't really true. The heritability of IQ is pretty high. We know this from twin studies. Beyond this, adopted siblings, have a very low correlation coefficient of IQ by adulthood, but genetic siblings have a very high one.