I get what you're saying. I don't think it's contentious to say genetics influence intelligence. One thing that I strongly disagree with about the way intelligence research is done is that it seems highly based on tests of individual intelligence. There's no IQ test for groups of people.

We know that selection happens at the level of genes, not individuals. You can't measure the fitness of genes by evaluating their effects solely on individuals because their effects may involve ensembles of individuals. Since humans are highly social beings, I'd expect our genes to be selected for intelligence at the level of cooperating brains as well as individual brains. There doesn't seem to be much research on measuring this aspect of intelligence.