(However, it is true that saying that genes contribute to intelligence isn't eugenics. Eugenics is a methodology where you attempt to selectively breed humankind by broader intent, rather than by emergent properties of human tendencies. A proposed trait to optimize is often intelligence, but similarly frequently it's attractiveness and things like that. Genetic influence on intelligence is simply a hypothesis whose testing would have consequences on the practice of eugenics.)
------- edit ------- I see your reply to the other comment. I think a quote from the article that makes your point far better is "[...] studies have consistently shown that genetic influence on individual differences in intelligence is substantial." I negligently assumed you were specifically talking about heritability.
From wikipedia (https://en.wikipedia.org/wiki/Heritability): "Heritability is a statistic used in breeding and genetics works that estimates how much variation in a phenotypic trait in a population is due to genetic variation among individuals in that population."
The section titled "Intelligence brings (some) genetics to ‘social’ epidemiology" addresses your concerns about environmental factors.
I don't think it's very controversial to say genes contribute to intelligence. Genes contribute to everything, how could they not affect intelligence? This isn't eugenics, nobody is saying we should (or could) use this information to selectively breed humans, and nobody is saying intelligence can be correlated to race.
We know that selection happens at the level of genes, not individuals. You can't measure the fitness of genes by evaluating their effects solely on individuals because their effects may involve ensembles of individuals. Since humans are highly social beings, I'd expect our genes to be selected for intelligence at the level of cooperating brains as well as individual brains. There doesn't seem to be much research on measuring this aspect of intelligence.
From the abstract: "Intelligence is one of the most heritable behavioural traits."