That's in the spirit of the analogy. Lead additive has a special niche purpose. Similarly IQ could be useful for measuring a specific narrow combination of skills and cultural background. (The first step towards rehabilitating "IQ" should be to rename it, though.)

Lead everywhere is as toxic as assuming IQ measures some kind of general intelligence.