I don't think you should feel bad for using heritability in its colloquial sense. I'm just saying that you won't be able to support the claim you made with the evidence you had available. That's how discussions work: you make claims, some of them hold up, some of them don't.