You may disagree, but the source and context do matter. If I say 'we should nuke the moon' people laugh and move on. If Trump says it's a completely different thing.

Trump spent years peddling lies and conspiracy theories, and getting right up to the incite violence line. His attempts to keep white nationalist on his side, by repeatedly having to be prodded to denounce them after showing some weird support is a problem. So yeah, if he said those things, it absolutely would count and may not count with someone else.