> He's not attacking his person and it's not ad-hominem, he's saying the guy is basically a moral hazard, he is advocating for policies here that he won't have to suffer the consequences of.

That is ad hominem -- specifically, ad hominem circumstantial [0] -- and lies at the nexus between the genetic fallacy and appeal to motive.

[0] https://en.wikipedia.org/wiki/Ad_hominem#Circumstantial