That’s not what that guy was saying; you’re taking hypotheticals literally. He was saying that even if he hadn’t had an affair or sold chips to China, a reason to oust him could have simply been fabricated if his rivals wanted him gone badly enough.

“Show me the man, and I will show you the crime”

I don’t think he was even making the case that his rivals were involved in this, only that if they really wanted him gone for advocating for open source models, it’s not like they needed this specific scandal to pull it off.