So no, it's not literally about his sex life, but pretending like that doesn't factor into the whole things seems like a very strange point for people to keep making. It may not be that 90% of the cause is "he had sex out of his marriage" but it's also not 0% (it surely doesn't make him a "good leader(tm)" if he's having sex with subordinates)