If you mean the dictionary definition:

> Those members of a group or political party holding extreme views

Then that's simply a subjective term, as is "extreme". By that definition "fringe" expresses nothing more than your opinion.

Thus, when you say Trump and Lenin were fringe, all you've done is clarify where you stand politically.