> The venerable Charles Thompson now above 80 years of Age, now and then calls to see me. I once suggested to him to write secret Memoirs of the American Revolution. “No—No said he I will not.—I could not tell the truth without giving great offence. Let the World admire our patriots and heroes. Their supposed talents and Virtues (where they were <[. . .])> so) <will> by commanding invitation will serve the Cause of patriotism, and of Our Country.” I concur in this Sentiment, and therefore I earnestly request that you will destroy this letter [largely about Washington's failings] as soon as you read it. I do not even wish it to be known that General W: was deficient in that Mark of true Greatness which so preeminently characterized Julius Cæsar, Henry the 4th: of France, and Frederick the 2nd: of Prussia,—the talent to forgive.
https://founders.archives.gov/documents/Adams/99-02-02-5755
I think this is true of a lot of history, really - anything "important" we've assumed a mythologized view of, mediated by schools and Hollywood. Myth is more powerful than reality, so I think until you bury yourself in primary and contemporary sources, it can come across as almost conspiratorial. And of course, I am not saying that Rush, or the antifederalists, were correct in all their criticisms or all they said: only that Washington's comments must be understood contextually, and that's almost always missing when people refer to the Farewell Address, or at best they have a very simplified view of the situation that preserves the mythologization of Washington.