So what? You say that like it is some great loss! I think the correct choice is to abscond from this culture of hero worship you're advocating for and see people for their good and bad qualities, and be ready to criticize them without hesitation.
> we cannot and should not hold an individual responsible for the mores of their time
That's the weakest argument. "Of their time"? Last week? Last month? 1,000 years ago? You can pick whatever date you want to justify your hero worship. Personally I don't see accepting the Neuremberg defense as an ethical (or sophisticated) position, but you do you.
If your argument is "your shirt with a picture of Lincoln on it offends me - he was a racist!", then I guess you can just kick rocks or whatever.
P.S. "racist" is lately feeling really close to "communist" of the 50s as far as how effectual it is in describing a person's character. A witch hunt, in other words.