>Out of curiosity, why would one consider him infamous?

IIRC claims were made that LeCun etc. were unfairly credited for work pioneered by him. As in, he pretty much invented modern ML but wasn't credited at all.