Prior to Lutheranism it was their unwillingness to convert, see Spanish Inquisition: https://en.wikipedia.org/wiki/Spanish_Inquisition
If you're seeking some negative stereotype that's true about them, you'll be disappointed to find out that the main one was their unwillingness to convert.
> The term originated in the Ivy League colleges and originally reflected a stereotype of old-line firms populated by White Anglo-Saxon Protestants (WASPs). The term historically had antisemitic connotations, as many of the New York firms known as "white shoe" were considered off-limits to Jews until the 1960s.
<https://en.wikipedia.org/wiki/Medieval_antisemitism#Restrict...>
> It has also been suggested that parts of antisemitism arose from a perception of Jewish people as greedy (as often used in stereotypes of Jews), and this perception has probably evolved in Europe during Medieval times where a large portion of money lending was operated by Jews.[245] Factors contributing to this situation included that Jews were restricted from other professions,[245] while the Christian Church declared for their followers that money lending constituted immoral "usury".[246]
https://en.wikipedia.org/wiki/Jim_Crow_laws
https://en.wikipedia.org/wiki/Apartheid
https://en.wikipedia.org/wiki/Canadian_Indian_residential_sc...
Not to mention that "just integrate" might mean abandoning your faith, language, customs, way of life etc.
Especially for Jews in Europe that would have meant abandoning their faith at a minimum.