It’s convenient to omit that the Irish were not considered “white” when they were being discriminated against. They were instead considered their own, distinct race. In most contexts, “white” implicitly meant “normal” and anyone you want to discriminate against got their own, separate label (see also the Jews and the Romani). That’s the crux of the problem.