Yes, because pogroms have solely been targeted against practicing Jews.

There are a ton of Jews who don't follow kosher law, who aren't particularly religious, etc etc. Yet they would be targeted by anti-semites.