This sticker only works against this classifier. If you start changing the algorithm, you'd need to change the attack to match.

If you think you can write a better image classifier by first segmenting the image before using ML, then I encourage you to get your own computer vision paper published and see how that works for you.