I think you just need to avoid taking an all-or-nothing attitude here. Knowing that ultra-processed foods are bad is valuable, even if you can't totally eliminate them from your diet. I do agree it's an overbroad category with stuff that ranges from abysmally terrible to stuff that's just kinda bad, but it has the upside of relatively low complexity (if you had ten different categories of processed food, most people would probably just give up on understanding the concept in general).

I eat mostly fish/veggies/fruit/rice, but sometimes I have pasta (and worse, sometimes I have cookies). In general, I've worked to shift my diet to unprocessed (or processed but not ultra) foods over time. Being cognizant of it is helpful at restaurants, too - I love all kinds of food, so more often than not, going with the least processed option is a helpful decider among menu items.