Why would it be unwise to think it works for everyone? Does doing sit-ups make everyone’s core stronger? Does doing squats make everyone’s legs stronger?
I have no idea what you were doing when you were meditating, but having anxiety about it is certainly not proof that it doesn’t work.
Maybe you didn’t have good guidance? Maybe you were having some benefit you didn’t notice or measure?
Preferring exercise over meditation doesn’t really make any sense? Exercise and meditation do not serve the same purpose. It would be best to do both with a good plan, it’s essentially impossible to do zero of either of them.
If someone told me exercise didn’t work for them, I’d simply say the same as I would to you, you must be doing it wrong (for your situation), or it is working, and it’s not at a fast enough pace for your liking.
What I would guess is going on would be loosely similar to someone who starts to exercise and does it with bad form and not enough conditioning for the exercises they try. So they get hurt or too sore and just think it won’t work.
I am fairly sure the issue isn't medical: I can code, drive, and read for hours at a time without losing focus. But meditation is still torture (as is having to sit down and watch TV). I have tried several times, I have done it every day for up to two or three weeks (willpower is not really an issue) but every time, after a while, I ended up feeling more trepidation and anxiety about doing it.
In addition though, I think there are good reasons to prefer exercise in certain cases (YMMV, and this is just my experience):
Stressing your cardiovascular system mimics the physical effect of a panic attack. And part of the reason that panic attacks occur is because something is wrong with the link between the physical and mental parts of the system. You can't solve it with looking at one side alone but it is useful to experience the physical sensation of panic without the mental side (hopefully, it can set things off). I don't meditation is as effective on the physical side, it may be effective on the mental side but not for me.
This is not going to be relevant for 95% of people. But it has been my experience of it. I also think it is pretty unwise to say it should work for everyone. If you get the impression that should work for everyone, and then you try and it doesn't work...you feel terrible (if you have a disorder, it is worse...you might feel shame). Unf, in my experience, this is fairly common within psychology too which has endless "universal"-sounding solutions with weak effect. It just isn't that simple. Try stuff. See what works.
Again, hopefully this will help someone. The number of times that I have tried meditation should suggest that I was convinced, past the point of logic, that I was the issue...not meditation...unsurprisingly, that belief elicited little progress. It makes more sense to just do what works.