I have no allergies, so I can't imagine how that is. However, I had a back injury 3 years ago. I thought it'd heal fast but I got to the point of being afraid to carry my backpack when traveling somewhere. The chance of having an incredibly sharp pain makes me fear almost any kind of activity.

I also put off traveling before and now I regret not doing it while I was physically able to walk/hike around for hours on end.

I did physical therapy, swimming etc to make it feel better, but by now it's clear it will never improve past a certain point.

So yeah, travel while you can :)