Personally, I suffer from whatever it is that drives a person to think about what numbers mean.

The numbers themselves aren't a problem, I'm just pointing out that our cognition involves many overlapping layers of abstraction, and we're doing mathematics and every other mental activity in one or more of those layers.

That this seems to correlate strongly to real-world phenomena speaks well of the types of abstraction that nature has equipped us with.