Anecdotally, Japanese children learn to do arithmetic quicker than children from (e.g.) Sweden. But I've been unable to find real scientific confirmation of this.
And about Japanese: you forgot about counters for men, animals, flat things and so on.
You have ichi-ippiku-ippon-hitory - issai And absolutely fascinating "system" for "years old" - everything starts with -sai but 20 years is "hatachi"!
As soon as you're starting to count it's different.
But.. it's not. Japanese is not. Just because it's not metric with grouping doesn't mean it's irregular.
The numbers (as in one, two, three..) are actually generally from Chinese, with exceptions (particularly where there are two options, as for four and seven), but counters (for smaller values) are generally from native Japanese and therefore sound different from numbers, and also changes somewhat with whatever it is you're counting. Japanese is so logical and well-structured that it appears that to compensate for that ease, you have counters.. (though we could blame Chinese for that as well, pre-contact there were only a very limited number of counter types (counter types are flat items, round items, long thin items, people, years..), post-contact there are hundreds (but fortunately it's possible to ignore a lot of them).
But this is a welcome trade for the regularity and simplicity of the rest of the number system. Although the flexibility available in European languages as described elsewhere in this thread does allow for texturizing things in a poetic or evocative way. being able to get two or three jobs done with one set of words is sometimes nice even if it does make things complicated when all you want is the most common usage of those words.
Ouch. Just absolutely horrible. Swedish is amazingly regular compared to that.
Some languages have it much worse... I think Hindi is pretty irregular up to 100 .
It's easier to add 30 and 40 in your head for children, than it is to add 13 and 2! Because it's "3 ten and 4 ten" vs "<special word> and 2". The special word being "thirteen". The language is irregular for numbers up to 29 as 20 has a special word.
We should change 10, 20, 30, 40 to "etti, tvåti, treti, fyrti". It would be so much better!