I've seen some examples that don't seem to agree with that. Programmers often don't need advanced math, but the ones that do, such as video game engine developers, seem to get fantastically good at it.

You need a lot of time to master any skill, and few jobs provide that for mathematics. At least, not with any diversity in problems. The degree provides some years of dedicated effort.