It also depends on what you're programming. I do iOS apps, which is basically just displaying pictures and grabbing data from the Internet-- no fancy math needed. Though I've been dabbling in OpenGL ES 2.0 recently and the shaders are kicking my ass with math!