For all intents and purposes, CS is a kind of math, it's just a different flavor than, say, differential equations. The amount you need to know to get a job is just pretty low compared to the depth available for study.