The basic, core stuff is the opposite. Fractions, bedmas, etc. you don't care enough to talk about, but if I handed a problem that used those concepts you could do it in your head, because they're skills that have been developed down to an instinctive level.
Common factoring is dull. There's nothing to say about common factoring. But if I show you an equation where you can apply it, you'll spot it instinctively because you've had common factoring ground into your reptilian brain.
For example, nobody knows whether there is an efficient algorithm to factor integers (where efficient depends on the number of digits in the integer). However, there is an efficient algorithm to factor polynomials, and you can write all irreducible polynomials of a certain degree as factors of one mother polynomial.
Moreover, being able to factor integers efficiently would allow you to break a lot of encryption schemes.
However some concepts, limits, derivatives and integrals i remember perfectly well (5+ years later) because my math teacher explained how the all fit together, what they represented wrt the real world and how they can be useful and that actually got me interested.
Yea you need to know the basics, but i daresay busy work isn't the best way to teach them.