Then a lot of people don't need to learn maths beyond addition and multiplication.

I prefer the opposite interpretation though: anything can become a hobby or puzzle. That puts nearly everything on the "ok" side of your line.