I agree, math is used as a domain for black box abstraction for the same reason banking is used for the example domain for concurrency and graphics for data abstraction - the domain provides good examples for trivial implementations.

A person no more needs extensive understanding of mathematics than they need such understanding of accounting or image processing.