I would say that positional notation, Zermelo ordinals and Church numerals are just ways to encode numbers. I would never call them numbers in the strictest sense of this word. Just how your C code is not an algorithm.

I would say I knew what 5 was even before I learned any notation or written language whatsoever.