It's not a mathematical or in any way strict thing. It's just a number chosen to exemplify any number. Just like "foo", "bar", "baz", "qux", etc, a sequence of numbers could be e.g. 17, 42, 4711. I grew up with it, and googling it seems that at least 4711 is a German thing.