"There is nothing that inherently links "one" to "first", or "two" to "second"-"

Uhm, no, just the opposite.