Math is a clean room where you don't need to worry about the concrete representation. Often the details of the representation and how they connect are more to do with human psychology (keeping things understandable) than with algorithmic heuristics.