Nah, you need them close to some work camps or else the limestone deliveries take months. And then the work camps need to be within 48 squares of a populated residence so the work-overseer can find workers.

Source: I played a lot of Pharaoh as a kid.