"by what moral authority can they block others access to it"

Actually, here in Scotland there is a fairly widespread recognition (apart, perhaps, from some large landowners) that a lot of land was acquired by rather dubious means. I think this provides a fairly decent justification for the "right to roam" we have over most land.