If the land of Joe's neighbours has no restrictions at all, it will be valuable. But if Joe's land has a weird zoning that says 'can only be used by Joe' that land would be nearly worthless on the market, but good for Joe.

Less extreme, if you have a neighbourhood with plots that allow unlimited building and a few plots that only allow single family homes, the latter would be a lot cheaper.