I read it as he was not invited. Some shrines in Asia have an "open zone", where people can hang out, take photos, etc. Then there's an inner zone for real devotees who live there, which the others cannot enter (not saying this is the case with Shaulin but it well could be).