The problem is when many people you want to socialize are inside the garden and the walls don't let you talk to them, and the garden keeper actively works to shape peoples perceptions of outside the walls as scary and confusing, so you just get blank states when you try to suggest ways to talk to people who can't or won't go inside.