Unfortunately headphones don't work that well. If it were possible to have whitelists and blacklists of people you could see and hear in real life then yes, headphones would be a solution.