Maybe I didn't convey my point well enough - I meant that if you find your workplace to be too distracting/unaccommodating/etc, then you can tell your manager that it doesn't work for you and leave to do your work somewhere else or some other time. There's no third party besides the people who might also be annoyed by your workplace's dysfunction but don't want to say anything about it.