It is not even toxic. Modern development is cooperative to absurd level all too often. You don't have any ability to make independent decisions or autonomy pretty much any time. Literally everything is result of negotiation and compromise and what not.

Taking chance to do a bit of focused work and actually do it in that environment is not toxic. It is not like you have run of for months and refused to communicate. It is just ... getting slight bit of rest.