For what reason? You say it's a total waste of time productivity wise. Imagine having this all the time, because it's how it looks like in an open space office.
This might be the reason why we are expected to work 8h/day. We simply waste most of our work time. It would be much better to be paid 2x more per hour and only really work 4 hours a day.
Also, working remotely does not mean my meetings have invitations or an agenda. You can call someone anytime. We have webcams on all day. I only have a calendar event if it is a planned meeting, like an interview with a new candidate, daily stand up, brainstorming session.
The huge advantage for me is that it makes me almost intangible to people like the local Director (technically incompetent and an ass) and I don't have to spend time with bullshit corporate "organizational work" like going to recruiting events and explain why we hire and promote only women (because targets). My yearly evaluation is also just a formality that I never spend more than 15 minutes for and I have the flexibility to pick the most interesting projects we have. If spending a couple of days per month in the office is the price, I am willing to pay it.
It is not about you being comfortable with IM, it is about doing an A/B comparison of the 2 options. You don't know what you don't know, if you don't compare with being in the office then "being fine" does not mean "it's better", it can be worse and you don't know it.
I am working from home a lot for ~ 12 years, I still go to the office from time to time not because I have to, but because it is good to. Those days are a complete waste of time in terms of productivity, sometimes I don't open my laptop the whole day, but they are priceless for other reasons; I talk to people all day long, the kind of discussions you don't plan and send invites with an agenda upfront.