Exactly. It is basically never okay to expect a quick reply, whether you are working remotely or in office. Doing that just fragments that person's attention and makes them get out of flow.

A long time ago when everyone was in office, a cultural norm was that if someone was wearing headphones, regardless of whether they were listening to anything, they do not welcome interruptions. That cultural norm was gradually eroded during the pandemic.