That’s definitely a big factor, and I’ve noticed a similar pattern with cafes or other locations.
The office is just the most reliable “not at home” environment for getting work done for me—there’s no guilt about camping out all day, seating is always available, internet is reliable, and so on.
Even before COVID and the standardisation of remote work I got my best work done when I just grabbed my laptop from the office and went to a pub or a cafe to work.
There's some actual science in there how changing the place where you work makes it ... different somehow and you can focus on what you need to do instead of falling into old habits based on the location.