> For me, the biggest downside of working from home is how easy it is to get distracted by non-work. I go grab a coffee and end up putting dishes away, cleaning up, etc.

Sometimes taking a short break like that is the best way to make progress on a difficult problem though. Realistically we probably get 2 or 3 hours of actual work done in a day. Everything else is a bonus and it comes and goes over time.

I've been running rescuetime on my computer for most of a decade, and "my developer time"(time on terminal, few documentation sites like SO, editor etc...) goal was initially 1hr 30 minutes, but nowadays it is stuck at 3 hours.. and been not filled except for rare days.

> When I worked in an office I never worried about being the first to leave, and didn't even realize other people do.

A lot of it is scarcity vs abundance mindset. Many people are quite scared to lose their jobs. I know people making six figures who would be in deep shit if they had a month of no paychecks while switching jobs.