Personally this slides from a near-perfect setup to a completely-awful setup once I need to leave my house and drive to an office (or luxury condo, apparently) to do this, for literally no reason.

I'd also reckon a typical remote team probably has more of the routine social interaction some other comments here describe as personally beneficial than this arrangement.