I think that's a great point, but I'd argue that one of the reasons that works well is that the developers are (typically) also the product owners, project managers, etc.

Didn't Google, GitHub, Valve, and some others used to pride themselves that most of the product owners/project managers/etc were also developers?

That's not necessarily something that companies couldn't adopt if it turned out to be a good way to run a remoting-based organization.