I do think remote teams can work very well but it has to be built with people who love to work remotely from the start. If you have a mix of people who can't work from home and need social interactions to be productive and combine it with people who want the opposite you are probably going to have problems.
I think it comes down to hiring for one concept or the other.
Sure you have to make boundaries and it helps if you have office so you can close door and isolate from rest.
Nowdays I try to teach my customers that I will work at least 1-2 days from home. Most times it works but some are not equipped for remote work at all.
It also takes discipline not to slack but that goes for on site worker as well or even more because they get more benefit of doubt being "seen to work"
I agree that face-to-face is great, but I also believe that it's vastly overrated as a necessity for "magic" to appear.
Tons of remote teams crank out magic all the time.