I worked remotely for 3 years in a high-profile company. Being remote helps control your time better. Coordinating anything with other people takes more effort, though, because you can't just walk around, see if somebody is busy, or out for a coffee, etc.
This is definitely solvable with technology, and will increasingly be solved.
There's also economy in employees providing their own computers, internet connectivity, and (most importantly) office space.
The only time I really felt overworked was while working 4 ten-hour days every week. I had zero time and needed one day of relaxation to make up for it, so the day was wasted nonetheless. I'll aslo mention that slews of people aren't lucky enough to do anything but work-related things during work. This is especially true if doing a low-paying job, even if there is downtime. "If you have time to talk, you have time to clean". Looking busy enough to earn your keep is a major theme to many jobs.
The next best schedule was weirdly retail, though. Around 40 hours per week, but I usually only worked 2-3 days in a row before having a day off, plus I got every other weekend off. Downside was working holidays - it was a pharmacy, after all. It just wasn't as productive as having 30-hour workweeks.
I spend more than 40 hours a week at work, but I actually work less than that whole time, because I have to wait for certain processes, or certain people, filling the gaps with activities like reading HN (as in right now).