Most offices are filled with people who will do nothing for your career.

Sure, when you work with good people, youre right. But these aren't the majority.

I'd guess, that the best what can happen to the average employee is more time for their loved ones and less time with at best boring and worst toxic people.