Based solely on my observation as a "staff engineer", the engineers that suffer most from remote work are the junior engineers. They are the ones we've had to help along the most, proactively coach the most, etc.

I think there's something lost with not having junior engineers in office with senior and staff+ engineers.