That only really happens if the on-site people neglect to provide the remote workers with a summary. Even when everyone still came in to the office, this happened to sick workers, people on different shifts, locations, teams, etc. In other words: it's about emotional intelligence and seeing yourself as part of a team, not working in an office.