In my current iteration, information does not flow naturally, but rather 1:1 and in-person along restricted paths, making it much harder to work remotely. So to build up a picture of what's going on, I connect with several other teleworkers and we try to compare notes on "what have you heard about X" and "who's working on y."
If the whole team is remote or acts like it (open communications, info flowing visibly, etc.) then remote working, remote bonding, remote team-building is natural and easy. I know; I've done it for years, building high-performance teams that see each other once or twice a year.
If you're the outlier and most everyone else is local, it takes a lot more effort, and even then can be very, very hard.
Some places are just easier to work for than others.
One of the biggest negatives for a remote employee, can occur if the entire company isn't remote: You're left out.
Regardless of how much code you produce, how well you communicate on slack, how attentive you are to emails, or how perfect you are at attending all the meetings... Bonds form in the office. If you're interested in forming relationships, making connections, and nurturing the social side of your career, be cautious of remote positions.
Either work for a company that is 100% remote, or, be aware that you may face a situation in which you don't feel entirely connected with the rest of your coworkers.