> Banning them would just further extend the isolation/echo chambers created by social media.

I'm not sure this is true. I know I don't see ads from all sides. In my experience the targeted ads just reinforce the echo chamber.