The BBC Horizons documentary I mentioned above also looked into mussels as a source of meat. I don't recall pollution being mentioned as an issue, but it gave other reasons why even optimistic outlooks could only consider them a partial replacement, given the numbers we have for meat consumption today (not to mention decades from now).