I don't see that argument having much heft. The people who are worried about their view being soured by billboards aren't the ones who are worried about what happens to poorer people. They move in different circles.