Not sure where you live but in my town I pay 7€ per bin container (approx 50l) for non-recyclable waste but the recyclable stuff is free (which is probably still too cheap)
The bus stop is that close because people live densely here. Which means that there are many people per building, who collectively decide what size of garbage container to get and pay for it. I'd have to persuade a majority of the other flat owners to do the same in order to save actual money, otherwise I'd just have to pay for the container I don't use.
There aren't very many homeless people, so that problem is small. It exists but it's small. As for poor people, the garbage container is effectively included in the rent (it's a separate line item, not a separate invoice) and is cheap compared to the other line items, so that problem doesn't really exist.
As far as the homeless, I'd much rather they use the bins than leave stuff lying around the street, even if I pay more in taxes. I definitely would prefer they would put the aluminium foil and lighters in the bin to the current approach of letting it pile up in any handy alcove.
This is not to say that consumers paying for their trash solves all problems.
It does, however, provide an incentive to avoid "bad" trash in the first place. "Taxing" manufacturers doesn't (because those taxes apply equally to every manufacturer)
EDIT: To be clear, taxing the manufacturer works via contributions of ecological people in facor of the unecological ones. It's the opposite of what you'd want.