If the local culture is to carry your trash with you, the "right" thing to do is to adapt yourself to that culture, not the other way around. You're a guest. But yes, you're factually correct: if cities don't do this, far too many tourists will just toss their trash anywhere they please.
I'm certain a big part of the issue are the services that tourism creates a demand for, and their waste for which there are no easy solutions when the infrastructure is not there. Setting up proper infra in place is really the local administration's job.
Nobody said anything about a "garbage crisis". The comment that started this thread was that if you're in a foreign country, you shouldn't litter and you should learn how to say please and thank you in the local tongue.
The fact that people are arguing about this subject is telling. Never in my life have I said "oh, there are no trash cans here. I guess I can just toss my litter anywhere because the local officials didn't plan properly for my presence."
I hike frequently, so simply by going to a national park I harm the environment there. But I also pay for park passes which help fund those parks, and I refrain from littering and wandering off the track.