I don't see the practical difference between losing your land to invaders and losing your land to, say, sea level rise, in terms of one's ability to cope with it and survive.
In any case, this is a lot of argument over what was mostly a throwaway argument. The precise nature of the Easter Island collapse doesn't much matter since it's not an isolated example anyway.
Losing land to sea level rise - if it happens - happens so slowly and incrementally that there's plenty of time to move elsewhere or build levees or put things up on stilts. On a timescale of decades and centuries, things fall down and break; when you rebuild you do it a bit further inland or somewhere else.
We might be having problems because an ecologist's definition of "resources" and "consumption" is different from an economist's; I tend towards the latter. I fear that if we listen to the ecologists we might inadvertently create the very scarcity they fear.
(Matt Ridley briefly discussed the difference between the two in a WSJ article this week: http://online.wsj.com/news/articles/SB1000142405270230427990... )
What's special about "un-invaded land" is that it has a bunch of people surviving on it living in a certain way and if they've been living there long enough, their way of life probably works pretty well for them. If some important resource they need is getting scarcer it's NOT going to disappear instantaneously all at once as per the poetic image of a "guy cutting down the last tree" catching everyone by surprise. As any given resource gets scarcer it gradually gets harder and harder to rely on access to it, which means people first have a small, then a moderate, then a large, and eventually a MASSIVE incentive to find substitutes. Other ways of living. Other things to eat. Other forms of shelter. Humans are a creative bunch; if there are other POSSIBLE ways to survive, we're pretty likely to find them given the existence of hundreds or thousands of people in an area whose lives depend on it and who have some ability to share info, try out ideas, and copy what works.
Invasion is a massive sudden shock to the system; some massive shocks aren't survivable.