On the other hand, the population wasn't sustained. One or two generations of people on that island would still leave behind a good number of artifacts.

IMHO concern that the population wasn't large enough for multiple people to attempt the trick ignore the timescales involved. These events could span tens of thousands of years--longer than all of recorded history.