For context, Diamond argues that the collapse occurred around 1600, much earlier than the 19th century slaving raids you mention. The first European contact occurred around 1720, with a 1770 Spanish estimate of 3000 people living on Easter Island. Honestly, it's not an outlandish thought that 887 gigantic statues were crafted by a larger population.