I heard of this through folk music. Fishing villages along the Cornish coast, South of Ireland, Devon, Somerset and Dorset were wary of attacks by "swarthy types", and that history is remembered through songs.