When you do an image search for trypophobia trigger images, you can understand it. While I won't be bothered by holes in some object that is expected to have them, the images of such holes being mapped onto faces and hands and such makes it obvious how these surface disturbances can be framed as grotesque.