I think as suggested prohobo, just use it as publicity and in the end people will realise that your book isn't shit. You may also try to go on some sort of podcasts if possible in a way to confront those people, as it seems to work these days.