The problem with that argument (which people also use on animals like sharks) is it assumes that these other organisms haven't also been evolving in the human timeframe. Yes, you can find evidence of organisms that look more or less like modern bacteria or sharks long before humans existed, but the idea that these organisms haven't been under selective pressure since is false. Indeed, they are probably under greater selective pressure now due to the effects of humans on the planet.