The fact that it is hardly necessary is the main facet here. We should not be killing and destroying homes for pleasure or entertainment. Unfortunately the pleasure part is already being done in the form of eating animals, so it's hard to argue a facet of morality that 99% of the world espouses with.
And that's totally fine. Nature also kills "all sorts of things", has all sorts of things killing each other, and could even wipe out the planet tomorrow with a huge comet or something...
Note that every time you wash your hands you're killing millions of germs...
What will you say? Survival of the fittest? Or immoral animal unnecessarily eating an innocent human being for its pleasure?
If you really believe that humans are just another animal, then we have as much right to eat them as they have to eat us--and they do.
Perhaps you're overthinking it? It's insects. For humanity it has been a non-issue killing them for the entirety of our existence.
What's next? "Is it ethical to kill cancer cells?".