If it's otherwise healthy, they won't kill it or even hurt it that badly. They loved the black walnut in our yard and I was worried about it, but by the next year they were mostly gone.