I live in a rural'ish area with a decent deer population [1] . Most residents see them as endearing, while a minority see them as pests. Go a bit farther out into more rural (but not boonies) areas where people do more serious (but still personal scale) agriculture on their properties, and the ag-pest attitude becomes much more prevalent.
Ask any winemaker and they'll call deer a pest.
Fwiw I'm in the "magical" camp (being neighbors with a deer rescuer will do that to you!) but understand the ag perspective.
[1] There's a family of deer that walk by my property every evening, and this morning I inadvertently startled a buck that was chilling out in front of the house -- they're very timid animals, which I guess is a big difference vs Kangaroos?
I know peers who get excited when we go for drives outside of the city limits, so they can see a Kangaroo. I get stressed out driving the car out of the city, because if you see a Kangaroo you're likely to run into it at a hundred k's an hour. They are a bit of a pest in the numbers they've expanded to.