Another thing that happened was that apex predators of domestic animals were suppressed and/or replaced by other predator domestic animals like the dog and cat. In general for lots of reasons the populations of humans grew substantially beyond what wild game could support.
Although deer in the US are something of a special case. They're really thriving, we could harvest quite a few more (and in a number of places desperately need to), heck, they're the most deadly animal in the US (through car crashes). This of course wouldn't happen in countries where meat was at more of a premium and/or where the population density was a lot higher.
In Australia they killed the megafauna but never went back to the agriculture they'd had and perhaps forgotten, or so said Jared Diamond in Guns, Germs and Steel.