Like you noted, a lot of the complexity comes from how the tools work together. There's version control, editing, code intelligence, test suites and test runners, different sorts of environments, and more. And every possible permutation and nuanced setup depending on the runtime you're using and depending on how opinionated and/or fickle the community is around whichever language you're using.
Meta-problems of this kind are seldom discussed directly and are difficult to improve upon. I suspect things will get better slowly, and problems we have now will seem trivial and quaint in the future.
EDIT: What heroku has done for the production environment, I want for the development environment.
Don't agree on the plateau so far as dev tools are concerned. Would be surprised if you haven't come across Bret Victor's ideas (http://vimeo.com/36579366). In my view, implementing those principles could really change how things are done. Can't wait to see what he comes up with over the next few years.
As to solving the core problem for now: the only solution is to just be really opinionated so far as beginners are concerned. Reasonable minds can differ on textmate/vim etc, but just showing students how to setup one solid set of tools on windows or mac (and more importantly, explaining it) would be a hell of alot more than is already out there. :)
I've been learning to code over the last few months, and while I've got a reasonable handle on it now, by far the most difficult thing for me was understanding how the dev tools work together (terminal, git, virtualenv etc.)
There seems to be a tendency for coders to underestimate how steep the learning curve on dev environment is for noobs. I think there's also a reticence to deal with a fiddly topic that depends so much on the settings that the individual has on their computer.
The irony is, you HAVE to understand dev environments before you can actually make code do stuff. I know more than one person who's been turned off by how hard it was to get started.
I know that means they probably didn't have the commitment needed, but for those that do, setting up dev tools as a hazing process still isn't fun.