It's worth it. It really is. At some point you will marvel that you ever thought it was a good idea to navigate filesystems with the mouse, or edit text in a non-modal editor.
- No configurations/installs from previous projects screwing things up (I know you can use tools like RVM and virtual-env, but in my experience starting from scratch is easier).
- Snapshots. It's great to be able to restore from a snapshot when you bork an upgrade.
- I've become very good at configuring a basic LAMP stack from memory.
Screen+Vim and the ability to suspend/resume machine images makes for an extremely flexible and ubiquitous development environment. I've considered doing this with AWS but there are still odd times where I find myself without an internet connection.