I don't buy the point about forcing programmers to refactor either. Vim gives me access to commands that make text manipulation faster, which often means I can refactor faster.

In fact, I'd say that a slower refactor process would almost certainly discourage me from refactoring.