> (and I suspect it was originally used on systems without arrow keys...)

This is correct! The vi editor was originally created on a ADM-3A terminal which had the arrow keys on HJKL.

http://www.catonmat.net/blog/why-vim-uses-hjkl-as-arrow-keys...