Try Emacs again with evil and undo-tree installed. Evil behaves like Vim to a high enough degree that you’ll be comfortable with it if you’re comfortable with Vim. And I haven’t had problems with undo.

If that doesn’t work, how about neovim-gtk or vanilla Neovim in a terminal emulator that’s capable of handling Indian languages?