I'm not sure why that's a problem for using vim, as if the only reason people use vim is to avoid using the mouse.