Right. Emacs modes are more context-oriented ("I'm editing XML, so give me navigation commands that natively understand that syntax") while vi modes are operation-oriented (either inserting/appending or navigating/editing). In the vi sense, Emacs is always in both modes, so you need to press modifier keys to categorize actions (and if you're unlucky, you may find yourself gradually growing crab claws for pinkies).

There's an editor synthesis waiting to happen, but decades of old elisp means there's a lot of inertia for new editors to overcome.