Yes, that is irritating though you can run M-x shell-resync-dirs to fix shell when it gets confused.

Generally I like to have bash available so that's why I use shell instead of shell.