I do this too (in zsh), but maybe writing a function callable like this would work:

  with mydir make

Although you'd want to be able to write things like

  with mydir make && ./bin/myprog

and parse everything to the right of `mydir' as a shell pipeline. That might be the sticking point in fish.