It's very easy to add exceptions for individual sites, for example letting youtube have f for youtube. You just click on the Vimium icon on toolbar and it pops up the dialog for that. Would take only about 5 seconds to do even while you are rowing.