Personally, I've found that it takes about five minutes for my hands to adjust when I switch between ergodox and laptop. (Basically working at home vs in a cafe). I'm a relatively speedy typist in either mode, but it does take adjusting to swap modes.

That said, this is why I am not using colemak on my ergodox- I dont want to further distance the two keyboards.