I have them both mapped to British layout and my fingers just "know" where things are. However, my conscious brain might not. I actually had to think really hard about where the '#' key is. On the American layout, it's printed above the number 3 (Shift-3), but actually produces the '£' symbol. The hash is above the return key and is printed as '\'. On the German keyboard it's actually in the "right" place, just to the left of the return key.
The biggest key I have problems with switching between American and British keyboards is the @ symbol. If I don't remap the keyboards, I'm forever typing " or @ incorrectly. On un-remapped German keyboards it's Y and Z.
I still try to buy my personal laptops from the UK, so I have the correct keyboard. It's a surprisingly big productivity loss to have incorrectly mapped keyboards.
My habit when I have to use a Mac is to switch to the Australian mapping, which is the same as the British one but with £ and # switched.