Yes, and then they just wait until you show up on their soil (say, on vacation) and arrest you then.

Remember Assange? He's fine as long as he stays in the embassy, but step into the back alley for a smoke and he's off to the hoosegow.