He's still Prime Minister until he's replaced. Which is probably inevitable, but like in all horror movies you need to make sure the monster is actually dead before your relax.