Misleading title as he is still, currently, the Prime Minister of the UK. It's theoretically possible for him to stay on as Prime Minister even without being party leader, which is what he resigned from.

Though it would be quite a wild, and probably unprecedented, way of staying in office. Because it undermines the cohesion and legitimacy of the Conservative party itself.