Courts have ruled that it doesn't mean brief visits invalidate it. Whether you think that's appropriate or not, that's the legal precedent.

You are aware that the Trump Tower exists right?

He doesn't live there. He lives in Florida. Before that he lived in the White House.

The criteria for the tolling of the statute of limitations is to unavailable. Trump being the President was. This was meant for people going into hiding.