We don't have to wonder about this. It's come up more than once before SCOTUS, and SCOTUS decisively rejected the idea. To apply border crossing doctrines to a search, the case has to have some nexus with an actual border crossing.

People live a couple miles from the Canadian border do not, in fact, lose their 4th Amendment rights.