LTE handsets connect to any base station, at least on physical layer and management protocols. This is required for mutual authentication.

Some attacks abuse error indication prior authentication for location leaks and denial of service.

Once the connection is established, you're good.