Scammers could probably using random numbers to call/text potential victims, and the RNG has ended up generating your phone number. Or the scammer might not even be using an RNG.