I assume the spammers buy "known active real person phone numbers" from somewhere (probably the awful carriers themselves), so it might be less likely for them to find a new Twilio number. But as soon as you give the phone number to some company that sells (or accidentally leaks) their customer data, that number will be burned too.