Unless it has changed, the phone number verification is server-based. If an admin sets the verification level to Highest you will be prompted if you attempt to join their server:

https://support.discord.com/hc/en-us/articles/216679607