The main selling point of Signal is privacy. That's basically the only reason it exists - without it, why not just use WhatsApp, Messenger, Snapchat, etc?

What is the usability concern for no longer needing a phone number?