If I am Alice and know Bob, I want to know Bob's address. Using the cell phone number, an address I already have for Bob, solves that problem. Verifying the number via SMS provides some reasonable (but not ironclad) guarantees that it actually is Bob.
Yes, as an address scheme, it prioritizes convenience over other things. If you want wide acceptance, that's a requirement. Wide acceptance can be useful if you need to adopt something in a hurry and you didn't think to set up something in advance. It's also great because it isn't exactly great opsec to look different from the crowd, and using Tor is a giant "HI I AM DOING CRIMES" beacon to the world.
1) The Signal protocol, which can have multiple implementations (WhatsApp, Facebook Messenger and Skype all use it), 2) The Signal client and server, which are open source, and 3) The Signal service operated by Signal Messenger, LLC.
You can use either 1 or 2 to implement a system that doesn't require a phone number to use. Wire, for instance, is a messenger that has adopted parts of the Signal protocol and the Signal source code. [https://github.com/wireapp/proteus/blob/develop/src/internal...]
What you can't do is change how the Signal servers operated by Signal Messenger are operated, or refer to your own client/server using Signal trademarks.
[1]: https://medium.com/@wireapp/axolotl-and-proteus-788519b186a7...