The thing is, as long as we're using phone numbers as user handles, you have to trust the provider with your phone book. Signal tries as hard as possible to avoid it (all phone numbers are hashed), but if they wanted, they could simply brute force all the hashes since the search space is so small. There's no good solution to this.
I ask knowing very little about their security model.
It seems like we (most humans who use communication devices) are doomed to be stuck in advertising-based-single-corporate-walled-garden solutions.
They don't have to - Open Whisper Systems is a non-profit with strong community support. It works out so well that they actually pay any contributor a few dollars per commit. That's the best monetization there is for an organization which serves the community.
There's a table comparing Wire and other systems here. [2]
I still have Signal and update it whenever there are updates, mainly to see what's new or changed, but prefer Wire for the better feature set and UX. Telegram still remains my most used messaging client due to its UX and speed (even Wire is slow and lacks some basic features like message delivered and message read indicators).
I've been waiting for a long time to switch to Signal (or to Wire), but the improvement seen is quite slow over time (just my experience). Telegram has been moving rapidly on feature addition.
[1]: https://wire.com
[2]: https://wire.com/privacy/