Signal forces you to use "a" phone number as your identifier. It does not have to be your primary phone number, or home phone number or office phone number. Just a phone number that you have control of.
In most parts of the world, you cannot get "just" a phone number not tied to your real identity.
1. the number everyone you have met since you were 12 has in their contacts.
2. the number a few people have but you also use for you facebook account.
3. the number nobody / no tech has but you have provided your legal id to the network provider.
4. the number nobody / no tech has and you gave the network provider a burner email for.
5. the number nobody / no tech has that you paid for in cash while wearing a wig and glasses half way across town. You put into a new, paid for in cash phone, activated and used briefly while carrying no other electronic devices while disguised and avoiding cctv.
6. the inbound phone number in the lobby of the ritz carlton.
Some of those are better than using 'firstname.lastname' as you identifier. 1&2 are definately public numbers 4&5&6 are not.
#3 in the real world is semi-anonymous - for those with real privacy needs, they should be taking many other precautions and shouldnt be carrying a tracking device or using a single phone number or service irrespective of it being in their name or someone elses or nobody at all. For privacy LARPERS of course it is not at all anonymous.
What metadata? Signal doesn't store anything about you aside the date you joined and the time of your last ping.
Last I checked, Signal uses AWS, Azure and GCP. All of those services are completely logged and although "Signal" may not be storing metadata, intelligence services on those networks definitely are.
Matrix OTOH would have a harder time getting adopted: businesses would need to update their websites, facebook pages and flyers to add the matrix contact info. Which they wouldn't do until Matrix is more popular. Which is a chicken and egg problem.
The most common client, Element, will by default ask you for your phone number when registering with the default matrix.org homeserver and the default vector.im identity server will associate your phone number with your matrix user.
So by default (changing servers and/or opting out is easy and encouraged BTW), Matrix already works like you would prefer.
This is BTW a main critique in the OP since it makes vector.im a PII and metadata aggregator.
of course it has, but so has the ability to NOT use a phone number. different use cases
The content of the message might be encrypted, but metadata can provide valuable intelligence insights.
At least Matrix can be used mostly anonymously through a user-generated identifier, without an email address or phone number, and can be used through Tor.