riot/matrix is substantially worse in usability than Signal.

In addition, if you wanted something federated with decent crypto, an xmpp server with something as basic as TLS and OTR on the server and clients would be far more usable than matrix.