> Think about it: if Signal didn't know that A was messaging B, how would they route that message to B's phone?

There is no need for signal to know because their servers are not involved to transport the message but only ip routing infrastructure in between and of course the two parties. That's P2P