We'd have to do private bi-directional NAT44. NAT is expensive to run and is one of those things that always breaks. It could work but it basically just makes permanent tech debt that will frustrate maintenance forever.

It also only really works when it's a 1:1 scale, as you add more networks the configuration grows with N^2.