This never presented a real problem in practice, but IIRC pip just silently installs over the other version.

And since we had a closed system, it was entirely on us to set it up correctly. It was just a discovery a couple years in that we hadn't properly thought of ahead of time.