They are called public because they were opened to the public historically. The other institutions you needed to be clergy/royalty/peer of the realm or something like that.