Not practically, because once you make a library with an mit license available to anyone, they can give to anyone you didn't "want" to give it to, per the mit license.