USSR had this possibility on paper and even offered a mechanism for exit (a local referendum). In fact it was dissolved after all republics including Russia left it. Probably the reason it was a mostly peaceful process with few exceptions.