They were also alert to the possibility of socialism becoming another oppressive orthodoxy; Emma Goldman is famous for saying 'if I can't dance, I don't want to be part of your revolution' (although this is paraphrase of some wordier remark made in an interview). Murray Bookchin is probably the best-known modern exponent of these ideas.
The thing most/all self-identified libertarian socialists have in common is the perception that capitalism and the state are, if not one and the same, heavily reliant on one another, to the point that abolishing one without abolishing the other leaves in place the material conditions that make both inevitable. It ain't enough to replace state agencies with private corporations, because those corporations will simply become the state - nor is it enough to replace corporations with state agencies, because the bureaucrats running those agencies will simply become the new bourgeoisie or outright aristocracy.