One of the dissenters is the chemistry experts, setting the charges in the steel factory, his specialization is something he can hold hostage and he takes it with him. Now you have a crew with no idea, producing low value steel, maybe even destroying the steelworks in the process. Once the factory is worn out, they all decides its to much hassle to run it and go fishing. Societal complexity does not hold up without external pressures.