yeah, exactly this: leave. Start applying for things. Use the "Relatively good" manager as your reference instead of the terrible one.

If you get an opportunity for an exit interview, write out a thing pointing out every way in which the terrible manager is terrible.

Encourage your co-workers to do the same.