It still sounds sketchy to me. Threatening to leave is giving your employer an ultimatum. Personally, I think the rational response to this is to placate you, find your replacement, then fire you. If you actually have issues with your work environment, you should address those head on without the threat of leaving the company.