Talk to an employment lawyer. Seriously, they can help shed a lot of clarity on a situation like this.

There are a lot of different ways to game out a situation like this and they depend a lot on your relationship with your boss, what outcome you want, and the specifics of your agreements.