Never quit on your own goals.

Its fine to quit when other peoples goals involve using your man-power for their own gain and you see less and less reason to continue being a part of it.