If you include the ejected mass, then momentum is conserved in that system. The ejected mass goes one way, the rocket goes the other. The momentum of the rocket is equal and opposite to the momentum of the ejected fuel.

Not true for the EmDrive.