Theoretically that's true but in practice there is ample precedent for Presidents refusing to enforce specific laws. In one instance (DACA) the Supreme Court ordered a President to continue a previous President's official policy of not enforcing certain laws against certain people!