While that is the smart way to go. The USA is one of the few country's that will allow you to become stateless.[1] But I am not sure why you would ever do that.

[1] https://en.wikipedia.org/wiki/Renunciation_of_citizenship#St...