I am not sure reopening private windows is a good idea, either, but Mac OS removed the rule "quitting an application closes its windows".

Given that, it is logical that it reopens private windows, just as, for example, TextEdit or Numbers reopen windows with content you never explicitly saved (even across reboots)