If we assume that the private-mode is "secure", then I suspect there's probably not a huge difference in practice.

But this way I'm very certain extensions, history, local-storage, etc, are absolutely not available.

(To be honest I tend to use this mostly avoid caching, and other things. Useful when you're testing redirects and new designs.)